We introduce a model-based average reward Reinforcement Learning method called H-learning and compare it with its discounted counterpart, Adaptive Real-Time Dynamic Programming, in a simulated robot scheduling task. We also introduce an extension to H-learning, which automatically explores the unexplored parts of the state space, while always choosing greedy actions with respect to the current ...

Introduction Diffusion Tensor Imaging (DTI) is achieved by collecting a series of Diffusion Weighted Images (DWI) with different diffusion weighted vectors. For each DWI, it is usually acquired with multiple repetitions to boost the signal to noise ratio. Most of the MRI consoles saved the DWI after the K-space averaging automatically. Some other MRI consoles, such as the Siemens 3T human scann...

abstract background: end-to-side esophagojejunostomy has almost always been associated with some degree of dysphagia. to overcome this complication we decided to perform an end-to-end anastomosis and compare it with end-to-side roux-en-y esophagojejunostomy. methods: in this prospective study, between 1998 and 2005, 71 patients with a diagnosis of gastric adenocarcinoma underwent total gastrect...

The embryonic myocardium increases functional performance geometrically during cardiac morphogenesis. We investigated developmental changes in the in vivo end-systolic stress-strain relations of embryonic chick myocardium in stage 17, 21, and 24 white Leghorn chick embryos (n = 10 for each stage). End-systolic stress-strain relations were linear in all developmental stages. End-systolic strain ...

uses of ‘average’ differ in several ways from concrete uses. In sentences of the sort we are focusing on, in which ‘average’ is part of a definite description in subject position, the truth conditions of examples with concrete ‘average’ can typically be paraphrased as generic statements. For example, (4a) is true just in case it generally holds that individuals who are New Yorkers and are avera...

The concept of biologically inspired networking has been introduced to tackle unpredictable and unstable situations in computer networks, especially in wireless ad hoc networks where network conditions are continuously changing, resulting in the need of robustness and adaptability of control methods. Unfortunately, existing methods often rely heavily on the detailed knowledge of each network co...

VoIP (Voice over IP) is a service that requires synergy between the underlying network for transport and the endpoints responsible for voice processing. We evaluate the end-to-end quality and performance of several VoIP end-points. In particular, we focus on the following aspects: mouth-to-ear (M2E) delay, clock skew and behavior under packet loss. Our measurement results show that M2E delay de...

The end-to-end performance of dual-hop cooperative diversity systems equipped with nonregenerative relays and a selection combining receiver at the destination terminal over independent and nonidentical Nakagami-m fading channels is studied. Closed-form expressions for the cumulative distribution function and the probability density function of the end-to-end signalto-noise ratio (SNR) are pres...

Wireless sensor networks (WSNs) will play a fundamental role in the realization of Internet of Things and Industry 4.0. Arising from the presence of spatially distributed sensor nodes in a sensor network, cooperative diversity can be achieved by using the sensor nodes between a given source-destination pair as intermediate relay stations. In this paper, we investigate the end-to-end average bit...