A softmax operator applied to a set of values acts somewhat like the maximization function and somewhat like an average. In sequential decision making, softmax is often used in settings where it is necessary to maximize utility but also to hedge against problems that arise from putting all of one’s weight behind a single maximum utility decision. The Boltzmann softmax operator is the most commo...

Gradient-following algorithms are deployed for efficient adaptation of exploration parameters in temporal-difference learning with discrete action spaces. Global and local variants are evaluated in discrete and continuous state spaces. The global variant is memory efficient in terms of requiring exploratory data only for starting states. In contrast, the local variant requires exploratory data ...

The high precision measurements needed to exploit the physics potential of an ee Future Linear Collider with 0.5 1 TeV center-of-mass energy range set strict requirements on performance of vertex, tracking and calorimetric detectors. The CALICE Collaboration [1] has been formed to conduct the research and development effort needed to bring initial conceptual designs for the calorimetry to a fin...

A&E . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265 ABC Family . . . . . . . . . . . . . . . . . . . . . . . . . 311 America’s Auction Network . . . . . . . . . . . . . . . . . . . 324 Animal Planet . . . . . . . . . . . . . . . . . . . . . . . 282 Aqui2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 401 AUDIENCE . . . . . . . . . . . . . . . . . . . . . ....

This paper describes the Open Tourism Initiative (OTI) as a framework to support tourism activities, following the Tourism Virtual Enterprise (TVE) organizational model and pragmatics based collaboration decisions. To assure the better alignment among tourism services providers and client’s expectations, the framework (and its architecture) must support reliable interoperability and dynamic net...

The edible mushroom Agrocybe chaxingu was stored in packages with or without silicon gum film windows in three different modified atmosphere systems (5% O2, with 5%, 10% and 15% CO2) at a temperature of 3± 1 ◦C. The results showed that there were significant differences between the packages with and without the silicon gum film windows on O2, CO2, and ethylene concentrations, respiration rate, ...

RoboCup simulated soccer presents many challenges to reinforcement learning methods, including a large state space, hidden and uncertain state, multiple agents, and long and variable delays in the e ects of actions. We describe our application of episodic SMDP Sarsa( ) with linear tile-coding function approximation and variable to learning higher-level decisions in a keepaway subtask of RoboCup...