In associative reinforcement learning, an environment generates input vectors, a learning system generates possible output vectors, and a reinforcement function computes feedback signals from the input-output pairs. The task is to discover and remember input-output pairs that generate rewards. Especially difficult cases occur when rewards are rare, since the expected time for any algorithm can ...

* Corresponding author. Tel.: +351 22 5580058; fax E-mail addresses: [email protected] (R.M.S. Cruz), m [email protected] (C.L.M. Silva). t of temperature abuses on the colour and vitamin C conturtium officinale R. Br.). c (AA) and dehydroascorbic (DHAA) acids, and colour, evaluated along a plan of temperature abuses, based on e period. A comparison between the hue angle and AA kinetic parameters ...

The main drawbacks of microwave heating of bioproducts (e.g. foods) are associated with its nonuniform heating patterns. The objective of this work was to derive optimal operating policies for microwave combination ovens in order to achieve better uniformity of temperature and/or quality. The corresponding optimal control problems were stated considering the microwave power and the oven tempera...

Adaptive immune responses are driven by interactions between T cell antigen receptors (TCRs) and complexes of peptide antigens (p) bound to Major Histocompatibility Complex proteins (MHC) on the surface of antigen presenting cells. Many experiments support the hypothesis that T cell response is quantitatively and qualitatively dependent on the so-called strength of TCR/pMHC association. Most av...

Continuous capacity modulation, for example by varying compressor speed, is only one alternative to conventional cycling of vapor compression systems. Cycling the compressor at higher frequencies (~0.01–0.1 Hz) than conventional systems (~0.001 Hz) offers a potentially simpler and less costly alternative. Experiments were conducted to quantify effects of steady vs. pulsed flow on the performanc...

A newly developed experimental model system was used to determine in vitro transformation-specific parameters which correlate with tumorigenicity. The data suggested that clonal herpes simplex virus type 2-transformed syngeneic rat embryo cells with intermediate, transformed rat embryo fibroblasts (tREF-G-1) or high, rat fibrosarcoma tumorigenic potential in syngeneic rats could be differentiat...

This paper introduces the Virtual Test Bed (VTB) for modeling, dynam and virtual-prototyping of power sources in the system context. Typical ele power sources such as battery, fuel cell and supercapacitor are first mod environmen and the capability of advanced visualizations of simulation results, make quite powerful. el cell, resistive-c INTRODUCTION The Virtual Test Bed (VTB) [1] provides a u...

The aim of this paper is to investigate the ascription of probabilities in a causal model of an episode in the history of science. The aim of such a quantitative approach is to allow the implementation of the causal model in a computer, to run simulations. As an example, we look at the beginning of the science of magnetism, “explaining” — in a probabilistic way, in terms of a single causal mode...

A preliminary hybrid particle-continuum computational framework for simulating hypersonic interacting flows is proposed. The framework consists of the direct simulation Monte Carlo-Information Preservation (DSMC-IP) method coupled with a Navier-Stokes solver. Since the DSMC-IP method provides the macroscopic information in each time step, determination of the continuum fluxes across the interfa...

Modern mobile communication systems must face conflicting design constraints. On the one hand, the expanding variety of transmission modes calls for highly-flexible solutions supporting the ever-growing number and diversity of application requirements. On the other hand, stringent power restrictions (e.g., at femto base stations and terminals) must be considered while satisfying the increasingl...