In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this setting by considering the environment is not given, but controllable and learnable through its interaction with the agent at the same time. Theoretically, ...

A selection of these reports is available in PostScript form at the Faculty's anonymous ftp-Abstract We consider the one-dimensional two-phase ow through a heterogeneous porous medium. The heterogeneity is due to the spatial variation of the absolute permeability and the porosity. Both these quantities are assumed to be piecewise constant. At interfaces where the rock properties are discontinuo...

Objectives—To assess oxygen uptake (V~O2), blood lactate concentration ([Lab]), and heart rate (HR) response during indoor and outdoor sport climbing. Methods—Seven climbers aged 25 (SE 1) years, with a personal best ascent without preview or fall (on sight) ranging from 6b to 7a were assessed using an indoor vertical treadmill with artificial rock hand/foot holds and a discontinuous protocol w...

A selection of these reports is available in PostScript form at the Faculty's anonymous ftp-Abstract We consider the one-dimensional two-phase ow including capillary eeects through a heterogeneous porous medium. The heterogeneity is due to the spatial variation of the absolute permeability and the poros-ity. Both these quantities are assumed to be piecewise constant. At interfaces where the roc...

We consider an immiscible incompressible two-phase flow in a porous medium composed of two different rocks so that the capillary pressure field is discontinuous at the interface between the rocks. This leads us to apply a concept of multi-valued phase pressures and a notion of weak solution for the flow which have been introduced in [Cancès & Pierre, SIAM J. Math. Anal, 44(2):966–992, 2012]. We...

We counted butterflies on transect surveys during Hesperia ottoe flight period in 1988-2011 at tallgrass prairie preserves in four states (Illinois, Iowa, Minnesota, Wisconsin), divided into units cross-referenced to vegetation type and management history. H. ottoe occurred only in dry and sand prairie types, and was significantly more abundant in undegraded than semi-degraded prairie, and in d...

The electrokinetic effect in a fluid-saturated porous rock is defined as the coupling and conversion between seismic and electric energies. When seismic waves propagate through a fluid-saturated formation and cause a pore fluid-flow relative to the solid matrix, the motion of the cations in the fluidflow forms a streaming electrical current and induces an electromagnetic wave at any discontinuo...