We consider a controlled stochastic system with an a.s. locally exponentially controllable compact set. Our aim is to characterize the set of points which can be driven by a suitable control to this set with either positive probability or with probability one. This will be obtained by associating to the stochastic system a suitable control problem and the corresponding Bellman equation. We then...

This paper is concerned with a compositional approach for constructing infinite abstractions of interconnected discrete-time stochastic control systems. The proposed approach uses the interconnection matrix and joint dissipativity-type properties of subsystems and their abstractions described by a new notion of so-called stochastic storage functions. The interconnected abstraction framework is ...

This paper presents a computationally feasible procedure for the optimal control and stochastic simulation of large nonlinear models with rational expectations under the assumption of certainty equivalence.

Existence and uniqueness results of fully coupled forward-backward stochastic differential equations with an arbitrarily large time duration are obtained. Some stochastic Hamilton systems arising in stochastic optimal control systems and mathematical finance can be treated within our framework.

In this short note we show that, in the context of stochastic control systems, the uniform existence of a limit of Cesàro averages implies the existence of uniform limits for averages with respect to a wide class of measures dominated by the Lebesgue measure and satisfying some asymptotic condition. It gives a partial answer to the problem mentioned in [18] and it provides an alternative method...