Filippov Approach in Stochastic Maximum Principle without Differentiability Assumptions
نویسنده
چکیده
In this article, we establish necessary conditions for optimality in stochastic control of systems governed by stochastic differential equations with nonsmooth coefficients. The approach used is based on the approximation of the nonsmooth coefficient by smooth one which generate a sequence of smooth control problems. Ekeland’s variational principle is then applied to obtain a sequence of nearly optimal controls which satisfy necessary conditions for near optimality. By using the generalized notion of Filippov’s solutions and the stable convergence, we obtain an explicit formula for the adjoint process and the inequality between the Hamiltonians, on a good extension of the initial filtered probability space.
منابع مشابه
Stochastic Non-Parametric Frontier Analysis
In this paper we develop an approach that synthesizes the best features of the two main methods in the estimation of production efficiency. Specically, our approach first allows for statistical noise, similar to Stochastic frontier analysis, and second, it allows modeling multiple-inputs-multiple-outputs technologies without imposing parametric assumptions on production relationship, similar to...
متن کاملConvergence of simultaneous perturbation stochastic approximation for nondifferentiable optimization
In this paper, we consider Simultaneous Perturbation Stochastic Approximation (SPSA) for function minimization. The standard assumption for convergence is that the function be three times differentiable, although weaker assumptions have been used for special cases. However, all work that we are aware of at least requires differentiability. In this paper, we relax the differentiability requireme...
متن کاملRisk-Sensitive Mean-Field-Type Games with Lp-norm Drifts
We study how risk-sensitive players act in situations where the outcome is influenced not only by the state-action profile but also by the distribution of it. In such interactive decision-making problems, the classical mean-field game framework does not apply. We depart from most of the mean-field games literature by presuming that a decision-maker may include its own-state distribution in its ...
متن کاملStochastic maximum principle
The Pontrjagin maximum principle solves the problem of optimal control of a continuous deterministic system. The discrete maximum principle solves the problem of optimal control of a discrete-time deterministic system. The maximum principle changes the problem of optimal control to a two point boundary value problem which can be completely solved only in special tasks. It was probably the reaso...
متن کاملDiffusion laws, information and action principle
We study diffusion phenomena from the point of view of information theory. The system of interest with a given Hamiltonian is placed in the context of stochastic dynamics. According to the result of our recent work, this dynamic system maximizes its uncertainty of motion measured by a path information in order to follow the least action principle of mechanics. In this work, this methodology is ...
متن کامل