A separation principle for partially observed control of singular stochastic processes

نویسنده

  • R. H. Stockbridge
چکیده

The analysis of partially observed stochastic control problems often replaces the unknown state process with its conditional distribution given the observations. This technique rewrites the dynamics in terms of knowable processes whose costs coincide with the original processes. This paper considers stochastic processes having singular behavior and presents an approach which separates the determination of the optimal control from the task of estimating the conditional distribution of the unknown process. It involves using a martingale problem characterization for the dynamics followed by a further characterization using occupationmeasures. This final characterization forms the basis for an equivalent linear programming formulation of the problem over the space of occupation measures. 2005 Elsevier Ltd. All rights reserved.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Partially observed non-linear risk-sensitive optimal stopping control for non-linear discrete-time systems

In this paper we introduce and solve the partially observed optimal stopping nonlinear risk-sensitive stochastic control problem for discrete-time non-linear systems. The presented results are closely related to previous results for finite horizon partially observed risk-sensitive stochastic control problem. An information state approach is used and a new (three-way) separation principle establ...

متن کامل

Balanced model reduction of partially-observed Langevin equations: an averaging principle

We study balanced model reduction of partially-observed stochastic differential equations of Langevin type. Upon balancing, the Langevin equation turns into a singularly perturbed system of equations with slow and fast degrees of freedom. We prove that in the limit of vanishing small Hankel singular values (i.e., for infinite scale separation between fast and slow variables), its solution conve...

متن کامل

LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels

This paper is concerned with control of stochastic systems subject to finite communication channel capacity. Necessary conditions for reconstruction and stability of system outputs are derived using the Information Transmission theorem and the Shannon lower bound. These conditions are expressed in terms of the Shannon entropy rate and the distortion measure employed to describe reconstruction a...

متن کامل

On necessary and sufficient conditions for near-optimal singular stochastic controls

This paper is concerned with necessary and sufficient conditions for near-optimal singular stochastic controls for systems driven by a nonlinear stochastic differential equations (SDEs in short). The proof of our result is based on Ekeland’s variational principle and some dilecate estimates of the state and adjoint processes. This result is a generalization of Zhou’s stochastic maximum principl...

متن کامل

A general stochastic maximum principle for mixed relaxed-singular control problems

We consider in this paper, mixed relaxed-singular stochastic control problems, where the control variable has two components, the first being measure-valued and the second singular. The control domain is not necessarily convex and the system is governed by a nonlinear stochastic differential equation, in which the measure-valued part of the control enters both the drift and the diffusion coeffi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015