Traditional approaches to solving stochastic optimal control problems involve dynamic programming, and solving certain optimality equations. When recast as stochastic programming problems, structural aspects such as convexity are regained, and solution procedures based on decomposition and duality may be exploited. This paper explores a class of stationary, infinite-horizon stochastic optimizat...

This paper presents a continuous-time version of recent results on unconstrained nonlinear model predictive control (MPC) schemes. Based on a controllability assumption and a corresponding infinite-dimensional optimization problem, performance estimates and stability conditions are derived in terms of the prediction horizon and the sampling time of the MPC controller. Moreover, improved estimat...

For a system governed by Itô-type nonlinear stochastic differential equation with state-dependent noise, the H2/H∞ control problem is considered, which combines the H2 optimization with the robust H∞ performance. A cross-coupled Hamilton-Jacobi equations associated with the nonlinear stochastic H2/H∞ control are obtained, based on which, sufficient conditions for designing the finite and infini...

In an incomplete market, with incompleteness stemming from stochastic factors imperfectly correlated with the underlying stocks, we derive representations of homothetic (power, exponential and logarithmic) forward performance processes in factor-form using ergodic BSDE. We also develop a connection between the forward processes and infinite horizon BSDE, and, moreover, with risk-sensitive optim...

A great challenge China’s power sector faces is to mitigate its carbon dioxide emissions while satisfying the ever-increasing power demand. Optimal planning of the power sector with consideration of carbon mitigation for a long-term future remains a complex task, involving many technical alternatives and an infinite number of possible plants installations, retrofitting, and decommissioning over...

A class of infinite horizon optimal control problems involving Lp-type cost functionals with 0 < p ≤ 1 is discussed. The existence of optimal controls is studied for both the convex case with p = 1 and the nonconvex case with 0 < p < 1, and the sparsity structure of the optimal controls promoted by the Lp-type penalties is analyzed. A dynamic programming approach is proposed to numerically appr...

In this paper, a sequential quadratic programming method combined with a trust region globalization strategy is analyzed and studied for solving a certain nonlinear constrained optimization problem with matrix variables. The optimization problem is derived from the infinite-horizon linear quadratic control problem for discrete-time systems when a complete set of state variables is not available...

For a non-cooperative differential game, the value functions of the various players satisfy a system of Hamilton-Jacobi equations. In the present paper, we consider a class of infinitehorizon games with nonlinear costs exponentially discounted in time. By the analysis of the value functions, we establish the existence of Nash equilibrium solutions in feedback form and provide results and counte...