Team Optimal Control of Coupled Major-Minor Subsystems with Mean-Field Sharing
نویسندگان
چکیده
In this paper, we investigate team optimal control of coupled major-minor subsystems with mean-field sharing. In such a model, there is one major subsystem that directly influences the dynamics of n homogeneous minor subsystems; however, the minor subsystems influence the dynamics of the major subsystem and each other only through their mean behaviour (indirectly). In this model, the major and the minor subsystems are arbitrarily coupled in the cost and have meanfield sharing information structure. We propose a two-step approach. In the first step, we describe a mean-field sharing model with multiple types of minor subsystems as a generalization of the mean-field sharing model of Arabneydi and Mahajan, CDC 2014. In the second step, we use the results obtained in the first step to construct a dynamic programming decomposition to identify optimal strategies for the major and the minor subsystems. We present an example with numerical results to illustrate the approach.
منابع مشابه
Near-Optimal Controls of a Fuel Cell Coupled with Reformer using Singular Perturbation methods
A singularly perturbed model is proposed for a system comprised of a PEM Fuel Cell(PEM-FC) with Natural Gas Hydrogen Reformer (NG-HR). This eighteenth order system is decomposedinto slow and fast lower order subsystems using singular perturbation techniques that provides tools forseparation and order reduction. Then, three different types of controllers, namely an optimal full-order,a near-opti...
متن کاملTeam Optimal Decentralized Control of System with Partially Exchangeable Agents-Part 1: Linear Quadratic Mean-Field Teams
We consider team optimal control of decentralized systems with linear dynamics and quadratic costs that consist of multiple sub-populations with exchangeable agents (i.e., exchanging two agents within the same sub-population does not affect the dynamics or the cost). Such a system is equivalent to one where the dynamics and costs are coupled across agents through the mean-field (or empirical me...
متن کاملLinear Quadratic Mean Field Teams: Optimal and Approximately Optimal Decentralized Solutions
We consider team optimal control of decentralized systems with linear dynamics, quadratic costs, and arbitrary disturbance that consist of multiple sub-populations with exchangeable agents (i.e., exchanging two agents within the same sub-population does not affect the dynamics or the cost). Such a system is equivalent to one where the dynamics and costs are coupled across agents through the mea...
متن کاملLinear-Quadratic-Gaussian Mixed Games with Continuum-Parametrized Minor Players
Abstract. We consider a mean field linear-quadratic-Gaussian game with a major player and a large number of minor players parametrized by a continuum set. The mean field generated by the minor players is approximated by a random process depending only on the initial state and the Brownian motion of the major player, and this leads to two limiting optimal control problems with random coefficient...
متن کاملDecentralized Optimal Control for the Mean Field Lqg Problem of Multi-agent Systems
This paper investigates the decentralized optimal control of the linear quadratic Gaussian (LQG) problem in discrete-time stochastic multi-agent systems. The state equations of the subsystems are uncoupled and the individual cost function is coupled with the states of other agents. With the help of state aggregation technique and the mean field structure, we get the decentralized optimal contro...
متن کامل