State Estimation in Multi-agent Decision and Control Systems
نویسندگان
چکیده
This thesis addresses the problem of estimating the state in multi-agent decision and control systems. In particular, a novel approach to state estimation is developed that uses partial order theory in order to overcome some of the severe computational complexity issues arising in multi-agent systems. Within this approach, state estimation algorithms are developed that enjoy provable convergence properties and are scalable with the number of agents. The dynamic evolution of the systems under study are characterized by the interplay of continuous and discrete variables. Continuous variables usually represent physical quantities such as position, velocity, voltage, and current, while the discrete variables usually represent quantities internal to the decision protocol that are used for coordination, communication, and control. Within the proposed state estimation approach, the estimation of continuous and discrete variables is developed in the same mathematical framework as a joint continuous-discrete space is considered for the estimator. This way, the dichotomy between the continuous and discrete world is overcome for the purpose of state estimation. Application examples are considered, which include the state estimation in competitive multi-robot systems and in multi-agent discrete event systems, and the monitoring of distributed environments.
منابع مشابه
Utilizing Generalized Learning Automata for Finding Optimal Policies in MMDPs
Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...
متن کاملComplexity management in the state estimation of multi-agent systems
This work addresses the problem of estimating the state in multi-agent decision and control systems. In particular, a novel approach to state estimation is developed that uses partial order theory in order to overcome some of the severe computational complexity issues arising in multi-agent systems. Within this approach, state estimation algorithms are developed, which enjoy proved convergence ...
متن کاملVoltage Coordination of FACTS Devices in Power Systems Using RL-Based Multi-Agent Systems
This paper describes how multi-agent system technology can be used as the underpinning platform for voltage control in power systems. In this study, some FACTS (flexible AC transmission systems) devices are properly designed to coordinate their decisions and actions in order to provide a coordinated secondary voltage control mechanism based on multi-agent theory. Each device here is modeled as ...
متن کاملOptimal adaptive leader-follower consensus of linear multi-agent systems: Known and unknown dynamics
In this paper, the optimal adaptive leader-follower consensus of linear continuous time multi-agent systems is considered. The error dynamics of each player depends on its neighbors’ information. Detailed analysis of online optimal leader-follower consensus under known and unknown dynamics is presented. The introduced reinforcement learning-based algorithms learn online the approximate solution...
متن کاملRobust state estimation in power systems using pre-filtering measurement data
State estimation is the foundation of any control and decision making in power networks. The first requirement for a secure network is a precise and safe state estimator in order to make decisions based on accurate knowledge of the network status. This paper introduces a new estimator which is able to detect bad data with few calculations without need for repetitions and estimation residual cal...
متن کامل