Lyapunov-Regularized Reinforcement Learning for Power System Transient Stability
نویسندگان
چکیده
Transient stability of power systems is becoming increasingly important because the growing integration renewable resources. These resources lead to a reduction in mechanical inertia but also provide increased flexibility frequency responses. Namely, their electronic interfaces can implement almost arbitrary control laws. To design these controllers, reinforcement learning (RL) has emerged as powerful method searching for optimal non-linear policy parameterized by neural networks. A key challenge enforce that learned controller must be stabilizing. This letter proposes Lyapunov regularized RL approach transient lossy Because lack an analytical function, we learn function network. The losses are specially designed with respect physical system. then utilized regularization train network penalizing actions violate conditions. Case study shows introducing enables stabilizing and achieve smaller losses.
منابع مشابه
A Reinforcement Learning Based Discrete Supplementary Control for Power System Transient Stability Enhancement
This paper proposes an application of a Reinforcement Learning (RL) method to the control of a dynamic brake aimed to enhance power system transient stability. The control law of the resistive brake is in the form of switching strategies. In particular, the paper focuses on the application of a model based RL method, known as prioritized sweeping, a method proven to be suitable in applications ...
متن کاملLyapunov-Constrained Action Sets for Reinforcement Learning
Lyapunov analysis is a standard approach to studying the stability of dynamical systems and to designing controllers. We propose to design the actions of a reinforcement learning (RL) agent to be descending on a Lyapunov function. For minimum cost-to-target problems, this has the theoretical benefit of guaranteeing that the agent will reach a goal state on every trial, regardless of the RL algo...
متن کاملLyapunov Design for Safe Reinforcement Learning
Lyapunov design methods are used widely in control engineering to design controllers that achieve qualitative objectives, such as stabilizing a system or maintaining a system’s state in a desired operating range. We propose a method for constructing safe, reliable reinforcement learning agents based on Lyapunov design principles. In our approach, an agent learns to control a system by switching...
متن کاملLyapunov Design for Safe Reinforcement Learning Control
We propose a general approach to safe reinforcement learning control based on Lyapunov design methods. In our approach, a Lyapunov function—a special form of domain knowledge—is used to formulate the action choices available to a reinforcement learning agent. A learning agent choosing among these actions provably enjoys performance guarantees, and satisfies safety constraints of various kinds. ...
متن کاملResponse Based Emergency Control System for Power System Transient Stability
A transient stability control system for the electric power system composed of a prediction method and a control method is proposed based on trajectory information. This system, which is independent of system parameters and models, can detect the transient stability of the electric power system quickly and provide the control law when the system is unstable. Firstly, system instability is detec...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Control Systems Letters
سال: 2022
ISSN: ['2475-1456']
DOI: https://doi.org/10.1109/lcsys.2021.3088068