Lyapunov-Regularized Reinforcement Learning for Power System Transient Stability

نویسندگان

چکیده

Transient stability of power systems is becoming increasingly important because the growing integration renewable resources. These resources lead to a reduction in mechanical inertia but also provide increased flexibility frequency responses. Namely, their electronic interfaces can implement almost arbitrary control laws. To design these controllers, reinforcement learning (RL) has emerged as powerful method searching for optimal non-linear policy parameterized by neural networks. A key challenge enforce that learned controller must be stabilizing. This letter proposes Lyapunov regularized RL approach transient lossy Because lack an analytical function, we learn function network. The losses are specially designed with respect physical system. then utilized regularization train network penalizing actions violate conditions. Case study shows introducing enables stabilizing and achieve smaller losses.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Reinforcement Learning Based Discrete Supplementary Control for Power System Transient Stability Enhancement

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a dynamic brake aimed to enhance power system transient stability. The control law of the resistive brake is in the form of switching strategies. In particular, the paper focuses on the application of a model based RL method, known as prioritized sweeping, a method proven to be suitable in applications ...

متن کامل

Lyapunov-Constrained Action Sets for Reinforcement Learning

Lyapunov analysis is a standard approach to studying the stability of dynamical systems and to designing controllers. We propose to design the actions of a reinforcement learning (RL) agent to be descending on a Lyapunov function. For minimum cost-to-target problems, this has the theoretical benefit of guaranteeing that the agent will reach a goal state on every trial, regardless of the RL algo...

متن کامل

Lyapunov Design for Safe Reinforcement Learning

Lyapunov design methods are used widely in control engineering to design controllers that achieve qualitative objectives, such as stabilizing a system or maintaining a system’s state in a desired operating range. We propose a method for constructing safe, reliable reinforcement learning agents based on Lyapunov design principles. In our approach, an agent learns to control a system by switching...

متن کامل

Lyapunov Design for Safe Reinforcement Learning Control

We propose a general approach to safe reinforcement learning control based on Lyapunov design methods. In our approach, a Lyapunov function—a special form of domain knowledge—is used to formulate the action choices available to a reinforcement learning agent. A learning agent choosing among these actions provably enjoys performance guarantees, and satisfies safety constraints of various kinds. ...

متن کامل

Response Based Emergency Control System for Power System Transient Stability

A transient stability control system for the electric power system composed of a prediction method and a control method is proposed based on trajectory information. This system, which is independent of system parameters and models, can detect the transient stability of the electric power system quickly and provide the control law when the system is unstable. Firstly, system instability is detec...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Control Systems Letters

سال: 2022

ISSN: ['2475-1456']

DOI: https://doi.org/10.1109/lcsys.2021.3088068