Deep-Reinforcement-Learning-Based Adaptive State-Feedback Control for Inter-Area Oscillation Damping with Continuous Eigenvalue Configurations

TL;DR

This paper introduces a deep reinforcement learning framework for adaptive inter-area oscillation damping in power systems, utilizing continuous eigenvalue configurations and a switching control strategy to improve stability and response.

Contribution

It presents a novel DRL-based control approach modeled as an MDP, integrating with power system stabilizers and tested on a standard power system model.

Findings

Outperforms benchmark methods in transient response.

Effective in both linear and nonlinear power system models.

Robust against communication delays.

Abstract

Controlling inter-area oscillation (IAO) across wide areas is crucial for the stability of modern power systems. Recent advances in deep learning, combined with the extensive deployment of phasor measurement units (PMUs) and generator sensors, have catalyzed the development of data-driven IAO damping controllers. In this paper, a novel IAO damping control framework is presented by modeling the control problem as a Markov Decision Process (MDP) and solving it through deep reinforcement learning (DRL). The DRL-based controller is trained in the state space with continuous eigenvalue configurations. To optimize control performance and cost-efficiency, only a subset of generators, identified by global participation factors, are selected for control. In addition, a switching control strategy (SCS) is introduced that effectively integrates the DRL-based controller with power system stabilizers (PSSs) to enhance overall performance. The simulation results on the IEEE 39-bus New England power system show that the proposed method outperforms two benchmark methods regarding the transient response. The DRL-based controller trained on the linear state-space environment can be directly tested in the nonlinear differential-algebraic environment. The robustness of the proposed method against communication delays has been thoroughly investigated.