Knowledge-enhanced deep reinforcement learning for intelligent event-based load shedding. (June 2023)

• Record Type: Journal Article
• Authors: Hu, Ze; Shi, Zhongtuo; Zeng, Lingkang; Yao, Wei; Tang, Yong; Wen, Jinyu
• Is Part Of: International journal of electrical power & energy systems. Volume 148(2023)
• Publication Date: 2023-06
• Subjects: Transient voltage instability -- Event-based load shedding -- Transient stability simulation -- Deep reinforcement learning -- Linear decision space; Electrical engineering -- Periodicals; Electric power systems -- Periodicals; Électrotechnique -- Périodiques; Réseaux électriques (Énergie) -- Périodiques; Electric power systems; Electrical engineering; Periodicals; 621.3
• DOI: 10.1016/j.ijepes.2023.108978
• Languages: English
• ISSNs: 0142-0615

Abstract

Abstract: Event-based load shedding (ELS) is an important emergency countermeasure against transient voltage instability in power systems. At present, the formulation of ELS measures is usually determined offline by the experience of experts, which is inefficient, time-consuming, and labor-intensive. This paper proposes a knowledge-enhanced deep reinforcement learning (DRL) method for intelligent ELS. Firstly, the Markov decision process (MDP) of the knowledge-enhanced DRL model for ELS is established based on transient stability simulation. Different from traditional response-based MDP, this MDP is event-based. Then, compared to conventional exponential decision space, a linear decision space of the DRL agent is established to reduce the decision space and training difficulty. Furthermore, the knowledge of removing repeated and negative actions is fused into DRL to improve training efficiency and decision quality. Finally, the simulation results of the CEPRI 36-bus system show that the proposed method can accurately give effective ELS measures. Compared with the pure data-driven DRL method, the knowledge-enhanced DRL method is more efficient. Graphical abstract: Highlights: An event-based Markov decision process (MDP) via trial and error sequence is proposed. A linear decision space for the MDP of event-based load shedding (ELS) is proposed. A knowledge-enhanced MDP of removing repeated and negative actions is proposed. The proposed event-based MDP can efficiently obtain effective ELS measures. The proposed linear decision space can decrease the training difficulty.