4.7 Article

A Multi-Step Unified Reinforcement Learning Method for Automatic Generation Control in Multi-Area Interconnected Power Grid

Journal

IEEE TRANSACTIONS ON SUSTAINABLE ENERGY
Volume 12, Issue 2, Pages 1406-1415

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSTE.2020.3047137

Keywords

Power grids; Automatic generation control; Frequency control; Reinforcement learning; Load modeling; Optimization; Heuristic algorithms; Multi-area Interconnected Power Grid; AGC; reinforcement learning; Battery Energy Storage System

Funding

  1. National Natural Science Foundation of China [51707102]
  2. Research Fund for Excellent Dissertation of China Three Gorges University [2021SSPY063]

Ask authors/readers for more resources

The increase in new energies and electric vehicles poses new challenges to the power grid, and an algorithm based on DQ(sigma, lambda) is proposed to improve the stability and performance of multi-area interconnected power systems.
As the penetration rate of new energies, energy storage devices and electric vehicles increases continuously in power grid, power grid faces strong random disturbances, as well as the issues of downfall in frequency control ability induced by the factors such as system inertia reduction and frequency control under-capacity in traditional power units. Therefore, an algorithm of automatic generation control with DQ(sigma, lambda) is proposed for the multi-area interconnected power grid. By integrating the eligibility trace, DQ(sigma, lambda) adopts the principle of double Q-learning to unify double Q(lambda) and double Expected-Sarsa(lambda), thereby the over-estimation of Q in the algorithm and the phenomenon of over-fitting can be avoided. The simulations are provided to demonstrate the effectiveness of the proposed algorithm, where the improved IEEE standard two-area load-frequency control model and the model of the multi-area interconnected power grid based on Central China Power Grid are adopted. The results show that the phenomena of random disturbances and frequency instability can be eliminated in multi-area interconnected power grid. The convergence is faster and the dynamic performance is better in the proposed algorithm compared with the traditional algorithms.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available