4.8 Article

Structural Scheduling of Transient Control Under Energy Storage Systems by Sparse-Promoting Reinforcement Learning

Journal

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
Volume 18, Issue 2, Pages 744-756

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TII.2021.3084139

Keywords

Transient analysis; Power system dynamics; Power grids; Power system stability; Job shop scheduling; Analytical models; Reinforcement learning; Control structure; neural network; reinforcement learning (RL); transient control

Funding

  1. Fundamental Research Funds for the Central Universities [XDJK2020B010]
  2. National Natural Science Foundation of China [61703347, 61803061, 61906026]
  3. Innovation research group of universities in Chongqing
  4. Chongqing Natural Science Foundation [cstc2020jcyj-msxmX0577]
  5. Chengdu-Chongqing Economic Circle innovation funding of Chongqing Municipal Education Commission [KJCXZD2020028]

Ask authors/readers for more resources

With the rapid increase in data measurement from power grids, machine learning research in transient control has gained significant attention. This article proposes a sparse neural network based reinforcement learning scheme for optimizing the transient stability enhancement of power grids with energy storage systems. The simulation results confirm the feasibility, advantages, and adaptability of the proposed method.
Machine learning related research in transient control has drawn considerable attention with the rapid increase in data measurement from power grids. Two key components, the control algorithm and system structure, work together to determine the control performance. The design of control laws, the selection of phase measurement units, the allocation of power resources, and the scheduling of communication topology in limited cyber-physical resources need to be considered. Many existing scheduling or planning schemes specialized for control structure are designed based on various linearized analytical models or the optimization of steady states. However, the transient dynamics of power grids are nonlinear and parts of these dynamics are usually unknown. Linearized analytical models cannot represent the transient dynamics of power grids with large disturbances. This article proposes a sparse neural network based reinforcement learning scheme to optimize the control system structure for the transient stability enhancement of power grids with energy storage systems. One adjustable group sparse weight matrix is introduced to formulate both control structure and actor-critic networks. This strategy enables the proposed scheme to simultaneously schedule the control system structure and design the control laws by online learning without solving any combinational optimization problems or requiring any linearized analytical models. The sufficient conditions of learning stability, control stability, and group sparsity are thoroughly studied by mathematical analysis. The proposed scheme is simulated on an IEEE 118-bus test system for verification. The simulation results confirm the feasibility, advantages, and adaptability of the proposed method.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available