4.7 Article

A Dynamic Internal Trading Price Strategy for Networked Microgrids: A Deep Reinforcement Learning-Based Game-Theoretic Approach

Journal

IEEE TRANSACTIONS ON SMART GRID
Volume 13, Issue 5, Pages 3408-3421

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSG.2022.3168856

Keywords

Optimization; Microgrids; Pricing; Costs; Uncertainty; Games; Load modeling; Deep reinforcement learning; energy management system; game theory; internal trading prices; networked microgrids; optimization; retailer agent

Ask authors/readers for more resources

In this study, a novel two-step optimization model is developed to maximize the internal power trading in a distribution network comprising multiple microgrids. The proposed model combines soft actor-critic method with entropy-regularized reinforcement learning to handle large state and action spaces. Experimental results demonstrate the superiority of the proposed model in increasing internal power trading and improving retailer's profit.
In this study, a novel two-step optimization model is developed for maximizing the amount of internal power trading in a distribution network comprising several networked microgrids. In the first step, a soft actor-critic-based optimization model is developed to help the retailer agent in determining dynamic internal trading prices for its local microgrid network. A better internal price encourages microgrids to increase the amount of internal power trading, and thus the retailer's profit is also increased. Unlike deep Q learning-based methods, the proposed method is able to handle large state and action spaces. In addition, using entropy-regularized reinforcement learning helps to accelerate and stabilize the learning process and also prevents trapping in local optima. In the second step, an optimization model is developed to facilitate internal trading among various networked microgrids using a cooperative strategy. Since the policy network plays the role of an approximator, the learning model can handle uncertainties in the distribution network. Finally, results of the proposed model show the superiority of the proposed model over the direct power trading schemes.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available