Journal
IEEE TRANSACTIONS ON SMART GRID
Volume 9, Issue 4, Pages 3465-3475Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSG.2016.2631453
Keywords
Agent-based modeling; demand response; machine learning; retail electrical energy markets
Categories
Funding
- U.S. Department of Energy, Office of Science, Basic Energy Sciences [DE-FG02-11ER46817]
Ask authors/readers for more resources
In this paper, we study the behavior of a day-ahead (DA) retail electrical energy market with price-based demand response from air conditioning (AC) loads through a hierarchical multiagent framework, employing a machine learning approach. At the top level of the hierarchy, a retailer agent buys energy from the DA wholesale market and sells it to the consumers. The goal of the retailer agent is to maximize its profit by setting the optimal retail prices, considering the response of the price-sensitive loads. Upon receiving the retail prices, at the lower level of the hierarchy, the AC agents employ a Q-learning algorithm to optimize their consumption patterns through modifying the temperature set-points of the devices, considering both consumption costs and users' comfort preferences. Since the retailer agent does not have direct access to the AC loads' underlying dynamics and decision process (i.e., incomplete information) the data privacy of the consumers becomes a source of uncertainty in the retailer's decision model. The retailer relies on techniques from the field of machine learning to develop a reliable model of the aggregate behavior of the price-sensitive loads to reduce the uncertainty of the decision-making process. Hence, a multiagent framework based on machine learning enables us to address issues such as interoperability and decision-making under incomplete information in a system that maintains the data privacy of the consumers. We will show that using the proposed model, all the agents arc able to optimize their behavior simultaneously. Simulation results show that the proposed approach leads to a reduction in overall power consumption cost as the system converges to its equilibrium. This also coincides with maximization in the retailer's profit. We will also show that the same decision architecture can be used to reduce peak load to defer/avoid distribution system upgrades under high penetration of photo-voltaic power in the distribution feeder.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available