Journal
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
Volume 17, Issue 2, Pages 849-859Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TII.2019.2950809
Keywords
Charging stations; Pricing; Electric vehicle charging; Load management; Real-time systems; Approximation algorithms; Job shop scheduling; Dynamic programming; machine learning; pricing and scheduling; reinforcement learning; state-action-reward-state-action (SARSA)
Categories
Funding
- National Natural Science Foundation of China [61871271]
- Guangdong Province Pearl River Scholar Funding Scheme
- Department of Education of Guangdong Province [2017KTSCX163]
- Foundation of Shenzhen City [JCYJ20170818101824392]
- Science and Technology Innovation Commission of Shenzhen [827/000212]
- Hong Kong Research Grant Council [14200315]
Ask authors/readers for more resources
This article proposes a reinforcement-learning approach for optimizing charging scheduling and pricing strategies, achieving 138.5% higher charging-station profit compared to representative benchmark algorithms. The algorithm is "online" and "model-free", and a feature-based linear function approximator is proposed to enhance efficiency and generalization ability.
This article proposes a reinforcement-learning (RL) approach for optimizing charging scheduling and pricing strategies that maximize the system objective of a public electric vehicle (EV) charging station. The proposed algorithm is x201C;onlinex201D; in the sense that the charging and pricing decisions made at each time depend only on the observation of past events, and is x201C;model-freex201D; in the sense that the algorithm does not rely on any assumed stochastic models of uncertain events. To cope with the challenge arising from the time-varying continuous state and action spaces in the RL problem, we first show that it suffices to optimize the total charging rates to fulfill the charging requests before departure times. Then, we propose a feature-based linear function approximator for the statex2013;value function to further enhance the efficiency and generalization ability of the proposed algorithm. Through numerical simulations with real-world data, we show that the proposed RL algorithm achieves on average 138.5x0025; higher charging-station profit than representative benchmark algorithms.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available