期刊
APPLIED ENERGY
卷 255, 期 -, 页码 -出版社
ELSEVIER SCI LTD
DOI: 10.1016/j.apenergy.2019.113762
关键词
Energy management strategy; Deep reinforcement learning; Discrete-continuous hybrid action space; Power-split hybrid electric bus; Terrain information
资金
- National Key Research and Development Program of China [2018YFB0105900]
- National Natural Science Foundation of China [51675042, 51705020]
- Natural Sciences and Engineering Research Council of Canada
- Beijing Institute of Technology
- State Key Laboratory of Automotive Simulation and Control [20181105]
Due to the high mileage and heavy load capabilities of hybrid commercial vehicles, energy management becomes crucial in improving their fuel economy. In this paper, terrain information is systematically integrated into the energy management strategy for a power-split hybrid electric bus based on a deep reinforcement learning approach: the deep deterministic policy gradient algorithm. Specially, this energy management method is improved and capable of searching optimal energy management strategies in a discrete-continuous hybrid action space, which, in this work, consists of two continuous actions for the engine and four discrete actions for powertrain mode selections. Additionally, a Critic network with dueling architecture and a pre-training stage ahead of the reinforcement learning process are combined for efficient strategy learning with the adopted algorithm. Assuming the current terrain information was available to the controller, the deep reinforcement learning based energy management strategy is trained and tested on different driving cycles and simulated terrains. Simulation results of the trained strategy show that reasonable energy allocation schemes and mode switching rules are learned simultaneously. Its fuel economy gap with the baseline strategy using dynamic programming is narrowed down to nearly 6.4% while reducing the times of engine starts by around 76%. Further comparisons also indicate approximately 2% promotion in fuel economy is contributed by the incorporation of terrain information in this learning-based energy management. The main contribution of this study is to explore the inclusion of terrain information in a learning-based energy management method that can deal with large hybrid action spaces.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据