期刊
RELIABILITY ENGINEERING & SYSTEM SAFETY
卷 235, 期 -, 页码 -出版社
ELSEVIER SCI LTD
DOI: 10.1016/j.ress.2023.109231
关键词
Cyber-Physical Energy System (CPES); Operation & Maintenance (O & M); Deep Reinforcement Learning (DRL); Nuclear Power Plant (NPP); Optimization; Advanced Lead -cooled Fast Reactor European; Demonstrator (ALFRED)
This paper discusses the O&M strategies for reliable and safe production and supply of CPESs, considering the uncertainty in energy demand and supply due to renewable energy sources and the need to avoid severe accidents for safety reasons. A Deep Reinforcement Learning approach is developed to search for the best strategy, taking into account the health conditions and remaining useful life of system components, and possible accident scenarios. The approach integrates Proximal Policy Optimization and Imitation Learning, and incorporates a CPES model with component RUL estimator and failure process model. An application to the ALFRED reactor demonstrates that the optimal solution found by DRL outperforms state-of-the-art O&M policies.
The Operation & Maintenance (O&M) of Cyber-Physical Energy Systems (CPESs) is driven by reliable and safe production and supply, that need to account for flexibility to respond to the uncertainty in energy demand and also supply due to the stochasticity of Renewable Energy Sources (RESs); at the same time, accidents of severe consequences must be avoided for safety reasons. In this paper, we consider O&M strategies for CPES reliable and safe production and supply, and develop a Deep Reinforcement Learning (DRL) approach to search for the best strategy, considering the system components health conditions, their Remaining Useful Life (RUL), and possible accident scenarios. The approach integrates Proximal Policy Optimization (PPO) and Imitation Learning (IL) for training RL agent, with a CPES model that embeds the components RUL estimator and their failure process model. The novelty of the work lies in i) taking production plan into O&M decisions to implement maintenance and operate flexibly; ii) embedding the reliability model into CPES model to recognize safety related components and set proper maintenance RUL thresholds. An application, the Advanced Lead-cooled Fast Reactor European Demonstrator (ALFRED), is provided. The optimal solution found by DRL is shown to outperform those provided by state-of-the-art O&M policies.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据