期刊
IEEE ACCESS
卷 9, 期 -, 页码 95360-95371出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2021.3094466
关键词
Job shop scheduling; Energy consumption; Wastewater; Predictive models; Tariffs; Predictive control; Forecasting; Predictive control; deep neural network; reinforcement learning; pumping system; cost-effective energy efficiency
资金
- National IT Industry Promotion Agency of Korea (NIPA) - Ministry of Science and ICT [1711120811]
- GIST Research Institute (GRI)
This research introduces a predictive control scheme based on deep reinforcement learning to reduce energy consumption and costs in wastewater treatment plant pump systems. Utilizing a deep neural network model and DRL agent, the scheme considers energy consumption, electricity prices, and pump wear prevention factors for efficient control.
In this paper, we propose a deep reinforcement learning (DRL) based predictive control scheme for reducing the energy consumption and energy cost of pumping systems in wastewater treatment plants (WWTP), in which the pumps are operated in a binary mode, using on/off signals. As global energy consumption increases, the efficient operation of energy-intensive facilities has also become important. A WWTP in Busan, Republic of Korea is used as the target of this study. This WWTP is a large energy-consuming facility, and the pumping station accounts for a significant portion of the energy consumption of the WWTP. The framework of the proposed scheme consists of a deep neural network (DNN) model for forecasting wastewater inflow and a DRL agent for controlling the on/off signals of the pumping system, where proximal policy optimization (PPO) and deep Q-neural network (DQN) are employed as the DRL agents. To implement smart control with DRL, a reward function is designed to consider the energy consumption amount and electricity price information. In particular, new features and penalty factors for pump switching, which are essential for preventing pump wear, are also considered. The performance of our designed DRL agents is compared with those of WWTP experts and conventional approaches such as scheduling method and model predictive control (MPC), in which integer linear programming (ILP) optimization is employed. Results show that the designed agents outperform the other approaches in terms of compliance with operating rules and reducing energy costs.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据