Journal
APPLIED ENERGY
Volume 252, Issue -, Pages -Publisher
ELSEVIER SCI LTD
DOI: 10.1016/j.apenergy.2019.113423
Keywords
Reinforcement learning; Predictive control; Energy efficiency; Data-driven; Machine learning; Wastewater treatment plant
Categories
Funding
- European Union's Horizon 2020 Framework Programme for Research and Innovation [731218]
- H2020 Societal Challenges Programme [731218] Funding Source: H2020 Societal Challenges Programme
Ask authors/readers for more resources
Urban wastewater sector is being pushed to optimize processes in order to reduce energy consumption without compromising its quality standards. Energy costs can represent a significant share of the global operational costs (between 50% and 60%) in an intensive energy consumer. Pumping is the largest consumer of electrical energy in a wastewater treatment plant. Thus, the optimal control of pump units can help the utilities to decrease operational costs. This work describes an innovative predictive control policy for wastewater variable-frequency pumps that minimize electrical energy consumption, considering uncertainty forecasts for wastewater intake rate and information collected by sensors accessible through the Supervisory Control and Data Acquisition system. The proposed control method combines statistical learning (regression and predictive models) and deep reinforcement learning (Proximal Policy Optimization). The following main original contributions are produced: (i) model-free and data-driven predictive control; (ii) control philosophy focused on operating the tank with a variable wastewater set-point level; (iii) use of supervised learning to generate synthetic data for pre-training the reinforcement learning policy, without the need to physically interact with the system. The results for a real case-study during 90 days show a 16.7% decrease in electrical energy consumption while still achieving a 97% reduction in the number of alarms (tank level above 7.2 m) when compared with the current operating scenario (operating with a fixed set-point level). The numerical analysis showed that the proposed data-driven method is able to explore the trade-off between number of alarms and consumption minimization, offering different options to decision-makers.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available