Journal
MINERALS
Volume 11, Issue 9, Pages -Publisher
MDPI
DOI: 10.3390/min11090989
Keywords
reinforcement learning; deep neural network; proportional-integral control
Ask authors/readers for more resources
In this study, deep reinforcement learning was used to continuously adjust control system parameters for optimizing performance. Training was conducted in a simulation environment with domain randomization to adapt to unseen conditions. Hyper-parameter optimization was performed to select the optimal agent neural network size and training algorithm parameters.
Control systems require maintenance in the form of tuning their parameters in order to maximize their performance in the face of process changes in minerals processing circuits. This work focuses on using deep reinforcement learning to train an agent to perform this maintenance continuously. A generic simulation of a first-order process with a time delay, controlled by a proportional-integral controller, was used as the training environment. Domain randomization in this environment was used to aid in generalizing the agent to unseen conditions on a physical circuit. Proximal policy optimization was used to train the agent, and hyper-parameter optimization was performed to select the optimal agent neural network size and training algorithm parameters. Two agents were tested, examining the impact of the observation space used by the agent and concluding that the best observation consists of the parameters of an auto-regressive with exogenous input model fitted to the measurements of the controlled variable. The best trained agent was deployed at an industrial comminution circuit where it was tested on two flow rate control loops. This agent improved the performance of one of these control loops but decreased the performance of the other control loop. While deep reinforcement learning does show promise in controller tuning, several challenges and directions for further study have been identified.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available