4.6 Article

Twin actor twin delayed deep deterministic policy gradient (TATD3) learning for batch process control

Related references

Note: Only part of the references are listed.
Article Computer Science, Interdisciplinary Applications

Reinforcement learning based optimal control of batch processes using Monte-Carlo deep deterministic policy gradient with phase segmentation

Haeun Yoo et al.

Summary: Batch process control presents a challenge due to its dynamic operation over a large range of parameters. Nonlinear model predictive control (NMPC) is currently the standard for optimal control of batch processes but may be unsatisfactory in the presence of uncertainties. Reinforcement learning (RL) offers a viable alternative, but careful decisions on reward function design and value update method are necessary for effective application. This study introduces a phase segmentation approach for reward function design and value/policy function representation, along with modifications to the deep deterministic policy gradient algorithm (DDPG) to ensure more stable and efficient learning behavior. The proposed approach is demonstrated and further issues are highlighted through a case study on a batch polymerization process producing polyols.

COMPUTERS & CHEMICAL ENGINEERING (2021)

Article Engineering, Chemical

Reinforcement learning based optimization of process chromatography for continuous processing of biopharmaceuticals

Saxena Nikita et al.

Summary: This study introduces a novel approach based on reinforcement learning to separate charge variants in biopharmaceutical industry by optimizing flow rate, achieving good results in experimental validation. Compared to traditional trial and error methods, this approach shows higher efficiency in both optimization and computational aspects.

CHEMICAL ENGINEERING SCIENCE (2021)

Article Automation & Control Systems

Reinforcement Learning Based Decision Making of Operational Indices in Process Industry Under Changing Environment

Chao Liu et al.

Summary: This article introduces a model-free reinforcement learning algorithm for decision making of operational indices in plant-wide production processes. Using a multiactor networks ensemble algorithm and an actor-critic framework with stochastic policy, a relatively optimal policy is achieved, along with addressing the issue of lacking sampling data through experience replay.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2021)

Article Computer Science, Interdisciplinary Applications

Reinforcement learning for batch bioprocess optimization

P. Petsagkourakis et al.

COMPUTERS & CHEMICAL ENGINEERING (2020)

Review Computer Science, Interdisciplinary Applications

A review On reinforcement learning: Introduction and applications in industrial process control

Rui Nian et al.

COMPUTERS & CHEMICAL ENGINEERING (2020)

Article Automation & Control Systems

Data-Driven Batch-End Quality Modeling and Monitoring Based on Optimized Sparse Partial Least Squares

Qingchao Jiang et al.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2020)

Article Automation & Control Systems

Constrained iterative learning control of batch transesterification process under uncertainty

Riju De et al.

CONTROL ENGINEERING PRACTICE (2020)

Article Engineering, Chemical

A Novel Dynamic Just-in-Time Learning Framework for Modeling of Batch Processes

Tanuja Joshi et al.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2020)

Proceedings Paper Automation & Control Systems

Reinforcement learning based control of batch polymerisation processes

Vikas Singh et al.

IFAC PAPERSONLINE (2020)

Article Automation & Control Systems

Continuous control of a polymerization system with deep reinforcement learning

Yan Ma et al.

JOURNAL OF PROCESS CONTROL (2019)

Article Computer Science, Interdisciplinary Applications

Reinforcement Learning - Overview of recent progress and implications for process control

Joohyun Shin et al.

COMPUTERS & CHEMICAL ENGINEERING (2019)

Article Engineering, Chemical

Toward self-driving processes: A deep reinforcement learning approach to control

Steven Spielberg et al.

AICHE JOURNAL (2019)

Article Automation & Control Systems

Stochastic Model Predictive Control AN OVERVIEW AND PERSPECTIVES FOR FUTURE RESEARCH

Ali Mesbah

IEEE CONTROL SYSTEMS MAGAZINE (2016)

Article Automation & Control Systems

First principle modeling and predictive control of a continuous biodiesel plant

Ana S. R. Brasio et al.

JOURNAL OF PROCESS CONTROL (2016)

Review Engineering, Chemical

Modifier Adaptation for Real-Time Optimization-Methods and Applications

Alejandro G. Marchetti et al.

PROCESSES (2016)

Article Automation & Control Systems

Advanced control with parameter estimation of batch transesterification reactor

Richard Kern et al.

JOURNAL OF PROCESS CONTROL (2015)

Article Multidisciplinary Sciences

Human-level control through deep reinforcement learning

Volodymyr Mnih et al.

NATURE (2015)

Article Automation & Control Systems

Nonlinear model predictive control of biodiesel production via transesterification of used vegetable oils

Ana S. R. Brasio et al.

JOURNAL OF PROCESS CONTROL (2013)

Article Engineering, Chemical

Recursive Least Squares-Based Adaptive Control of a Biodiesel Transesterification Reactor

Ho Yong Kuen et al.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2010)

Article Engineering, Chemical

Dynamics and Control of a Biodiesel Transesterification Reactor

Farouq S. Mjalli et al.

CHEMICAL ENGINEERING & TECHNOLOGY (2009)

Article Engineering, Chemical

Approximate Predictive versus Self-Tuning Adaptive Control Strategies of Biodiesel Reactors

Farouq S. Mjalli et al.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2009)

Article Automation & Control Systems

Iterative learning control applied to batch processes: An overview

Jay H. Lee et al.

CONTROL ENGINEERING PRACTICE (2007)