4.7 Article

Linear quadratic tracking control of unknown systems: A two-phase reinforcement learning method

Related references

Note: Only part of the references are listed.
Article Automation & Control Systems

Reinforcement Learning-Based Composite Optimal Operational Control of Industrial Systems With Multiple Unit Devices

Jianguo Zhao et al.

Summary: This article investigates the optimal operational control problem for a class of industrial systems consisting of multiple unit devices. The proposed decentralized composite control scheme, using singular perturbation theory, achieves the desired operational index tracking and disturbance rejection. The online and offline controller design methods are proposed for the slow and fast subsystems, respectively, ensuring optimal control without requiring knowledge of the operational process dynamics.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2022)

Article Automation & Control Systems

Resilient reinforcement learning and robust output regulation under denial-of-service attacks

Weinan Gao et al.

Summary: This paper proposes a novel resilient reinforcement learning approach for solving robust optimal output regulation problems of a class of partially linear systems under both dynamic uncertainties and denial-of-service attacks. The approach rigorously analyzes the resilience of closed-loop systems against attacks and the robustness against dynamic uncertainties, and introduces a faster convergence learning strategy.

AUTOMATICA (2022)

Article Automation & Control Systems

A Distributed Indirect Adaptive Approach to Cooperative Tracking in Networks of Uncertain Single-Input Single-Output Systems

Simone Baldi et al.

Summary: This article presents an indirect adaptive methodology for the cooperative control of single-input single-output systems, which does not require prior knowledge of system parameters, minimum phase assumptions, or initial stabilizing controllers to guarantee asymptotic tracking.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Automation & Control Systems

Adaptive Dynamic Programming for Control: A Survey and Recent Advances

Derong Liu et al.

Summary: This article reviews the recent development of adaptive dynamic programming (ADP) with applications in control, highlighting efficient algorithms and future research directions. ADP is applied in optimization, game theory, and large-scale systems, showing great potential in the era of artificial intelligence.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2021)

Article Automation & Control Systems

Finite-Horizon Discounted Optimal Control: Stability and Performance

Mathieu Granzotto et al.

Summary: This paper analyzes the stability of deterministic nonlinear discrete-time systems, constructs a Lyapunov function for the closed-loop system, and ensures a uniform semiglobal stability property with adjustable parameters including the discount factor and horizon length. It provides less conservative stability conditions, new relationships between optimal value functions, and investigates stability with only a near-optimal sequence of inputs for discounted finite-horizon costs.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Automation & Control Systems

Reduced-dimensional reinforcement learning control using singular perturbation approximations

Sayak Mukherjee et al.

Summary: This study introduces model-free, reduced-dimensional reinforcement learning optimal control designs for singularly perturbed systems. By learning a linear quadratic regulator for slow dynamics, significant learning time is saved compared to traditional methods. Furthermore, centralized and decentralized RL controllers are developed for clustered multi-agent consensus networks.

AUTOMATICA (2021)

Article Automation & Control Systems

Self-Learning Optimal Regulation for Discrete-Time Nonlinear Systems Under Event-Driven Formulation

Ding Wang et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2020)

Article Automation & Control Systems

Adaptive composite suboptimal control for linear singularly perturbed systems with unknown slow dynamics

Chunyu Yang et al.

INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL (2020)

Article Computer Science, Information Systems

New insight into the simultaneous policy update algorithms related to H∞ state feedback control

Zhou-Yang Liu et al.

INFORMATION SCIENCES (2019)

Article Automation & Control Systems

Reinforcement Learning-Based Adaptive Optimal Exponential Tracking Control of Linear Systems With Unknown Dynamics

Ci Chen et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2019)

Article Automation & Control Systems

Model-free event-triggered control algorithm for continuous-time linear systems with optimal performance

Kyriakos G. Vamvoudakis et al.

AUTOMATICA (2018)

Article Automation & Control Systems

Leader-to-Formation Stability of Multiagent Systems: An Adaptive Optimal Control Approach

Weinan Gao et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2018)

Article Automation & Control Systems

Infinite horizon linear quadratic tracking problem: A discounted cost function approach

Soleiman Najafi Birgani et al.

OPTIMAL CONTROL APPLICATIONS & METHODS (2018)

Article Computer Science, Artificial Intelligence

Optimal and Autonomous Control Using Reinforcement Learning: A Survey

Bahare Kiumarsi et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2018)

Article Automation & Control Systems

Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning HOW TO SOLVE MULTIPLAYER GAMES ONLINE

Kyriakos G. Vamvoudakis et al.

IEEE CONTROL SYSTEMS MAGAZINE (2017)

Article Automation & Control Systems

Stability Analysis of Discrete-Time Infinite-Horizon Optimal Control With Discounted Cost

Romain Postoyan et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2017)

Article Automation & Control Systems

Optimal control for a new class of singularly perturbed linear systems

Kliti Kodra et al.

AUTOMATICA (2017)

Article Automation & Control Systems

Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems

Weinan Gao et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

Optimal Output-Feedback Control of Unknown Continuous-Time Linear Systems Using Off-policy Reinforcement Learning

Hamidreza Modares et al.

IEEE TRANSACTIONS ON CYBERNETICS (2016)

Article Automation & Control Systems

Non-zero sum Nash Q-learning for unknown deterministic continuous-time linear systems

Kyriakos G. Vamvoudakis

AUTOMATICA (2015)

Article Automation & Control Systems

Approximate optimal trajectory tracking for continuous-time nonlinear systems

Rushikesh Kamalapurkar et al.

AUTOMATICA (2015)

Article Automation & Control Systems

Stabilization with discounted optimal control

Vladimir Gaitsgory et al.

SYSTEMS & CONTROL LETTERS (2015)

Article Computer Science, Artificial Intelligence

H∞ Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement Learning

Hamidreza Modares et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2015)

Article Automation & Control Systems

Linear Quadratic Tracking Control of Partially-Unknown Continuous-Time Systems Using Reinforcement Learning

Hamidreza Modares et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2014)

Article Computer Science, Information Systems

Simultaneous policy update algorithms for learning the solution of linear continuous-time H∞ state feedback control

Huai-Ning Wu et al.

INFORMATION SCIENCES (2013)

Article Computer Science, Artificial Intelligence

Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method

Huaguang Zhang et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS (2011)

Article Engineering, Electrical & Electronic

Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control

Frank L. Lewis et al.

IEEE CIRCUITS AND SYSTEMS MAGAZINE (2009)