4.7 Article

Output-feedback robust control of systems with uncertain dynamics via data-driven policy learning

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

Model-Free λ-Policy Iteration for Discrete-Time Linear Quadratic Regulation

Yongliang Yang et al.

Summary: This article presents a model-free lambda-policy iteration algorithm for the discrete-time linear quadratic regulation problem. It introduces the weighted Bellman operator and the composite Bellman operator to solve the algebraic Riccati equation. Compared to the PI algorithm, the lambda-PI algorithm does not require an initial policy and has a faster convergence rate. The model-free extension of the lambda-PI algorithm is developed using the off-policy reinforcement learning technique.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Engineering, Electrical & Electronic

Asymptotic Tracking Control for Nonaffine Systems With Disturbances

Shubo Wang

Summary: This article presents an adaptive asymptotic tracking control method with prescribed performance function for a class of nonaffine systems with unknown disturbances. By transforming the nonaffine system into an affine system, introducing a prescribed performance function, and utilizing the robust integral of the sign of the error (RISE) feedback term, the proposed control scheme achieves asymptotic tracking performance with guaranteed prescribed performance.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS (2022)

Article Engineering, Electrical & Electronic

Adaptive Learning Based Output-Feedback Optimal Control of CT Two-Player Zero-Sum Games

Jun Zhao et al.

Summary: Although optimal control with full state-feedback has been extensively studied, solving online output-feedback optimal control problem remains challenging, especially for learning Nash equilibrium solution of continuous-time two-player zero-sum differential games. In this paper, we propose an adaptive learning algorithm to address this problem, approximating the solution using online data.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS (2022)

Article Computer Science, Artificial Intelligence

Robust Actor-Critic Learning for Continuous-Time Nonlinear Systems With Unmodeled Dynamics

Yongliang Yang et al.

Summary: This article investigates the robust optimal control problem for a class of nonlinear systems with unmodeled dynamics and proposes an adaptive optimal controller using online actor-critic learning. By introducing an auxiliary signal and a robustifying term, the stability and robustness during the learning process are ensured.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2022)

Article Automation & Control Systems

Hamiltonian-Driven Adaptive Dynamic Programming With Approximation Errors

Yongliang Yang et al.

Summary: This article explores an iterative adaptive dynamic programming algorithm within the Hamiltonian-driven framework for solving the Hamilton-Jacobi-Bellman equation in continuous time for nonlinear systems. It introduces a novel function "min-Hamiltonian" and develops an iterative ADP algorithm that considers approximation errors during policy evaluation. The article also provides a sufficient condition on the iterative value gradient to ensure closed-loop stability and convergence to optimal value, as well as a model-free extension based on off-policy reinforcement learning.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Computer Science, Artificial Intelligence

Observer-Based Neuro-Adaptive Optimized Control of Strict-Feedback Nonlinear Systems With State Constraints

Yongming Li et al.

Summary: This article presents an adaptive neural network output feedback optimized control design for strict-feedback nonlinear systems with unknown internal dynamics. By constructing optimal cost functions for subsystems and using the actor-critic architecture, virtual and actual optimal controllers are developed to ensure the boundedness of all closed-loop signals. The proposed strategy also guarantees that system states are always confined within some preselected compact sets.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Robotics

Human-in-the-Loop Control of Soft Exosuits Using Impedance Learning on Different Terrains

Zhijun Li et al.

Summary: This article proposes a novel hierarchical human-in-the-loop paradigm to provide suitable assistance powers for cable-driven lower limb exosuits, improving human walking performance over different terrains.

IEEE TRANSACTIONS ON ROBOTICS (2022)

Article Computer Science, Artificial Intelligence

Adaptive Resilient Event-Triggered Control Design of Autonomous Vehicles With an Iterative Single Critic Learning Framework

Kun Zhang et al.

Summary: This article investigates adaptive resilient event-triggered control for RWDA vehicles using an iterative single critic learning framework to balance the frequency/changes in adjusting the vehicle's control. By combining event-triggered sampling mechanism and novel utility function design, the control input can be guaranteed into an applicable saturated bound, demonstrating effectiveness and practicality in driving RWDA vehicles.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Automation & Control Systems

Modeling and trajectory tracking control for flapping-wing micro aerial vehicles

Wei He et al.

Summary: This paper studies the trajectory tracking problem of flapping-wing micro aerial vehicles in the longitudinal plane and proposes an adaptive control scheme to achieve autonomous flight. By designing position and attitude controllers, the effectiveness of the control scheme is discussed and verified through simulations.

IEEE-CAA JOURNAL OF AUTOMATICA SINICA (2021)

Article Automation & Control Systems

Robust Policy Learning Control of Nonlinear Plants With Case Studies for a Power System Application

Ding Wang

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2020)

Article Automation & Control Systems

Reinforcement Learning-Based Linear Quadratic Regulation of Continuous-Time Systems Using Dynamic Output Feedback

Syed Ali Asad Rizvi et al.

IEEE TRANSACTIONS ON CYBERNETICS (2020)

Article Computer Science, Artificial Intelligence

Adaptive Neural Networks Finite-Time Optimal Control for a Class of Nonlinear Systems

Yongming Li et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2020)

Article Computer Science, Artificial Intelligence

Neural Network Learning and Robust Stabilization of Nonlinear Systems With Dynamic Uncertainties

Ding Wang et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2018)

Article Automation & Control Systems

Optimal Output-Feedback Control of Unknown Continuous-Time Linear Systems Using Off-policy Reinforcement Learning

Hamidreza Modares et al.

IEEE TRANSACTIONS ON CYBERNETICS (2016)

Article Automation & Control Systems

Adaptive Suboptimal Output-Feedback Control for Linear Systems Using Integral Reinforcement Learning

Lemei M. Zhu et al.

IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY (2015)

Article Automation & Control Systems

Adaptive dynamic programming and optimal control of nonlinear nonaffine systems

Tao Bian et al.

AUTOMATICA (2014)

Article Automation & Control Systems

Policy Iteration Algorithm for Online Design of Robust Control for a Class of Continuous-Time Nonlinear Systems

Ding Wang et al.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2014)

Article Computer Science, Artificial Intelligence

Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear Systems

Yu Jiang et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2014)

Article Computer Science, Artificial Intelligence

Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks

Hamidreza Modares et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2013)

Article Automation & Control Systems

Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data

F. L. Lewis et al.

IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS (2011)

Article Automation & Control Systems

Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem

Kyriakos G. Vamvoudakis et al.

AUTOMATICA (2010)

Article Engineering, Aerospace

Necessary and sufficient conditions for H-∞ static output-feedback control

Jyotirmay Gadewadikar et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2006)

Article Automation & Control Systems

An optimal control approach to robust control design

F Lin

INTERNATIONAL JOURNAL OF CONTROL (2000)