Journal
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY
Volume 27, Issue 3, Pages 1228-1236Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCST.2018.2794336
Keywords
Active leader; containment control; distributed observer; heterogeneous systems; model free; reinforcement learning (RL)
Funding
- National Natural Science Foundation of China [61333002]
- China Scholarship Council [201406460057]
- Mary K. Finley Endowment
- Missouri S&T Intelligent Systems Center
- National Science Foundation
Ask authors/readers for more resources
This brief presents a partially model-free solution to the distributed containment control of multiagent systems using off-policy reinforcement learning (RL). The followers are assumed to be heterogeneous with different dynamics, and the leaders are assumed to be active in the sense that their control inputs can be nonzero. Optimality is explicitly imposed in solving the containment problem to not only drive the agents' states into a convex hull of the leaders' states but also minimize their transient responses. Inhomogeneous algebraic Riccati equations (AREs) are derived to solve the optimal containment control with active leaders. The resulting control protocol for each agent depends on its own state and an estimation of an interior point inside the convex hull spanned by the leaders. This estimation is provided by designing a distributed observer for a trajectory inside the convex hull of active leaders. Only the knowledge of the leaders' dynamics is required by the observer. An off-policy RL algorithm is developed to solve the inhomogeneous AREs online in real time without requiring any knowledge of the followers' dynamics. Finally, a simulation example is presented to show the effectiveness of the presented algorithm.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available