期刊
IEEE TRANSACTIONS ON AUTOMATIC CONTROL
卷 64, 期 7, 页码 2737-2752出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TAC.2018.2876389
关键词
Safety; robot learning; autonomous systems; robust optimal control; Gaussian processes
资金
- NSF CPS project ActionWebs [0931843]
- NSF CPS project FORCES [1239166]
- ONR under the HUNT
- ONR under Embedded Humans MURIs
- AFOSR under the CHASE MURI
- la Caixa Foundation
- NSF Bridge to Doctorate program
- EU FP7 (FP7/2007-2013) [PIOFGA-2011-301436-COGENT]
- ONR under SMARTS
- Division Of Computer and Network Systems
- Direct For Computer & Info Scie & Enginr [1239166] Funding Source: National Science Foundation
The proven efficacy of learning-based control schemes strongly motivates their application to robotic systems operating in the physical world. However, guaranteeing correct operation during the learning process is currently an unresolved issue, which is of vital importance in safety-critical systems. We propose a general safety framework based on Hamilton-Jacobi reachability methods that can work in conjunction with an arbitrary learning algorithm. The method exploits approximate knowledge of the system dynamics to guarantee constraint satisfaction while minimally interfering with the learning process. We further introduce a Bayesian mechanism that refines the safety analysis as the system acquires new evidence, reducing initial conservativeness when appropriate while strengthening guarantees through real-time validation. The result is a least-restrictive, safety-preserving control law that intervenes only when the computed safety guarantees require it, or confidence in the computed guarantees decays in light of new observations. We prove theoretical safety guarantees combining probabilistic and worst-case analysis and demonstrate the proposed framework experimentally on a quadrotor vehicle. Even though safety analysis is based on a simple point-mass model, the quadrotor successfully arrives at a suitable controller by policy-gradient reinforcement learning without ever crashing, and safely retracts away from a strong external disturbance introduced during flight.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据