Contractivity of the Method of Successive Approximations for Optimal Control

Strongly contracting dynamical systems have numerous properties (e.g., incremental ISS), find widespread applications (e.g., in controls and learning), and their study is receiving increasing attention. This letter starts with the simple observation that, given a strongly contracting system, its adjoint dynamical system is also strongly contracting, with the same rate, with respect to the dual norm, under time reversal. As main implication of this dual contractivity, we show that the classic Method of Successive Approximations (MSA), an indirect method in optimal control, is a contraction mapping for short optimization intervals or large contraction rates. Consequently, we establish new convergence conditions for the MSA algorithm, which further imply uniqueness of the optimal control and sufficiency of Pontryagin's minimum principle under additional assumptions.

Automated summary

Strongly contracting dynamical systems and their adjoint systems are shown to have the same rate of contraction under time reversal. This duality leads to new convergence conditions for the Method of Successive Approximations (MSA) algorithm and establishes uniqueness of the optimal control and sufficiency of Pontryagin's minimum principle under certain assumptions.