The Adaptive Dynamic Programming Toolbox

The paper develops the adaptive dynamic programming toolbox (ADPT), which is a MATLAB-based software package and computationally solves optimal control problems for continuous-time control-affine systems. The ADPT produces approximate optimal feedback controls by employing the adaptive dynamic programming technique and solving the Hamilton-Jacobi-Bellman equation approximately. A novel implementation method is derived to optimize the memory consumption by the ADPT throughout its execution. The ADPT supports two working modes: model-based mode and model-free mode. In the former mode, the ADPT computes optimal feedback controls provided the system dynamics. In the latter mode, optimal feedback controls are generated from the measurements of system trajectories, without the requirement of knowledge of the system model. Multiple setting options are provided in the ADPT, such that various customized circumstances can be accommodated. Compared to other popular software toolboxes for optimal control, the ADPT features computational precision and time efficiency, which is illustrated with its applications to a highly non-linear satellite attitude control problem.

Automated summary

The paper introduces the adaptive dynamic programming toolbox (ADPT), a MATLAB-based software package for solving optimal control problems for continuous-time control-affine systems. ADPT generates approximate optimal feedback controls using the adaptive dynamic programming technique and supports two working modes. Multiple setting options are available to accommodate various customized circumstances, with computational precision and time efficiency.