Journal
AUTOMATICA
Volume 147, Issue -, Pages -Publisher
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.automatica.2022.110685
Keywords
Stochastic linear quadratic regulator; Additive and multiplicative noises; Model-free; Reinforcement learning
Ask authors/readers for more resources
This paper investigates the optimal control problem for a class of discrete-time stochastic systems subject to additive and multiplicative noises. An algebraic Riccati equation is established which gives the form of the solution to the problem. To obtain the optimal control gain iteratively, an offline policy iteration is presented with convergence proof. A model-free reinforcement learning algorithm is proposed to learn the optimal admissible control policy using the system states and inputs without resorting to the system matrices. It is proven that the estimation error of the kernel matrix is bounded and the iterative control gain is admissible. Compared with the existing work, this paper considers the model-free controller learning problem for stochastic systems suffering from both additive and multiplicative noises using reinforcement learning. The proposed algorithm is illustrated through a numerical example, which shows that our algorithm outperforms other policy iteration algorithms.
This paper investigates the optimal control problem for a class of discrete-time stochastic systems subject to additive and multiplicative noises. An algebraic Riccati equation is established which gives the form of the solution to the problem. To obtain the optimal control gain iteratively, an offline policy iteration is presented with convergence proof. A model-free reinforcement learning algorithm is proposed to learn the optimal admissible control policy using the system states and inputs without resorting to the system matrices. It is proven that the estimation error of the kernel matrix is bounded and the iterative control gain is admissible. Compared with the existing work, this paper considers the model-free controller learning problem for stochastic systems suffering from both additive and multiplicative noises using reinforcement learning. The proposed algorithm is illustrated through a numerical example, which shows that our algorithm outperforms other policy iteration algorithms. (c) 2022 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available