Linear Quadratic Regulation and Stabilization of Discrete-Time Systems With Delay and Multiplicative Noise

This paper is concerned with the long-standing problems of linear quadratic regulation (LQR) control and stabilization for a class of discrete-time stochastic systems involving multiplicative noises and input delay. These fundamental problems have attracted resurgent interests due to development of networked control systems. An explicit analytical expression is given for the optimal LQR controller. More specifically, the optimal LQR controller is shown to be a linear function of the conditional expectation of the state, with the feedback gain based on a Riccati-ZXL difference equation. It is also shown that the system is stabilizable in the mean-square sense if and only if an algebraic Riccati-ZXL equation has a particular solution. These results are based on a new technical tool, which establishes a non-homogeneous relationship between the state and the costate of this class of systems, and the introduction of a new Lyapunov function for the finite-horizon optimal control design.