4.7 Article

State and Control Path-Dependent Stochastic Optimal Control With Jumps

Journal

IEEE TRANSACTIONS ON AUTOMATIC CONTROL
Volume 67, Issue 9, Pages 4555-4567

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TAC.2022.3161381

Keywords

Mathematical models; Stochastic processes; Optimal control; Measurement; Aerospace electronics; Dynamic programming; Delays; Functional Ito formula for jump diffusions; integro-type path-dependent Hamilton-Jacobi-Bellman (PHJB) equation; stochastic control for jump diffusions; stochastic control with delay; verification theorem

Funding

  1. National Research Foundation of Korea (NRF) - Ministry of Science and ICT, South Korea [NRF-2017R1A5A1015311, NRF-2021R1A2C2094350]
  2. Institute of Information and Communications Technology Planning and Evaluation (IITP) - Korea Government (MSIT) through Artificial Intelligence Graduate School Program of Hanyang University [2020-0-01373]

Ask authors/readers for more resources

This paper considers the path-dependent stochastic optimal control problem for jump-diffusion models. It proves the dynamic programming principle of the value functional and introduces the path-dependent integro-type Hamilton-Jacobi-Bellman equation. The verification theorem is provided to obtain the sufficient condition for optimality. The explicit optimal solutions are obtained for specific problems using the verification theorem and solving the corresponding PIHJB equation.
We consider the state and control path-dependent stochastic optimal control problem for jump-diffusion models, where the dynamics and the objective functional are dependent on (current and past) paths of state and control processes. We prove the dynamic programming principle of the value functional, for which, unlike the existing literature, the Skorohod metric is necessary to maintain the separability of cadlag (state and control) spaces. We introduce the state and control path-dependent integro-type Hamilton-Jacobi-Bellman (PIHJB) equation, which includes the Levy measure in the corresponding nonlocal path-dependent integral operator. Then, by using the functional Ito calculus of a cadlag path, we show the verification theorem, which constitutes the sufficient condition for optimality in terms of the solution to the PIHJB equation. We finally apply our verification theorem to the linear-quadratic optimal control problem of jump-diffusion models with delay and the control path-dependent problem, for which the explicit optimal solutions are obtained by solving the corresponding PIHJB equation.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available