4.7 Article

State and Control Path-Dependent Stochastic Optimal Control With Jumps

期刊

IEEE TRANSACTIONS ON AUTOMATIC CONTROL
卷 67, 期 9, 页码 4555-4567

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TAC.2022.3161381

关键词

Mathematical models; Stochastic processes; Optimal control; Measurement; Aerospace electronics; Dynamic programming; Delays; Functional Ito formula for jump diffusions; integro-type path-dependent Hamilton-Jacobi-Bellman (PHJB) equation; stochastic control for jump diffusions; stochastic control with delay; verification theorem

资金

  1. National Research Foundation of Korea (NRF) - Ministry of Science and ICT, South Korea [NRF-2017R1A5A1015311, NRF-2021R1A2C2094350]
  2. Institute of Information and Communications Technology Planning and Evaluation (IITP) - Korea Government (MSIT) through Artificial Intelligence Graduate School Program of Hanyang University [2020-0-01373]

向作者/读者索取更多资源

This paper considers the path-dependent stochastic optimal control problem for jump-diffusion models. It proves the dynamic programming principle of the value functional and introduces the path-dependent integro-type Hamilton-Jacobi-Bellman equation. The verification theorem is provided to obtain the sufficient condition for optimality. The explicit optimal solutions are obtained for specific problems using the verification theorem and solving the corresponding PIHJB equation.
We consider the state and control path-dependent stochastic optimal control problem for jump-diffusion models, where the dynamics and the objective functional are dependent on (current and past) paths of state and control processes. We prove the dynamic programming principle of the value functional, for which, unlike the existing literature, the Skorohod metric is necessary to maintain the separability of cadlag (state and control) spaces. We introduce the state and control path-dependent integro-type Hamilton-Jacobi-Bellman (PIHJB) equation, which includes the Levy measure in the corresponding nonlocal path-dependent integral operator. Then, by using the functional Ito calculus of a cadlag path, we show the verification theorem, which constitutes the sufficient condition for optimality in terms of the solution to the PIHJB equation. We finally apply our verification theorem to the linear-quadratic optimal control problem of jump-diffusion models with delay and the control path-dependent problem, for which the explicit optimal solutions are obtained by solving the corresponding PIHJB equation.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据