4.6 Article

Stochastic optimal control in infinite dimensions with state constraints

Journal

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.na.2022.113050

Keywords

State-constrained control problem; Hamilton-Jacobi-Bellman equation; Viscosity solution; Backward reachability analysis; ininfinitedimensions

Ask authors/readers for more resources

In this paper, we investigate the state-constrained stochastic optimal control problem in infinite-dimensional separable Hilbert spaces. By utilizing stochastic target theory and backward reachability approach, we establish the representation of the original value function and prove the uniqueness of the auxiliary value function as a viscosity solution to the associated HJB equation.
We consider the state-constrained stochastic optimal control problem in infinitedimensional separable Hilbert spaces, where the state process is driven by the Q-Wiener process and the (possibly unbounded) linear operator. By applying the stochastic target theory and the backward reachability approach, we show that the original (possibly discontinuous) value function can be represented by the zero-level set of the auxiliary (continuous) value function. The auxiliary value function is obtained from the penalized unconstrained stochastic control problem (in infinite dimensions) that includes an additional control variable as a consequence of the (infinite-dimensional) martingale representation theorem. We then prove that the auxiliary value function is a unique (continuous) viscosity solution to the associated Hamilton-Jacobi-Bellman (HJB) equation in infinite dimensions. Note that the viscosity analysis developed in our paper generalizes that presented in the existing literature, since the corresponding infinite-dimensional HJB equation includes an additional operator-valued control variable in the Hamiltonian maximization and depends on an additional initial state variable. (c) 2022 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available