Journal
SIAM JOURNAL ON CONTROL AND OPTIMIZATION
Volume 56, Issue 2, Pages 1441-1462Publisher
SIAM PUBLICATIONS
DOI: 10.1137/17M1134731
Keywords
partially observable piecewise deterministic Markov process; Markov decision process; filter; updating operator
Categories
Ask authors/readers for more resources
In this paper we consider a control problem for a partially observable piecewise deterministic Markov process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to control the process continuously in time in such a way that the expected discounted cost of the system is minimized. We solve this optimization problem by reducing it to a discrete-time Markov decision process. This includes the derivation of a filter for the unobservable state. Imposing sufficient continuity and compactness assumptions we are able to prove the existence of optimal policies and show that the value function satisfies a fixed point equation. A generic application is given to illustrate the results.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available