Existence of optimal controls for partially observed jump processes
This paper deals with a partially observable stochastic control problem for an \({\mathbb R}^d\)-valued Markov jump process \((X_t)\) given an observation process \((Y_t)\) which is a point process. In a previous paper [\textit{C. Ceci} and \textit{A. Gerardi}, Stochastic Processes Appl. 78, No.~2, 245-260 (1998; Zbl 0934.60077)], the authors have considered the case where \((Y_t)\) is the process that counts the jumps of \((X_s)\) up to time \(t\). In the present work they address the more general problem where \((X_t,Y_t)\) is a pure jump Markov process whose components may be strongly dependent. In particular no independence assumption is made on the intensities of \((X_t)\) and \((Y_t)\), which may have common jumps. They formulate the usual associated separated control problem in which the first component is a measure-valued process satisfying a controlled filtering equation. A relaxed generalized and totally observable control problem, for which an optimal strategy is determined, is stated by weakening the measurability assumptions on the control processes. Equivalence between the partially observable stochastic control problem and the relaxed generalized separated control problem is discussed. In particular it is proved that the infimum expected cost of the separated problem equals the infimum expected cost of the original problem, using a uniqueness result for the solutions of controlled filtering equations.
- Partially observed control of a Markov jump process with counting observations: Equivalence with the separated problems
- Compactification methods in a control problem of jump processes under partial observations
- Mixed control problem under partial observation
- Publication:3032184
- Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation
- scientific article; zbMATH DE number 4020996
- Existence of an Optimal Markovian Filter for the Control under Partial Observations
- Martingale measures and partially observable diffusions
- Optimal control of Markovian jump processes with partial information and applications to a parallel queueing model
- Mixed control problem under partial observation
- Compactification methods in a control problem of jump processes under partial observations
- Optimal channel choice for lossy data flow transmission
- Partially observed control of a Markov jump process with counting observations: Equivalence with the separated problems
- scientific article; zbMATH DE number 4130301 (Why is no real title available?)
- Problems of differential and topological diagnostics. II: Problem of differential diagnostics
- Problems of differential and topological diagnostics. III: The checking problem
- Controlled Heterogeneous Collection: The Role of Occupation Numbers
- EXISTENCE OF OPTIMAL CONTROLS FOR PARTIALLY OBSERVED GENERAL SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS
- scientific article; zbMATH DE number 3940369 (Why is no real title available?)
- Existence of an Optimal Markovian Filter for the Control under Partial Observations
- scientific article; zbMATH DE number 63757 (Why is no real title available?)
- Observation control for discrete-continuous stochastic systems
- An approximation method for controlled discrete jump processes under partial observations
- Control and observation for dynamical queueing networks. I
- Optimal control of partially observable piecewise deterministic Markov processes
- Problems of differential and topological diagnostics. V: The case of trajectorial measurements with error
- Problems of differential and topological diagnostics. VI: Statistical solving of the problem of differential diagnostics
- Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation
- Problems of differential and topological diagnostics. IV: The case of exact trajectorial measurements
- Problems of differential and topological diagnostics. I: Motion equations and classification of malfunctions
- Two-armed restless bandits with imperfect information: stochastic control and indexability
- Refined diagnostic problem for a model of a moving platform
This page was built for publication: Existence of optimal controls for partially observed jump processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1862261)
