An approximation method for stochastic control problems with partial observation of the state - a method for constructing -optimal controls
continuous-time stochastic control problem with partial observationsdynamic programming techniquesrandom measure transformationstochastic approximation
Existence of optimal solutions to problems involving randomness (49J55) Dynamic programming in optimal control and differential games (49L20) Signal detection and filtering (aspects of stochastic processes) (60G35) Random measures (60G57) Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Optimal stochastic control (93E20)
The authors consider a continuous-time stochastic control problem with partial observations. The dynamics of the controlled system is described by an Ito differential equation, the observation process by another stochastic differential equation. The cost of the controls and the resulting motion of the system for a fixed time interval are measured by an expected value functional containing the integral over a running cost function and a terminal cost part. Approximating the controls and functions in the system's stochastic differential equations by step functions and discretizing the observations, the authors prove that under rather mild assumptions the infinite-dimensional problem considered can successively be approximated by a discrete-time stochastic control problem with complete state observations and with a finite number of finitely valued possible states and controls. Thus, dynamic programming techniques may be applied to the approximating problem for computing optimal controls which are shown to be optimal within \(\epsilon\)-limits for the original problem as well.
- Discrete dynamic programming and viscosity solutions of the Bellman equation
- Approximations for discrete-time adaptive control: Construction of \(\varepsilon\)-optimal controls
- Concepts and methods for discrete and continuous time control under uncertainty
- A transformation method for stochastic control problems with partial observations
- On the construction of -optimal strategies in partially observed MDPs
- scientific article; zbMATH DE number 3948141 (Why is no real title available?)
- scientific article; zbMATH DE number 3963708 (Why is no real title available?)
- scientific article; zbMATH DE number 3983056 (Why is no real title available?)
- scientific article; zbMATH DE number 4033647 (Why is no real title available?)
- The solution of a partially observed stochastic optimal control problem in terms of predicted miss
- An Approach to Discrete-Time Stochastic Control Problems under Partial Observation
- scientific article; zbMATH DE number 4193599 (Why is no real title available?)
- Discrete-Time Approximation of Stochastic Optimal Control with Partial Observation
- A remark on control of partially observed Markov chains
This page was built for publication: An approximation method for stochastic control problems with partial observation of the state - a method for constructing \(\in\)-optimal controls
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1108258)
