Discretisation of stochastic control problems for continuous time dynamics with delay
From MaRDI portal
Abstract: As a main step in the numerical solution of control problems in continuous time, the controlled process is approximated by sequences of controlled Markov chains, thus discretising time and space. A new feature in this context is to allow for delay in the dynamics. The existence of an optimal strategy with respect to the cost functional can be guaranteed in the class of relaxed controls. Weak convergence of the approximating extended Markov chains to the original process together with convergence of the associated optimal strategies is established.
Recommendations
- Discretisation of continuous-time stochastic optimal control problems with delay.
- Time discretisation and rate of convergence for the optimal control of continuous-time stochastic systems with delay
- scientific article; zbMATH DE number 935166
- scientific article; zbMATH DE number 1104519
- On the time discretization of stochastic optimal control problems: the dynamic programming approach
Cites work
- scientific article; zbMATH DE number 1577097 (Why is no real title available?)
- scientific article; zbMATH DE number 2134039 (Why is no real title available?)
- scientific article; zbMATH DE number 3936125 (Why is no real title available?)
- scientific article; zbMATH DE number 3951715 (Why is no real title available?)
- scientific article; zbMATH DE number 4034749 (Why is no real title available?)
- scientific article; zbMATH DE number 1325009 (Why is no real title available?)
- scientific article; zbMATH DE number 1354815 (Why is no real title available?)
- scientific article; zbMATH DE number 1099342 (Why is no real title available?)
- Convergence in Nonlinear Filtering for Stochastic Delay Systems
- Discrete-time approximations of stochastic delay equations: the Milstein scheme.
- Dynamic programming in stochastic control of systems with delay
- Introduction to the numerical analysis of stochastic delay differential equations
- Numerical approximations for nonlinear stochastic systems with delays
- On the rate of convergence of finite-difference approximations for Bellman's equations with variable coefficients
- Representation and control of infinite dimensional systems. Volume I
- Some Solvable Stochastic Control Problems With Delay
- Stochastic differential equations. An introduction with applications.
- Vintage capital and the dynamics of the AK model
- Weak convergence methods and singularly perturbed stochastic control and filtering problems
- Weak limit theorems for stochastic integrals and stochastic differential equations
Cited in
(8)- Time discretisation and rate of convergence for the optimal control of continuous-time stochastic systems with delay
- Recurrent neural networks for stochastic control problems with delay
- Stochastic control problems with delay
- A stochastic control problem with delay arising in a pension fund model
- Discretisation of continuous-time stochastic optimal control problems with delay.
- Discrete approximations of controlled stochastic systems with memory: a survey
- Finite-dimensional representations for controlled diffusions with delay
- A constructive approach to existence of equilibria in time-inconsistent stochastic control problems
This page was built for publication: Discretisation of stochastic control problems for continuous time dynamics with delay
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q885948)
