Duality and approximation of stochastic optimal control problems under expectation constraints
From MaRDI portal
Publication:3382780
Abstract: We consider a continuous time stochastic optimal control problem under both equality and inequality constraints on the expectation of some functionals of the controlled process. Under a qualification condition, we show that the problem is in duality with an optimization problem involving the Lagrange multiplier associated with the constraints. Then by convex analysis techniques, we provide a general existence result and some a priori estimation of the dual optimizers. We further provide a necessary and sufficient optimality condition for the initial constrained control problem. The same results are also obtained for a discrete time constrained control problem. Moreover, under additional regularity conditions, it is proved that the discrete time control problem converges to the continuous time problem, possibly with a convergence rate. This convergence result can be used to obtain numerical algorithms to approximate the continuous time control problem, which we illustrate by two simple numerical examples.
Recommendations
- Two approaches to stochastic optimal control problems with a final-time expectation constraint
- Convexity and convex approximations of discrete-time stochastic control problems with constraints
- Stochastic optimization under constraints.
- Discrete approximations for strict convex continuous time problems and duality
- Stochastic optimal control and linear programming approach
Cites work
- A General Stochastic Maximum Principle for Optimal Control Problems
- A numerical scheme for BSDEs
- A probabilistic numerical method for fully nonlinear parabolic PDEs
- A theoretical framework for the pricing of contingent claims in the presence of model uncertainty
- Compactification methods in the control of degenerate diffusions: existence of an optimal control
- Discrete-time approximation and Monte-Carlo simulation of backward stochastic differential equations
- Discrete-time probabilistic approximation of path-dependent stochastic control problems
- Duality theorem for the stochastic optimal control problem
- Error bounds for monotone approximation schemes for parabolic Hamilton-Jacobi-Bellman equations
- First and second order necessary conditions for stochastic optimal control problems
- scientific article; zbMATH DE number 1577097 (Why is no real title available?)
- scientific article; zbMATH DE number 4205918 (Why is no real title available?)
- scientific article; zbMATH DE number 1325009 (Why is no real title available?)
- scientific article; zbMATH DE number 477581 (Why is no real title available?)
- scientific article; zbMATH DE number 1502618 (Why is no real title available?)
- Introductory lectures on convex optimization. A basic course.
- Lectures on modern convex optimization. Analysis, algorithms, and engineering applications
- Lectures on stochastic programming. Modeling and theory.
- Numerical schemes for \(G\)-expectations
- On dynamic programming principle for stochastic control under expectation constraints
- On the convergence of monotone schemes for path-dependent PDEs
- On the rate of convergence of finite-difference approximations for Bellman's equations with variable coefficients
- On tightness and stopping times
- Optimal control under stochastic target constraints
- Optimal transport and Skorokhod embedding
- Optimal transportation under controlled stochastic dynamics
- Optimality conditions in variational form for non-linear constrained stochastic control problems
- Semi-Lagrangian schemes for linear and fully non-linear diffusion equations
- State-constrained stochastic optimal control problems via reachability approach
- Stochastic Target Problems, Dynamic Programming, and Viscosity Solutions
- Two approaches to stochastic optimal control problems with a final-time expectation constraint
- Weak approximation of second-order BSDEs
- Weak dynamic programming for generalized state constraints
Cited in
(18)- Two approaches to stochastic optimal control problems with a final-time expectation constraint
- Duality and martingales: a stochastic programming perspective on contingent claims
- Optimal control of diffusion processes with terminal constraint in law
- Convex Duality Approach to the Optimal Control of Diffusions
- A lower bound for optimal risk in dual control problems
- Duality and lower bounds in optimal stochastic control
- Computable Primal and Dual Bounds for Stochastic Control
- Variance minimization approach for a class of dual control problems
- Discrete approximations for strict convex continuous time problems and duality
- Discrete‐time approximation for stochastic optimal control problems under the G‐expectation framework
- Optimal control of the Fokker-Planck equation under state constraints in the Wasserstein space
- Optimal stopping with expectation constraints
- Discrete-Time Approximation of Stochastic Optimal Control with Partial Observation
- A level-set approach to the control of state-constrained McKean-Vlasov equations: application to renewable energy storage and portfolio selection
- Convexity and convex approximations of discrete-time stochastic control problems with constraints
- Stochastic control/stopping problem with expectation constraints
- Robust market convergence: from discrete to continuous time
- Mean-field limit for stochastic control problems under state constraint
This page was built for publication: Duality and approximation of stochastic optimal control problems under expectation constraints
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3382780)
