Bellman equation and viscosity solutions for mean-field stochastic control problem
From MaRDI portal
Publication:3177924
Stochastic partial differential equations (aspects of stochastic analysis) (60H15) Interacting random processes; statistical mechanics type models; percolation theory (60K35) Dynamic programming (90C39) Vlasov equations (35Q83) Dynamic programming in optimal control and differential games (49L20) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Control/observation systems governed by partial differential equations (93C20) Optimal stochastic control (93E20)
Abstract: We consider the stochastic optimal control problem of McKean-Vlasov stochastic differential equation where the coefficients may depend upon the joint law of the state and control. By using feedback controls, we reformulate the problem into a deterministic control problem with only the marginal distribution of the process as controlled state variable, and prove that dynamic programming principle holds in its general form. Then, by relying on the notion of differentiability with respect to pro-bability measures recently introduced by P.L. Lions in [32], and a special It{^o} formula for flows of probability measures, we derive the (dynamic programming) Bellman equation for mean-field stochastic control problem, and prove a veri-fication theorem in our McKean-Vlasov framework. We give explicit solutions to the Bellman equation for the linear quadratic mean-field control problem, with applications to the mean-variance portfolio selection and a systemic risk model. We also consider a notion of lifted visc-sity solutions for the Bellman equation, and show the viscosity property and uniqueness of the value function to the McKean-Vlasov control problem. Finally, we consider the case of McKean-Vlasov control problem with open-loop controls and discuss the associated dynamic programming equation that we compare with the case of closed-loop controls.
Recommendations
- Ergodic control of McKean-Vlasov SDEs and associated Bellman equation
- Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Dynamic programming for mean-field type control
- scientific article; zbMATH DE number 5016968
Cites work
- scientific article; zbMATH DE number 3121490 (Why is no real title available?)
- scientific article; zbMATH DE number 4211245 (Why is no real title available?)
- scientific article; zbMATH DE number 5016968 (Why is no real title available?)
- scientific article; zbMATH DE number 1245556 (Why is no real title available?)
- scientific article; zbMATH DE number 2152346 (Why is no real title available?)
- A comparison principle for Hamilton-Jacobi equations related to controlled gradient flows in infinite dimensions
- A general stochastic maximum principle for SDEs of mean-field type
- A maximum principle for SDEs of mean-field type
- Continuous time mean-variance portfolio optimization through the mean field approach
- Continuous-time mean-variance portfolio selection: a stochastic LQ framework
- Control of McKean-Vlasov dynamics versus mean field games
- Controlled Markov processes and viscosity solutions
- Dynamic programming for mean-field type control
- Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics
- Hamilton-Jacobi equations in the Wasserstein space
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
- Linear-quadratic mean field games
- Linear-quadratic optimal control problems for mean-field stochastic differential equations
- Mean field games
- Mean field games and systemic risk
- Mean-field stochastic differential equations and associated PDEs
- Metric viscosity solutions of Hamilton-Jacobi equations depending on local slopes
- Nonlinear SDEs driven by L\'evy processes and related PDEs
- On the interpretation of the master equation
- On time-inconsistent stochastic control in continuous time
- Optimal Transport
- Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
- Stochastic Optimal Control in Infinite Dimension
- The master equation for large population equilibriums
- The master equation in mean field theory
- Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. I: The case of bounded stochastic evolutions
- Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III: Uniqueness of viscosity solutions for general second-order equations
Cited in
(70)- Mean-field type FBSDEs in a domination-monotonicity framework and LQ multi-level Stackelberg games
- scientific article; zbMATH DE number 1484942 (Why is no real title available?)
- Mean-field limit for a class of stochastic ergodic control problems
- Mean-field linear-quadratic stochastic differential games in an infinite horizon
- Finite state \(N\)-agent and mean field control problems
- A varying terminal time mean-variance model
- A mean-field optimal control formulation of deep learning
- scientific article; zbMATH DE number 78058 (Why is no real title available?)
- A probabilistic approach to classical solutions of the master equation for large population equilibria
- Characterization of stochastic equilibrium controls by the Malliavin calculus
- On Bellman's equations for mean and variance control of a Markov diffusion
- Controllability Gramian and Kalman rank condition for mean-field control systems
- Optimality conditions in variational form for non-linear constrained stochastic control problems
- Density of subalgebras of Lipschitz functions in metric Sobolev spaces and applications to Wasserstein Sobolev spaces
- Finite Dimensional Approximations of Hamilton–Jacobi–Bellman Equations for Stochastic Particle Systems with Common Noise
- Krasovskii-Subbotin approach to mean field type differential games
- Linear quadratic stochastic optimal control problems with operator coefficients: open-loop solutions
- Lattice approximations of the first-order mean field type differential games
- Schauder estimates for a class of potential mean field games of controls
- Viscosity solutions to parabolic master equations and McKean-Vlasov SDEs with closed-loop controls
- Hamilton-Jacobi equations for controlled gradient flows: the comparison principle
- Viscosity Solutions for Obstacle Problems on Wasserstein Space
- Mean-field optimal control as Gamma-limit of finite agent controls
- Controlled Markov chains with non-exponential discounting and distribution-dependent costs
- scientific article; zbMATH DE number 4002910 (Why is no real title available?)
- Optimal control for stochastic partial differential equations and viscosity solutions of Bellman equations
- A closed-loop saddle point for zero-sum linear-quadratic stochastic differential games with mean-field type
- Itô's formula for flows of measures on semimartingales
- McKean–Vlasov Optimal Control: Limit Theory and Equivalence Between Different Formulations
- Viscosity solutions for controlled McKean-Vlasov jump-diffusions
- Stochastic control with delayed information and related nonlinear master equation
- Rate of convergence for particle approximation of PDEs in Wasserstein space
- Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
- Near optimality of stochastic control for singularly perturbed McKean-Vlasov systems
- An extended McKean-Vlasov dynamic programming approach to robust equilibrium controls under ambiguous covariance matrix
- Viability theorem for deterministic mean field type control systems
- scientific article; zbMATH DE number 497467 (Why is no real title available?)
- Extended mean field control problems: stochastic maximum principle and transport perspective
- Discrete-time mean-field stochastic control with partial observations
- Extended mean-field control problem with partial observation
- Closed-Loop Equilibrium for Time-Inconsistent McKean--Vlasov Controlled Problem
- Mean–field moral hazard for optimal energy demand response management
- Dynamic Programming Equation for the Mean Field Optimal Stopping Problem
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Finite dimensional approximations of Hamilton-Jacobi-Bellman equations in spaces of probability measures
- Nonexponential Sanov and Schilder theorems on Wiener space: BSDEs, Schrödinger problems and control
- A strong comparison result for the bellman equation arising in stochastic exit time control problems and its applications
- Mean-field linear-quadratic stochastic differential games
- Extended Mckean-Vlasov optimal stochastic control applied to smart grid management,
- Ergodic control of McKean-Vlasov SDEs and associated Bellman equation
- Mean field verification theorem
- A stability property in mean field type differential games
- McKean-Vlasov optimal control: the dynamic programming principle
- A level-set approach to the control of state-constrained McKean-Vlasov equations: application to renewable energy storage and portfolio selection
- A Global Optimality Principle for Fully Coupled Mean-field Control Systems
- Wellposedness of second order master equations for mean field games with nonsmooth data
- Importance sampling for the empirical measure of weakly interacting diffusions
- Master Bellman equation in the Wasserstein space: Uniqueness of viscosity solutions
- Stochastic recursive optimal control of McKean-Vlasov type: a viscosity solution approach
- Control on Hilbert spaces and application to some mean field type control problems
- Controlled measure-valued martingales: a viscosity solution approach
- Hypergraphon mean field games
- Kolmogorov equations on the space of probability measures associated to the nonlinear filtering equation: the viscosity approach
- Classical solution of path-dependent mean-field semilinear PDEs
- A fast iterative PDE-based algorithm for feedback controls of nonsmooth mean-field control problems
- Exact controllability for mean-field type linear game-based control systems
- Well-posedness for Hamilton-Jacobi equations on the Wasserstein space on graphs
- Fully-coupled mean-field FBSDE and maximum principle for related optimal control problem
- Viscosity solutions for mean field optimal switching with a two-time-scale Markov chain
- Viscosity Solutions for McKean–Vlasov Control on a Torus
This page was built for publication: Bellman equation and viscosity solutions for mean-field stochastic control problem
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3177924)
