Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
From MaRDI portal
Abstract: We study the optimal control of general stochastic McKean-Vlasov equation. Such problem is motivated originally from the asymptotic formulation of cooperative equilibrium for a large population of particles (players) in mean-field interaction under common noise. Our first main result is to state a dynamic programming principle for the value function in the Wasserstein space of probability measures, which is proved from a flow property of the conditional law of the controlled state process. Next, by relying on the notion of differentiability with respect to probability measures due to P.L. Lions [32], and It{^o}'s formula along a flow of conditional measures, we derive the dynamic programming Hamilton-Jacobi-Bellman equation, and prove the viscosity property together with a uniqueness result for the value function. Finally, we solve explicitly the linear-quadratic stochastic McKean-Vlasov control problem and give an application to an interbank systemic risk model with common noise.
Recommendations
- Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
- McKean-Vlasov optimal control: the dynamic programming principle
- Discrete time McKean-Vlasov control problem: a dynamic programming approach
- Stochastic optimal control of McKean-Vlasov equations with anticipating law
- Dynamic programming for multidimensional stochastic control problems
- Near optimality of stochastic control for singularly perturbed McKean-Vlasov systems
- Dynamic programming and stochastic control
- Stochastic maximum principle for partially observed optimal control problems of general McKean-Vlasov differential equations
- Stochastic Dynamic Programming and Control of Markov Processes
- Dynamic Programming for the stochastic Navier-Stokes equations
Cites work
- A comparison principle for Hamilton-Jacobi equations related to controlled gradient flows in infinite dimensions
- A general stochastic maximum principle for SDEs of mean-field type
- A maximum principle for SDEs of mean-field type
- A mean-field stochastic control problem with partial observations
- A probabilistic approach to classical solutions of the master equation for large population equilibria
- A probabilistic approach to mean field games with major and minor players
- A pseudo-Markov property for controlled diffusion processes
- Bellman equation and viscosity solutions for mean-field stochastic control problem
- Control of McKean-Vlasov dynamics versus mean field games
- Dynamic programming for mean-field type control
- Dynamic programming for stochastic target problems and geometric flows
- Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics
- Fundamentals of stochastic filtering
- Hamilton-Jacobi equations in the Wasserstein space
- scientific article; zbMATH DE number 3665285 (Why is no real title available?)
- scientific article; zbMATH DE number 3720745 (Why is no real title available?)
- scientific article; zbMATH DE number 1245556 (Why is no real title available?)
- scientific article; zbMATH DE number 515978 (Why is no real title available?)
- scientific article; zbMATH DE number 2152346 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
- Linear-quadratic optimal control problems for mean-field stochastic differential equations
- Mean field games
- Mean field games and systemic risk
- Mean field games with common noise
- Mean-field stochastic differential equations and associated PDEs
- On a Matrix Riccati Equation of Stochastic Control
- On the interpretation of the master equation
- Optimal transport and large number of particles
- Particle representations for a class of nonlinear SPDEs
- Randomized and backward SDE representation for optimal control of non-Markovian SDEs
- Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
- Stochastic McKean-Vlasov equations
- Stochastic Optimal Control in Infinite Dimension
- The Master Equation and the Convergence Problem in Mean Field Games
- The master equation for large population equilibriums
- The master equation in mean field theory
- Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. I: The case of bounded stochastic evolutions
- Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III: Uniqueness of viscosity solutions for general second-order equations
- Well-posedness of mean field games with common noise under a weak monotonicity condition
Cited in
(only showing first 100 items - show all)- Optimal social policies in mean field games
- A maximum principle for mean-field SDEs with time change
- Viability theorem for deterministic mean field type control systems
- Randomized filtering and Bellman equation in Wasserstein space for partial observation control problem
- A stability property in mean field type differential games
- Optimal portfolio choice with path dependent benchmarked labor income: a mean field model
- Mean field games with common noises and conditional distribution dependent FBSDEs
- Optimal continuous-singular control of stochastic McKean-Vlasov system in Wasserstein space of probability measures
- Periodic solutions in distribution of mean-field stochastic differential equations
- Extended mean field control problem: a propagation of chaos result
- A varying terminal time mean-variance model
- McKean-Vlasov optimal control: the dynamic programming principle
- Mean-field Markov decision processes with common noise and open-loop controls
- Centralized systemic risk control in the interbank system: weak formulation and gamma-convergence
- DeepSets and their derivative networks for solving symmetric PDEs
- Mean-field-type games with jump and regime switching
- A Mckean-Vlasov approach to distributed electricity generation development
- Dynamic programming and Hamilton-Jacobi-Bellman equations on time scales
- Continuous-time mean field games with finite state space and common noise
- A general stochastic maximum principle for mean-field controls with regime switching
- Lattice approximations of the first-order mean field type differential games
- Zero-sum stochastic differential games of generalized McKean-Vlasov type
- Krasovskii-Subbotin approach to mean field type differential games
- Linear quadratic optimal control of conditional McKean-Vlasov equation with random coefficients and applications
- A mean-field optimal control formulation of deep learning
- Strong approximation of non-autonomous time-changed McKean-Vlasov stochastic differential equations
- Propagation of chaos and conditional McKean-Vlasov SDEs with regime-switching
- Bellman equation and viscosity solutions for mean-field stochastic control problem
- Viscosity solutions for controlled McKean-Vlasov jump-diffusions
- Mean-field linear-quadratic stochastic differential games in an infinite horizon
- Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
- Mean field control and mean field game models with several populations
- A class of finite-dimensional numerically solvable McKean-Vlasov control problems
- Controlled Markov chains with non-exponential discounting and distribution-dependent costs
- Finite state N-agent and mean field control problems
- Mean-field limit for a class of stochastic ergodic control problems
- Near optimality of stochastic control for singularly perturbed McKean-Vlasov systems
- A probabilistic approach to classical solutions of the master equation for large population equilibria
- Rate of convergence for particle approximation of PDEs in Wasserstein space
- Control in Hilbert space and first-order mean field type problem
- A Risk Extended Version of Merton’s Optimal Consumption and Portfolio Selection
- A stochastic maximum principle for switching diffusions using conditional mean-fields with applications to control problems
- Adaptive robust control in continuous time
- Linear quadratic mean field type control and mean field games with common noise, with application to production of an exhaustible resource
- Discrete time McKean-Vlasov control problem: a dynamic programming approach
- Optimal stopping of McKean-Vlasov diffusions via regression on particle systems
- A Tale of a Principal and Many, Many Agents
- Limit theory for controlled McKean-Vlasov dynamics
- Model uncertainty stochastic mean-field control
- Robust Markowitz mean-variance portfolio selection under ambiguous covariance matrix
- Finite dimensional approximations of Hamilton-Jacobi-Bellman equations in spaces of probability measures
- McKean–Vlasov Optimal Control: Limit Theory and Equivalence Between Different Formulations
- Nonlinear Markov chains with finite state space: invariant distributions and long-term behaviour
- Dynamic programming for mean-field type control
- Finite Dimensional Approximations of Hamilton–Jacobi–Bellman Equations for Stochastic Particle Systems with Common Noise
- Maximum principle for mean-field SDEs under model uncertainty
- Mean–field moral hazard for optimal energy demand response management
- Portfolio diversification and model uncertainty: A robust dynamic mean‐variance approach
- An Algebraic Convergence Rate for the Optimal Control of McKean–Vlasov Dynamics
- An extended McKean-Vlasov dynamic programming approach to robust equilibrium controls under ambiguous covariance matrix
- Stochastic Fokker–Planck Equations for Conditional McKean–Vlasov Jump Diffusions and Applications to Optimal Control
- Strong convergence of Euler-Maruyama schemes for doubly perturbed McKean-Vlasov stochastic differential equations
- Equilibrium pricing of securities in the co-presence of cooperative and non-cooperative populations
- Master Bellman equation in the Wasserstein space: Uniqueness of viscosity solutions
- A level-set approach to the control of state-constrained McKean-Vlasov equations: application to renewable energy storage and portfolio selection
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Mean field control and finite agent approximation for regime-switching jump diffusions
- Superposition and mimicking theorems for conditional McKean-Vlasov equations
- Dynamic Programming Equation for the Mean Field Optimal Stopping Problem
- Fully-coupled mean-field FBSDE and maximum principle for related optimal control problem
- Markovian-switching systems: backward and forward-backward stochastic differential equations, mean-field interactions, and nonzero-sum differential games
- Viscosity Solutions for McKean–Vlasov Control on a Torus
- A Global Optimality Principle for Fully Coupled Mean-field Control Systems
- Well-posedness for Hamilton-Jacobi equations on the Wasserstein space on graphs
- Optimal stopping of conditional McKean-Vlasov jump diffusions
- A \(C^1\)-Itô's formula for flows of semimartingale distributions
- Recent developments in machine learning methods for stochastic control and games
- Stochastic recursive optimal control of McKean-Vlasov type: a viscosity solution approach
- Control on Hilbert spaces and application to some mean field type control problems
- Infinite horizon average cost optimality criteria for mean-field control
- A probabilistic approach to small noise limit for PDEs in the Wasserstein space
- Propagation of chaos for mean field Schrödinger problems
- Stability and stabilization of large-scale distribution-dependent SDEs
- Kolmogorov equations on the space of probability measures associated to the nonlinear filtering equation: the viscosity approach
- Terminal perturbation for McKean-Vlasov BSDE with regime switching and application to finance
- Existence and uniqueness of strong solutions for a class of mean-field backward stochastic differential equations with non-Lipschitz coefficients
- A Hilbert space method to LQ optimal control of conditional McKean-Vlasov dynamics
- A class of time-changed McKean-Vlasov stochastic differential equations with super-linear drift and Hölder diffusion coefficients
- A randomisation method for mean-field control problems with common noise
- Time-inconsistent mean-field stopping problems: a regularised equilibrium approach
- Learning with linear function approximations in mean-field control
- Actor-critic learning for mean-field control in continuous time
- Ergodic control of McKean-Vlasov systems on the Wasserstein space
- Control of McKean-Vlasov SDEs with contagion through killing at a state-dependent intensity
- On mean field monotonicity conditions from a control theoretical perspective
- Optimal control of the nonlinear stochastic Fokker-Planck equation
- Finite dimensional projections of HJB equations in the Wasserstein space
- Degenerate mean field type control with linear and unbounded diffusion, and their associated equations
- Linear quadratic optimal control problems for conditional mean-field stochastic differential equations under partial information
- Maximum principles for conditional mean field type control problems under partial and full observation with applications
This page was built for publication: Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5737639)
