Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics

DOI10.1137/16M1071390zbMath1361.93069arXiv1604.04057OpenAlexW2963415493MaRDI QIDQ5737639

Xiaoli Wei, Huyên Pham

Publication date: 24 May 2017

Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1604.04057

zbMATH Keywords

Bellman equationviscosity solutionsWasserstein spacedynamic programming principlestochastic McKean-Vlasov SDEs

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Dynamic programming (90C39) Interacting random processes; statistical mechanics type models; percolation theory (60K35) Optimal stochastic control (93E20) Applications of stochastic analysis (to PDEs, etc.) (60H30)

Related Items (68)

Extended mean field control problem: a propagation of chaos result ⋮ Nonlinear Markov chains with finite state space: invariant distributions and long-term behaviour ⋮ A varying terminal time mean-variance model ⋮ Mean-Field Limit for a Class of Stochastic Ergodic Control Problems ⋮ Near Optimality of Stochastic Control for Singularly Perturbed McKean--Vlasov Systems ⋮ Optimality conditions in variational form for non-linear constrained stochastic control problems ⋮ McKean-Vlasov optimal control: the dynamic programming principle ⋮ A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria ⋮ Linear quadratic mean field social optimization: Asymptotic solvability and decentralized control ⋮ Mean-field Markov decision processes with common noise and open-loop controls ⋮ Rate of convergence for particle approximation of PDEs in Wasserstein space ⋮ Control in Hilbert Space and First-Order Mean Field Type Problem ⋮ DeepSets and their derivative networks for solving symmetric PDEs ⋮ A Risk Extended Version of Merton’s Optimal Consumption and Portfolio Selection ⋮ Mean-field-type games with jump and regime switching ⋮ Optimal social policies in mean field games ⋮ A maximum principle for mean-field SDEs with time change ⋮ Limit Theory for Controlled McKean--Vlasov Dynamics ⋮ Finite Dimensional Approximations of Hamilton–Jacobi–Bellman Equations for Stochastic Particle Systems with Common Noise ⋮ Maximum principle for mean-field SDEs under model uncertainty ⋮ Mean–field moral hazard for optimal energy demand response management ⋮ Portfolio diversification and model uncertainty: A robust dynamic mean‐variance approach ⋮ A Mckean-Vlasov approach to distributed electricity generation development ⋮ An extended McKean-Vlasov dynamic programming approach to robust equilibrium controls under ambiguous covariance matrix ⋮ Stochastic Fokker–Planck Equations for Conditional McKean–Vlasov Jump Diffusions and Applications to Optimal Control ⋮ Strong convergence of Euler-Maruyama schemes for doubly perturbed McKean-Vlasov stochastic differential equations ⋮ Equilibrium pricing of securities in the co-presence of cooperative and non-cooperative populations ⋮ Master Bellman equation in the Wasserstein space: Uniqueness of viscosity solutions ⋮ Strong approximation of non-autonomous time-changed McKean-Vlasov stochastic differential equations ⋮ A level-set approach to the control of state-constrained McKean-Vlasov equations: application to renewable energy storage and portfolio selection ⋮ Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension ⋮ Mean field control and finite agent approximation for regime-switching jump diffusions ⋮ Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics ⋮ Superposition and mimicking theorems for conditional McKean-Vlasov equations ⋮ Fully-coupled mean-field FBSDE and maximum principle for related optimal control problem ⋮ Propagation of chaos and conditional McKean-Vlasov SDEs with regime-switching ⋮ Markovian-switching systems: backward and forward-backward stochastic differential equations, mean-field interactions, and nonzero-sum differential games ⋮ Viscosity Solutions for McKean–Vlasov Control on a Torus ⋮ Viability theorem for deterministic mean field type control systems ⋮ A stochastic maximum principle for switching diffusions using conditional mean-fields with applications to control problems ⋮ Randomized filtering and Bellman equation in Wasserstein space for partial observation control problem ⋮ Dynamic programming and Hamilton-Jacobi-Bellman equations on time scales ⋮ Viscosity Solutions for Controlled McKean--Vlasov Jump-Diffusions ⋮ Continuous-time mean field games with finite state space and common noise ⋮ A general stochastic maximum principle for mean-field controls with regime switching ⋮ Lattice approximations of the first-order mean field type differential games ⋮ Adaptive Robust Control in Continuous Time ⋮ Linear quadratic mean field type control and mean field games with common noise, with application to production of an exhaustible resource ⋮ A stability property in mean field type differential games ⋮ Model uncertainty stochastic mean-field control ⋮ Robust Markowitz mean‐variance portfolio selection under ambiguous covariance matrix ⋮ Zero-sum stochastic differential games of generalized McKean-Vlasov type ⋮ A Global Optimality Principle for Fully Coupled Mean-field Control Systems ⋮ Krasovskii-Subbotin approach to mean field type differential games ⋮ Linear quadratic optimal control of conditional McKean-Vlasov equation with random coefficients and applications ⋮ A class of finite-dimensional numerically solvable McKean-Vlasov control problems ⋮ Optimal Stopping of McKean--Vlasov Diffusions via Regression on Particle Systems ⋮ Mean-field linear-quadratic stochastic differential games in an infinite horizon ⋮ A Tale of a Principal and Many, Many Agents ⋮ A mean-field optimal control formulation of deep learning ⋮ Optimal portfolio choice with path dependent benchmarked labor income: a mean field model ⋮ Mean Field Control and Mean Field Game Models with Several Populations ⋮ Mean field games with common noises and conditional distribution dependent FBSDEs ⋮ Controlled Markov chains with non-exponential discounting and distribution-dependent costs ⋮ Finite stateN-agent and mean field control problems ⋮ Finite Dimensional Approximations of Hamilton--Jacobi--Bellman Equations in Spaces of Probability Measures ⋮ Periodic solutions in distribution of mean-field stochastic differential equations ⋮ McKean–Vlasov Optimal Control: Limit Theory and Equivalence Between Different Formulations

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A probabilistic approach to mean field games with major and minor players
• Control of McKean-Vlasov dynamics versus mean field games
• Optimal transport and large number of particles
• Mean field games with common noise
• A maximum principle for SDEs of mean-field type
• A general stochastic maximum principle for SDEs of mean-field type
• Hamilton-Jacobi equations in the Wasserstein space
• Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics
• Fundamentals of stochastic filtering
• Mean field games
• A comparison principle for Hamilton-Jacobi equations related to controlled gradient flows in infinite dimensions
• Particle representations for a class of nonlinear SPDEs
• A mean-field stochastic control problem with partial observations
• Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III: Uniqueness of viscosity solutions for general second-order equations
• Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. I: The case of bounded stochastic evolutions
• Dynamic programming for stochastic target problems and geometric flows
• Stochastic McKean-Vlasov equations
• The master equation in mean field theory
• Mean field games and systemic risk
• Randomized and backward SDE representation for optimal control of non-Markovian SDEs
• On the interpretation of the master equation
• Mean-field stochastic differential equations and associated PDEs
• Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
• A Pseudo-Markov Property for Controlled Diffusion Processes
• Linear-Quadratic Optimal Control Problems for Mean-Field Stochastic Differential Equations
• Stochastic Optimal Control in Infinite Dimension
• Bellman equation and viscosity solutions for mean-field stochastic control problem
• Wellposedness of Mean Field Games with Common Noise under a Weak Monotonicity Condition
• The Master Equation and the Convergence Problem in Mean Field Games
• Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
• A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria
• The Master Equation for Large Population Equilibriums
• On a Matrix Riccati Equation of Stochastic Control
• Dynamic programming for mean-field type control

This page was built for publication: Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics