Master Bellman equation in the Wasserstein space: Uniqueness of viscosity solutions
From MaRDI portal
Publication:6145295
Abstract: We study the Bellman equation in the Wasserstein space arising in the study of mean field control problems, namely stochastic optimal control problems for McKean-Vlasov diffusion processes.Using the standard notion of viscosity solution `a la Crandall-Lions extended to our Wasserstein setting,we prove a comparison result under general conditions on the drift and reward coefficients, whichcoupled with the dynamic programming principle, implies that the value function is the unique viscosity solution of the Master Bellman equation.This is the first uniqueness result in such a second-order context. The classical arguments used in the standard cases of equations in finite-dimensional spaces or in infinite-dimensional separable Hilbert spaces do not extend to the present framework, due to the awkward nature of the underlying Wasserstein space. The adopted strategy is based on finite-dimensional approximations of the value function obtained in terms of the related cooperative -player game, and on the construction of a smooth gauge-type function, built starting from a regularization of a sharp estimate of the Wasserstein metric; such a gauge-type function is used to generate maxima/minima through a suitable extension of the Borwein-Preiss generalization of Ekeland's variational principle on the Wasserstein space.
Recommendations
- Viscosity solutions of the eikonal equation on the Wasserstein space
- A comparison principle for semilinear Hamilton-Jacobi-Bellman equations in the Wasserstein space
- Viscosity solutions of centralized control problems in measure spaces
- Equivalence between strict viscosity solution and viscosity solution in the Wasserstein space and regular extension of the Hamiltonian in \(L^2_{\mathbb{P}}\)
- Viscosity Solutions for McKean–Vlasov Control on a Torus
Cites work
- A Smooth Variational Principle With Applications to Subdifferentiability and to Differentiability of Convex Functions
- Bellman equation and viscosity solutions for mean-field stochastic control problem
- Constructive quantization: approximation by empirical measures
- Controlled diffusion processes. Translated by A. B. Aries
- Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
- Finite dimensional approximations of Hamilton-Jacobi-Bellman equations in spaces of probability measures
- Gradient flows in metric spaces and in the space of probability measures
- Hamilton-Jacobi equations in the Wasserstein space
- Hamiltonian ODEs in the Wasserstein space of probability measures
- scientific article; zbMATH DE number 1713116 (Why is no real title available?)
- scientific article; zbMATH DE number 3505981 (Why is no real title available?)
- scientific article; zbMATH DE number 1061253 (Why is no real title available?)
- scientific article; zbMATH DE number 3323562 (Why is no real title available?)
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
- Limit theory for controlled McKean-Vlasov dynamics
- Mean field games
- Mean field games and mean field type control theory
- Mean field games. I: The stationary case
- Mean field games. II: Finite horizon and optimal control
- Mean-field stochastic differential equations and associated PDEs
- Metric viscosity solutions of Hamilton-Jacobi equations depending on local slopes
- On a class of first order Hamilton-Jacobi equations in metric spaces
- On differentiability in the Wasserstein space and well-posedness for Hamilton-Jacobi equations
- On the rate of convergence in Wasserstein distance of the empirical measure
- One-dimensional empirical measures, order statistics, and Kantorovich transport distances
- Optimal control of diffusion processes and hamilton–jacobi–bellman equations part 2 : viscosity solutions and uniqueness
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Optimal portfolio choice with path dependent benchmarked labor income: a mean field model
- Optimal Transport
- Optimal transport and large number of particles
- Partial regularity of viscosity solutions for a class of Kolmogorov equations arising from mathematical finance
- Path-dependent equations and viscosity solutions in infinite dimension
- Probabilistic theory of mean field games with applications I. Mean field FBSDEs, control, and games
- Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
- Stochastic Optimal Control in Infinite Dimension
- Techniques of variational analysis
- The Master Equation and the Convergence Problem in Mean Field Games
- The master equation in mean field theory
- User’s guide to viscosity solutions of second order partial differential equations
- Viscosity solutions for controlled McKean-Vlasov jump-diffusions
- Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III: Uniqueness of viscosity solutions for general second-order equations
- Viscosity solutions of path-dependent PDEs with randomized time
- Viscosity solutions to parabolic master equations and McKean-Vlasov SDEs with closed-loop controls
- Zero-sum stochastic differential games of generalized McKean-Vlasov type
Cited in
(31)- A comparison principle for semilinear Hamilton-Jacobi-Bellman equations in the Wasserstein space
- Viscosity solutions of the eikonal equation on the Wasserstein space
- Well-posedness for Hamilton-Jacobi equations on the Wasserstein space on graphs
- Partially observed mean-field game and related mean-field forward-backward stochastic differential equation
- Stochastic recursive optimal control of McKean-Vlasov type: a viscosity solution approach
- Propagation of chaos for mean field Schrödinger problems
- Viscosity solutions of centralized control problems in measure spaces
- Kolmogorov equations on the space of probability measures associated to the nonlinear filtering equation: the viscosity approach
- Weak solutions to the master equation of potential mean field games
- Comparison for semi-continuous viscosity solutions for second order PDEs on the Wasserstein space
- A minimality property of the value function in optimal control on spaces of probability measures
- Ergodic control of McKean-Vlasov systems on the Wasserstein space
- Quantitative convergence for mean field control with common noise and degenerate idiosyncratic noise
- Singularities and their propagation in optimal transport
- Finite dimensional projections of HJB equations in the Wasserstein space
- Stochastic optimal transport and Hamilton-Jacobi-Bellman equations on the set of probability measures
- Mean-field backward stochastic differential equations and nonlocal PDEs with quadratic growth
- Stochastic McKean-Vlasov control problem with regime-switching and its applications
- Convergence rate of particle system for second-order PDEs on Wasserstein space
- Comparison of viscosity solutions for a class of second-order PDEs on the Wasserstein space
- Mean field type control problems, some Hilbert-space-valued FBSDES, and related equations
- Well-posedness of Hamilton-Jacobi equations in the Wasserstein space: non-convex Hamiltonians and common noise
- Viscosity solutions of a class of second order Hamilton-Jacobi-Bellman equations in the Wasserstein space
- Finite difference schemes for Hamilton-Jacobi equation on the Wasserstein space on graphs
- Viscosity solutions of fully second-order HJB equations in the Wasserstein space
- Control on Hilbert spaces and mean field control: the common noise case
- Global well-posedness of first-order mean field games and master equations with nonlinear dynamics
- Infinite time horizon optimal control of McKean-Vlasov SDEs
- Mean field games incorporating carryover effects: optimizing advertising models
- Mean-field limit for stochastic control problems under state constraint
- Global well-posedness of Hamilton-Jacobi equations for linear-quadratic mean field control problems
This page was built for publication: Master Bellman equation in the Wasserstein space: Uniqueness of viscosity solutions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6145295)
