Finite Dimensional Approximations of Hamilton–Jacobi–Bellman Equations for Stochastic Particle Systems with Common Noise

DOI10.1137/22M1489186zbMath1512.35155OpenAlexW4367311981MaRDI QIDQ6042792

Sergio Mayorga, Andrzej Świȩch

Publication date: 4 May 2023

Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/22m1489186

zbMATH Keywords

master equationviscosity solutionsstochastic particle systemsWasserstein spacemean field controlHamilton-Jacobi-Bellman equations in infinite dimensionWasserstein Laplacian

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) PDEs on infinite-dimensional (e.g., function) spaces (= PDEs in infinitely many variables) (35R15) Viscosity solutions to PDEs (35D40) Hamilton-Jacobi equations (35F21) Mean field games and control (49N80)

Related Items (4)

A finite-dimensional approximation for partial differential equations on Wasserstein space ⋮ Equivalence between strict viscosity solution and viscosity solution in the Wasserstein space and regular extension of the Hamiltonian in \(L^2_{\mathbb{P}}\) ⋮ Well-posedness for Hamilton-Jacobi equations on the Wasserstein space on graphs ⋮ Optimal control of stochastic delay differential equations: optimal feedback controls

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Optimal transport and large number of particles
• Hamilton-Jacobi equations in space of measures associated with a system of conservation laws
• Metric viscosity solutions of Hamilton-Jacobi equations depending on local slopes
• On the rate of convergence in Wasserstein distance of the empirical measure
• Existence of a solution to an equation arising from the theory of mean field games
• The stochastic value function in metric measure spaces
• Hamilton-Jacobi equations in the Wasserstein space
• A general characterization of the mean field limit for stochastic differential games
• A comparison principle for Hamilton-Jacobi equations related to controlled gradient flows in infinite dimensions
• A remark on regularization in Hilbert spaces
• Convexity preserving properties for Hamilton-Jacobi equations in geodesic spaces
• On a strong form of propagation of chaos for McKean-Vlasov equations
• Randomized filtering and Bellman equation in Wasserstein space for partial observation control problem
• On differentiability in the Wasserstein space and well-posedness for Hamilton-Jacobi equations
• Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. I: The case of bounded stochastic evolutions
• Continuous dependence estimates for viscosity solutions of fully nonlinear degenerate parabolic equations
• Optimal control of multiagent systems in the Wasserstein space
• The exponential resolvent of a Markov process and large deviations for Markov processes via Hamilton-Jacobi equations
• A Hamilton-Jacobi PDE associated with hydrodynamic fluctuations from a nonlinear diffusion equation
• A general convergence result for viscosity solutions of Hamilton-Jacobi equations and non-linear semigroups
• Mean field games master equations with nonseparable Hamiltonians and displacement monotonicity
• Extended mean field control problem: a propagation of chaos result
• Weak quantitative propagation of chaos via differential calculus on the space of measures
• Convergence to the mean field game limit: a case study
• From the master equation to mean field game limit theory: large deviations and concentration of measure
• Viscosity solutions to parabolic master equations and McKean-Vlasov SDEs with closed-loop controls
• Lattice approximations of the first-order mean field type differential games
• Infinite horizon value functions in the Wasserstein spaces
• A partial Laplacian as an infinitesimal generator on the Wasserstein space
• Zero-sum stochastic differential games of generalized McKean-Vlasov type
• Stochastic nonlinear Fokker-Planck equations
• The master equation in mean field theory
• Value functions in the Wasserstein spaces: finite time horizons
• On the interpretation of the master equation
• Hamilton-Jacobi-Isaacs equations for differential games with asymmetric information on probabilistic initial condition
• Mean-field stochastic differential equations and associated PDEs
• From the master equation to mean field game limit theory: a central limit theorem
• On a class of first order Hamilton-Jacobi equations in metric spaces
• Controlled Markov processes and viscosity solutions
• On the convergence of closed-loop Nash equilibria to the mean field game limit
• Solutions to Hamilton-Jacobi equation on a Wasserstein space
• Optimal control for a mixed flow of Hamiltonian and gradient type in space of probability measures
• On metric viscosity solutions for Hamilton-Jacobi equations of evolution type
• Stochastic Optimal Control in Infinite Dimension
• Bellman equation and viscosity solutions for mean-field stochastic control problem
• Viscosity Solutions for Controlled McKean--Vlasov Jump-Diffusions
• User’s guide to viscosity solutions of second order partial differential equations
• The Master Equation and the Convergence Problem in Mean Field Games
• Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
• Stability properties and large time behavior of viscosity solutions of Hamilton–Jacobi equations on metric spaces
• Extension of range of functions
• A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria
• Control in Hilbert Space and First-Order Mean Field Type Problem
• Monotone Solutions of the Master Equation for Mean Field Games with Idiosyncratic Noise
• Control problem on space of random variables and master equation
• Hamilton-Jacobi in metric spaces with a homological term
• Limit Theory for Controlled McKean--Vlasov Dynamics
• Probabilistic Theory of Mean Field Games with Applications I
• Probabilistic Theory of Mean Field Games with Applications II
• Eikonal equations in metric spaces
• Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
• Finite Dimensional Approximations of Hamilton--Jacobi--Bellman Equations in Spaces of Probability Measures
• Global Well‐Posedness of Master Equations for Deterministic Displacement Convex Potential Mean Field Games

This page was built for publication: Finite Dimensional Approximations of Hamilton–Jacobi–Bellman Equations for Stochastic Particle Systems with Common Noise