The master equation for large population equilibriums
From MaRDI portal
Abstract: We use a simple N-player stochastic game with idiosyncratic and common noises to introduce the concept of Master Equation originally proposed by Lions in his lectures at the Coll`ege de France. Controlling the limit N tends to the infinity of the explicit solution of the N-player game, we highlight the stochastic nature of the limit distributions of the states of the players due to the fact that the random environment does not average out in the limit, and we recast the Mean Field Game (MFG) paradigm in a set of coupled Stochastic Partial Differential Equations (SPDEs). The first one is a forward stochastic Kolmogorov equation giving the evolution of the conditional distributions of the states of the players given the common noise. The second is a form of stochastic Hamilton Jacobi Bellman (HJB) equation providing the solution of the optimization problem when the flow of conditional distributions is given. Being highly coupled, the system reads as an infinite dimensional Forward Backward Stochastic Differential Equation (FBSDE). Uniqueness of a solution and its Markov property lead to the representation of the solution of the backward equation (i.e. the value function of the stochastic HJB equation) as a deterministic function of the solution of the forward Kolmogorov equation, function which is usually called the decoupling field of the FBSDE. The (infinite dimensional) PDE satisfied by this decoupling field is identified with the extit{master equation}. We also show that this equation can be derived for other large populations equilibriums like those given by the optimal control of McKean-Vlasov stochastic differential equations. The paper is written more in the style of a review than a technical paper, and we spend more time and energy motivating and explaining the probabilistic interpretation of the Master Equation, than identifying the most general set of assumptions under which our claims are true.
Recommendations
- The master equation in mean field theory
- Convergence, fluctuations and large deviations for finite state mean field games via the master equation
- An introduction to mean field game theory
- Mean field games: the master equation and the mean field limit
- The Master Equation and the Convergence Problem in Mean Field Games
Cites work
- Control of McKean-Vlasov dynamics versus mean field games
- Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics
- scientific article; zbMATH DE number 4211245 (Why is no real title available?)
- scientific article; zbMATH DE number 158461 (Why is no real title available?)
- scientific article; zbMATH DE number 785439 (Why is no real title available?)
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
- Mean field games
- Mean field games and systemic risk
- Mean field games models -- a brief survey
- Mean field games with common noise
- Mean field games. I: The stationary case
- Mean field games. II: Finite horizon and optimal control
- Numerical method for FBSDEs of McKean-Vlasov type
- On non-Markovian forward-backward SDEs and backward stochastic PDEs
- Probabilistic analysis of mean-field games
- Stochastic Hamilton–Jacobi–Bellman Equations
- The master equation in mean field theory
Cited in
(70)- Mean-field forward and backward SDEs with jumps and associated nonlocal quasi-linear integral-PDEs
- Viability theorem for deterministic mean field type control systems
- Randomized filtering and Bellman equation in Wasserstein space for partial observation control problem
- Strong solutions of mean-field stochastic differential equations with irregular drift
- Sharp semi-concavity in a non-autonomous control problem and \(L^p\) estimates in an optimal-exit MFG
- A stability property in mean field type differential games
- McKean-Vlasov SDEs under measure dependent Lyapunov conditions
- Stationary fully nonlinear mean-field games
- Mean-field Langevin dynamics and energy landscape of neural networks
- McKean-Vlasov optimal control: the dynamic programming principle
- A mean field game price model with noise
- On first order mean field game systems with a common noise
- From the master equation to mean field game limit theory: large deviations and concentration of measure
- Viscosity solutions to parabolic master equations and McKean-Vlasov SDEs with closed-loop controls
- Quenched mass transport of particles toward a target
- On a mean field optimal control problem
- Forward-backward stochastic differential equations with monotone functionals and mean field games with common noise
- Linear quadratic optimal control of conditional McKean-Vlasov equation with random coefficients and applications
- Restoring uniqueness to mean-field games by randomizing the equilibria
- The master equation in mean field theory
- On the interpretation of the master equation
- From the master equation to mean field game limit theory: a central limit theorem
- Mean-field SDEs with jumps and nonlocal integral-PDEs
- scientific article; zbMATH DE number 5990053 (Why is no real title available?)
- Bellman equation and viscosity solutions for mean-field stochastic control problem
- Existence of Solutions of the Master Equation in the Smooth Case
- Well-posedness of mean field games with common noise under a weak monotonicity condition
- A numerical scheme for a mean field game in some queueing systems based on Markov chain approximation method
- Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics
- A Mean Field Game of Optimal Stopping
- Mean field control and mean field game models with several populations
- Analysis of a Finite State Many Player Game Using Its Master Equation
- Existence of a solution to an equation arising from the theory of mean field games
- Minimal-time mean field games
- A mean field game of optimal portfolio liquidation
- A probabilistic approach to classical solutions of the master equation for large population equilibria
- Dimension reduction techniques in deterministic mean field games
- The master equation in a bounded domain with Neumann conditions
- Monotone solutions of the master equation for mean field games with idiosyncratic noise
- Control problem on space of random variables and master equation
- Viability analysis of the first-order mean field games
- Stackelberg solution of first-order mean field game with a major player
- Linear quadratic mean field type control and mean field games with common noise, with application to production of an exhaustible resource
- Mean field game theory with a partially observed major agent
- Limit theory for controlled McKean-Vlasov dynamics
- Dynamic Programming for Optimal Control of Stochastic McKean--Vlasov Dynamics
- Numerical approximations of coupled forward–backward SPDEs
- Doubly-stochastic interpretation for nonlocal semi-linear backward stochastic partial differential equations
- Itô-Wentzell-Lions formula for measure dependent random fields under full and conditional measure flows
- Mean field games and master equation
- Viscosity Solutions for Obstacle Problems on Wasserstein Space
- The Convergence Problem in Mean Field Games with Neumann Boundary Conditions
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Splitting methods and short time existence for the master equations in mean field games
- Superposition and mimicking theorems for conditional McKean-Vlasov equations
- A posteriori estimate for a class of mean-field forward-backward stochastic differential equations
- A \(C^1\)-Itô's formula for flows of semimartingale distributions
- Classical solution of path-dependent mean-field semilinear PDEs
- Connecting GANs, mean-field games, and optimal transport
- Recent developments in machine learning methods for stochastic control and games
- Stochastic recursive optimal control of McKean-Vlasov type: a viscosity solution approach
- Stability, uniqueness and existence of solutions to McKean-Vlasov stochastic differential equations in arbitrary moments
- Wellposedness of second order master equations for mean field games with nonsmooth data
- Stability, uniqueness and existence of solutions to McKean-Vlasov SDEs: a multidimensional Yamada-Watanabe approach
- Itô's formula for flows of conditional measures on semimartingales
- Mean-field forward-backward stochastic variational inequalities with oblique subgradients and nonlocal parabolic variational inequalities
- Mean-field games of optimal stopping: master equation and weak equilibria
- The well-posedness and stabilities of mean-field stochastic differential equations driven by G-Brownian motion
- A general characterization of the mean field limit for stochastic differential games
- Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics
This page was built for publication: The master equation for large population equilibriums
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5374157)
