Large population games with interactions through controls and common noise: convergence results and equivalence between open-loop and closed-loop controls

DOI10.1051/COCV/2023005arXiv2108.02992OpenAlexW4315781372MaRDI QIDQ6138467FDOQ6138467

Mao Fabrice Djete

Publication date: 5 September 2023

Published in: ESAIM: Control, Optimisation and Calculus of Variations (Search for Journal in Brave)

Abstract: In the presence of a common noise, we study the convergence problems in mean field game (MFG) and mean field control (MFC) problem where the cost function and the state dynamics depend upon the joint conditional distribution of the controlled state and the control process. In the first part, we consider the MFG setting. We start by recalling the notions of $measure$--$valued$ MFG equilibria and of approximate $closed$--$loop$ Nash equilibria associated to the corresponding $N$--player game. Then, we show that all convergent sequences of approximate $closed$--$loop$ Nash equilibria, when $Noinfty,$ converge to $measure$--$valued$ MFG equilibria. And conversely, any $measure$--$valued$ MFG equilibrium is the limit of a sequence of approximate $closed$--$loop$ Nash equilibria. In other words, $measure$--$valued$ MFG equilibria are the accumulation points of the approximate $closed$--$loop$ Nash equilibria. Previous work has shown that $measure$--$valued$ MFG equilibria are the accumulation points of the approximate $open$--$loop$ Nash equilibria. Therefore, we obtain that the limits of approximate $closed$--$loop$ Nash equilibria and approximate $open$--$loop$ Nash equilibria are the same. In the second part, we deal with the MFC setting. After recalling the $closed$--$loop$ and $open$--$loop$ formulations of the MFC problem, we prove that they are equivalent. We also provide some convergence results related to approximate $closed$--$loop$ Pareto equilibria.

Full work available at URL: https://arxiv.org/abs/2108.02992

Mathematics Subject Classification ID

Applications of stochastic analysis (to PDEs, etc.) (60H30) Mean field games and control (49N80) Mean field games (aspects of game theory) (91A16)

Cites Work

• Mean field games
• Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
• Local behavior of solutions of quasilinear parabolic equations
• Mean field games. I: The stationary case
• Title not available (Why is that?)
• Compactification methods in the control of degenerate diffusions: existence of an optimal control
• On the existence of classical solutions for stationary extended mean field games
• ON STRONG SOLUTIONS AND EXPLICIT FORMULAS FOR SOLUTIONS OF STOCHASTIC INTEGRAL EQUATIONS
• On Certain Questions in the Theory of Optimal Control
• Particle representations for a class of nonlinear SPDEs
• Measurability of semimartingale characteristics with respect to the probability law
• A general characterization of the mean field limit for stochastic differential games
• A probabilistic weak formulation of mean field games and applications
• Mean field games with common noise
• Fokker–Planck–Kolmogorov Equations
• An extended mean field game for storage in smart grids
• Existence of a solution to an equation arising from the theory of mean field games
• The Master Equation and the Convergence Problem in Mean Field Games
• Linear quadratic mean field type control and mean field games with common noise, with application to production of an exhaustible resource
• Probabilistic Theory of Mean Field Games with Applications I
• On a strong form of propagation of chaos for McKean-Vlasov equations
• On the connection between symmetric \(N\)-player games and mean field games
• The existence of optimal controls
• Schauder estimates for a class of potential mean field games of controls
• Limit Theory for Controlled McKean--Vlasov Dynamics
• Extended deterministic mean-field games
• Uniqueness for linear-quadratic mean field games with common noise
• Mean field game of controls and an application to trade crowding
• Mean field games of controls: on the convergence of Nash equilibria
• From the master equation to mean field game limit theory: a central limit theorem
• Monotone solutions for mean field games master equations: finite state space and optimal stopping
• Restoring uniqueness to mean-field games by randomizing the equilibria
• Finite state mean field games with Wright-Fisher common noise
• On the convergence of closed-loop Nash equilibria to the mean field game limit
• Non-equivalence of stochastic optimal control problems with open and closed loop controls
• From the master equation to mean field game limit theory: large deviations and concentration of measure
• Control problem on space of random variables and master equation
• An example of multiple mean field limits in ergodic differential games
• On classical solutions to the mean field game system of controls
• Extended mean field control problem: a propagation of chaos result
• Mean-field Markov decision processes with common noise and open-loop controls
• Convergence of Large Population Games to Mean Field Games with Interaction Through the Controls
• McKean–Vlasov Optimal Control: Limit Theory and Equivalence Between Different Formulations
• Closed-loop convergence for mean field games with common noise
• Mean Field Games

Cited In (6)

• The Role of Population Games in the Design of Optimization-Based Controllers
• Individual and mass behavior in large population forward–backward stochastic control problems: Centralized and Nash equilibrium solutions
• Isomorphism Properties of Optimality and Equilibrium Solutions Under Equivalent Information Structure Transformations: Stochastic Dynamic Games and Teams
• From finite population optimal stopping to mean field optimal stopping
• Convergence of Large Population Games to Mean Field Games with Interaction Through the Controls
• Set values for mean field games

This page was built for publication: Large population games with interactions through controls and common noise: convergence results and equivalence between open-loop and closed-loop controls

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6138467)