Mean field games of controls: finite difference approximations
From MaRDI portal
Publication:2167461
DOI10.3934/MINE.2021024zbMATH Open1496.91011arXiv2003.03968OpenAlexW3009364473MaRDI QIDQ2167461FDOQ2167461
Authors: Ziad Kobeissi, Yves Achdou 
Publication date: 25 August 2022
Published in: Mathematics in Engineering (Search for Journal in Brave)
Abstract: We consider a class of mean field games in which the agents interact through both their states and controls, and we focus on situations in which a generic agent tries to adjust her speed (control) to an average speed (the average is made in a neighborhood in the state space). In such cases, the monotonicity assumptions that are frequently made in the theory of mean field games do not hold, and uniqueness cannot be expected in general. Such model lead to systems of forward-backward nonlinear nonlocal parabolic equations; the latter are supplemented with various kinds of boundary conditions, in particular Neumann-like boundary conditions stemming from reflection conditions on the underlying controled stochastic processes. The present work deals with numerical approximations of the above mentioned systems. After describing the finite difference scheme, we propose an iterative method for solving the systems of nonlinear equations that arise in the discrete setting; it combines a continuation method, Newton iterations and inner loops of a bigradient like solver. The numerical method is used for simulating two examples. We also make experiments on the behaviour of the iterative algorithm when the parameters of the model vary. The theory of mean field games, (MFGs for short), aims at studying deterministic or stochastic differential games (Nash equilibria) as the number of agents tends to infinity. It supposes that the rational agents are indistinguishable and individually have a negligible influence on the game, and that each individual strategy is influenced by some averages of quantities depending on the states (or the controls as in the present work) of the other agents. MFGs have been introduced in the pioneering works of J-M. Lasry and P-L. Lions [17, 18, 19]. Independently and at approximately the same time, the notion of mean field games arose in the engineering literature, see the works of M.Y. Huang, P.E. Caines and R.Malham{'e} [14, 15]. The present work deals with numerical approximations of mean field games in which the agents interact through both their states and controls; it follows a more theoretical work by the second author, [16], which is devoted to the mathematical analysis of the related systems of nonlocal partial differential equations. There is not much literature on MFGs in which the agents also interact through their controls, see [13, 12, 8, 10, 7, 16]. To stress the fact that the latter situation is considered, we will sometimes use the terminology mean field games of control and the acronym MFGC.
Full work available at URL: https://arxiv.org/abs/2003.03968
Recommendations
Numerical computation of solutions to systems of equations (65H10) Nonlinear parabolic equations (35K55) Fokker-Planck equations (35Q84) Finite difference methods for initial value and initial-boundary value problems involving PDEs (65M06) Optimal stochastic control (93E20) Computational methods for problems pertaining to game theory, economics, and finance (91-08) Mean field games and control (49N80) Mean field games (aspects of game theory) (91A16) PDEs in connection with mean field game theory (35Q89)
Cites Work
- Mean field games
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
- Finite difference methods for mean field games
- Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria
- Mean field games and mean field type control theory
- Mean field games: numerical methods
- Mean field games. I: The stationary case
- Mean field games. II: Finite horizon and optimal control
- Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems
- On the existence of classical solutions for stationary extended mean field games
- Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics
- A probabilistic weak formulation of mean field games and applications
- Extended mean field games
- Mean field games with congestion
- Mean Field Games for Modeling Crowd Motion
- Probabilistic theory of mean field games with applications I. Mean field FBSDEs, control, and games
- Schauder estimates for a class of potential mean field games of controls
- Mean field game of controls and an application to trade crowding
- On classical solutions to the mean field game system of controls
Cited In (27)
- Control and Nash Games with Mean Field Effect
- Ergodic behavior of control and mean field games problems depending on acceleration
- Mean field games of controls: propagation of monotonicities
- Discrete potential mean field games: duality and numerical resolution
- Learning Optimal Policies in Potential Mean Field Games: Smoothed Policy Iteration Algorithms
- Mean field games via controlled martingale problems: existence of Markovian equilibria
- Linear-quadratic mean field games of controls with non-monotone data
- A variational approach to first order kinetic mean field games with local couplings
- The finite difference approximation preserving conjugate properties of the mean-field game equations
- A Cucker-Smale inspired deterministic mean field game with velocity interactions
- Sensitivity of MFG SEIR-HCD epidemiological model
- A remark on Uzawa's algorithm and an application to mean field games systems
- Recent developments in machine learning methods for stochastic control and games
- Mean field games with monotonous interactions through the law of states and controls of the agents
- Multiple-population discrete-time mean field games with discounted and total payoffs: the existence of equilibria
- On classical solutions to the mean field game system of controls
- A Maximum Principle Approach to a Deterministic Mean Field Game of Control with Absorption
- A fictitious-play finite-difference method for linearly solvable mean field games
- Finite Difference Scheme for Stochastic Differential Games with Several Singular Control Variables and Its Environmental Application
- On numerical approximations of fractional and nonlocal mean field games
- Approximations of two-dimensional mean field games with nonsymmetric controls
- Mean field games and applications: numerical aspects
- Optimal control and zero-sum stochastic differential game problems of mean-field type
- Finite difference methods for mean field games systems
- Mean field games of controls: on the convergence of Nash equilibria
- Mean field type control with congestion. II: An augmented Lagrangian method
- Mean-field optimal control as Gamma-limit of finite agent controls
This page was built for publication: Mean field games of controls: finite difference approximations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2167461)
