Numerical methods for mean-field type optimal control problems

MaRDI QIDQ2955422zbMATH OpenFDO

Authors Laurent Pfeiffer

Publication date 13 January 2017

Full work available at URL https://arxiv.org/abs/1703.10001, http://www.yokohamapublishers.jp/online2/oppafa/vol1/p629.html

zbMATH Keywords

gradient methodsoptimality conditionssemi-Lagrangian schemesmean-field type control

Mathematics Subject Classification ID

Stochastic programming (90C15) Optimal stochastic control (93E20)

Abstract: In this article, two methods for solving mean-field type optimal control problems are proposed and investigated. The two methods are iterative methods: at each iteration, a Hamilton-Jacobi-Bellman equation is solved, for a terminal condition obtained by linearizing the cost function. The terminal condition is updated by solving a Fokker-Planck equation. The first method can be seen as a gradient method and uses in an essential manner the convexity of the set of probability distributions. A convergence result for this method is provided. The second method incorporates a penalization term and provides feedback controls. We test the methods on four academic examples.

Recommendations

• Mean field games: numerical methods
• Dynamic programming for mean-field type control
• Mean field type control with congestion. II: An augmented Lagrangian method
• Mean field games: numerical methods for the planning problem
• A policy iteration method for mean field games

Cited in

(11)

• Optimality conditions in variational form for non-linear constrained stochastic control problems
• Convergence analysis of machine learning algorithms for the numerical solution of mean field control and games. II: The finite horizon case
• Mean field control hierarchy
• Convergence analysis of machine learning algorithms for the numerical solution of mean field control and games. I: The ergodic case
• A fast iterative PDE-based algorithm for feedback controls of nonsmooth mean-field control problems
• Numerical analysis for an optimal control of bidomain-bath model
• Numerical optimal control for problems with random forced SPDE constraints
• Numerical solution of mean field problem with limited management resource
• Dynamic programming for mean-field type control
• Fourier Galerkin approximation of mean field control problems
• Mean field type control with congestion. II: An augmented Lagrangian method

This page was built for publication: Numerical methods for mean-field type optimal control problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2955422)