A stochastic maximum principle for partially observed general mean-field control problems with only weak solution

DOI10.1016/J.SPA.2023.08.005MaRDI QIDQ6056576zbMATH OpenFDO

Authors Juan Li, Hao Liang, Chao Mi

Publication date 30 October 2023

Published in Stochastic Processes and their Applications (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2109.12316

zbMATH Keywords

derivative with respect to the densitiesmaximum principlemean-field SDEspartial observationstochastic controlweak solution

Mathematics Subject Classification ID

Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Optimal stochastic control (93E20)

Abstract: In this paper we focus on a general type of mean-field stochastic control problem with partial observation, in which the coefficients depend in a non-linear way not only on the state process $X_t$ and its control $u_t$ but also on the conditional law $E[X_t|mathcal{F}_t^Y]$ of the state process conditioned with respect to the past of observation process $Y$. We first deduce the well-posedness of the controlled system by showing weak existence and uniqueness in law. Neither supposing convexity of the control state space nor differentiability of the coefficients with respect to the control variable, we study Peng's stochastic maximum principle for our control problem. The novelty and the difficulty of our work stem from the fact that, given an admissible control $u$, the solution of the associated control problem is only a weak one. This has as consequence that also the probability measure in the solution $P^u=L_T^{u}Q$ depends on $u$ and has a density $L_T^u$ with respect to a reference measure $Q$. So characterizing an optimal control leads to the differentiation of non-linear functions $f(P^{u}circ{E^{P^u}[X_t|mathcal{F}_t^Y]}^{-1})$ with respect to $(L_T^u,X_t)$. This has as consequence for the study of Peng's maximum principle that we get a new type of first and second order variational equations and adjoint backward stochastic differential equations, all with new mean-field terms and with coefficients which are not Lipschitz. For their estimates and for those for the Taylor expansion new techniques have had to be introduced and rather technical results have had to be established. The necessary optimality condition we get extends Peng's one with new, non-trivial terms.

Recommendations

• A mean-field stochastic control problem with partial observations
• The maximum principle for partially observed optimal control problems of mean-field FBSDEs
• Stochastic maximum principle for partially observed optimal control problems of general McKean-Vlasov differential equations
• Extended mean-field control problem with partial observation
• A stochastic maximum principle for general mean-field systems

Cites work

• A General Stochastic Maximum Principle for Optimal Control Problems
• A general stochastic maximum principle for SDEs of mean-field type
• A mean-field stochastic control problem with partial observations
• A probabilistic approach to mean field games with major and minor players
• An Introductory Approach to Duality in Optimal Stochastic Control
• Control of McKean-Vlasov dynamics versus mean field games
• scientific article; zbMATH DE number 3780265 (Why is no real title available?)
• scientific article; zbMATH DE number 3999814 (Why is no real title available?)
• Mean field games
• Mean-field backward stochastic differential equations and related partial differential equations
• Mean-field backward stochastic differential equations: A limit approach
• Necessary Conditions for Continuous Parameter Stochastic Optimization Problems
• On the stochastic maximum principle. Fixed time of control
• Partial derivative with respect to the measure and its application to general controlled mean-field systems
• Probabilistic analysis of mean-field games
• The Malliavin Calculus and Related Topics
• Weak solutions of mean-field stochastic differential equations and application to zero-sum stochastic differential games

This page was built for publication: A stochastic maximum principle for partially observed general mean-field control problems with only weak solution

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6056576)