Coupling by reflection for controlled diffusion processes: turnpike property and large time behavior of Hamilton-Jacobi-Bellman equations

DOI10.1214/22-AAP1927arXiv2206.04009OpenAlexW4389342210MaRDI QIDQ6138919FDOQ6138919

Authors: Giovanni Conforti 

Publication date: 16 January 2024

Published in: The Annals of Applied Probability (Search for Journal in Brave)

Abstract: We investigate the long time behavior of weakly dissipative semilinear Hamilton-Jacobi-Bellman (HJB) equations and the turnpike property for the corresponding stochastic control problems. To this aim, we develop a probabilistic approach based on a variant of coupling by reflection adapted to the study of controlled diffusion processes. We prove existence and uniqueness of solutions for the ergodic Hamilton-Jacobi-Bellman equation and different kind of quantitative exponential convergence results at the level of the value function, of the optimal controls and of the optimal processes. Moreover, we provide uniform in time gradient and Hessian estimates for the solutions of the HJB equation that are of independent interest.

Full work available at URL: https://arxiv.org/abs/2206.04009

Recommendations

• The turnpike property and the longtime behavior of the Hamilton-Jacobi-Bellman equation for finite-dimensional LQ control problems
• Long time asymptotics for fully nonlinear Bellman equations: a backward SDE approach
• Large time behavior of solutions of Hamilton-Jacobi-Bellman equations with quadratic nonlinearity in gradients
• A dynamical approach to the large-time behavior of solutions to weakly coupled systems of Hamilton-Jacobi equations
• A probabilistic approach to large time behavior of mild solutions of HJB equations in infinite dimension

zbMATH Keywords

Hamilton-Jacobi equationsstochastic controlturnpike propertycoupling by reflection

Mathematics Subject Classification ID

Diffusion processes (60J60) Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Asymptotic behavior of solutions to PDEs (35B40) Optimal stochastic control (93E20)

Cites Work

• Long time average of mean field games
• Title not available (Why is that?)
• The turnpike property in finite-dimensional nonlinear optimal control
• Long time versus steady state optimal control
• Ergodic BSDEs and optimal ergodic control in Banach spaces
• Space-time periodic solutions and long-time behavior of solutions to quasi-linear parabolic equations
• Long time asymptotics for fully nonlinear Bellman equations: a backward SDE approach
• A probabilistic approach to large time behavior of mild solutions of HJB equations in infinite dimension
• On ergodic stochastic control
• Large time asymptotic problems for optimal stochastic control with superlinear cost
• Large time behavior of solutions of Hamilton-Jacobi-Bellman equations with quadratic nonlinearity in gradients
• Ergodic BSDEs under weak dissipative assumptions
• Coupling of multidimensional diffusions by reflection
• Coupling methods for multidimensional diffusion processes
• Reflection couplings and contraction rates for diffusions
• A survey of the Schrödinger problem and some of its connections with optimal transport
• Sur la convergence du semi-groupe de Lax-Oleinik
• Remarks on the long time behaviour of the solutions of hamilton-jacobi equations
• On the Large Time Behavior of Solutions of Hamilton--Jacobi Equations
• Global Lipschitz regularizing effects for linear and nonlinear parabolic equations
• Asymptotic Solutions of Viscous Hamilton–Jacobi Equations with Ornstein–Uhlenbeck Operator
• Approximation and regularization of Lipschitz functions: Convergence of the gradients
• Comportement asymptotique des solutions d'équations de Hamilton-Jacobi monodimensionnelles
• Turnpike Theorems for a Generalized Leontief Model
• Long time average of mean field games with a nonlocal coupling
• Couplings and quantitative contraction rates for Langevin dynamics
• The kinetic Fokker-Planck equation with mean field interaction
• Turnpike properties for stochastic linear-quadratic optimal control problems
• Long time behavior of the master equation in mean field game theory
• Hessian estimates for viscous Hamilton-Jacobi equations with the Ornstein-Uhlenbeck operator.
• Long time behavior and turnpike solutions in mildly non-monotone mean field games
• The mean field Schrödinger problem: ergodic behavior, entropy estimates and functional inequalities
• Sticky couplings of multidimensional diffusions with different drifts
• Ergodic BSDE with unbounded and multiplicative underlying diffusion and application to large time behaviour of viscosity solution of HJB equation
• The turnpike property and the longtime behavior of the Hamilton-Jacobi-Bellman equation for finite-dimensional LQ control problems
• The turnpike property in nonlinear optimal control -- a geometric approach
• Turnpike in Lipschitz-nonlinear optimal control
• Turnpike in optimal control of PDEs, ResNets, and beyond

Cited In (2)

• Weak semiconvexity estimates for Schrödinger potentials and logarithmic Sobolev inequality for Schrödinger bridges
• Time-uniform log-Sobolev inequalities and applications to propagation of chaos

This page was built for publication: Coupling by reflection for controlled diffusion processes: turnpike property and large time behavior of Hamilton-Jacobi-Bellman equations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6138919)