HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
From MaRDI portal
Publication:3083249
Regularity of solutions in optimal control (49N60) Control problems for functional-differential equations (34K35) Optimality conditions for problems involving ordinary differential equations (49K15) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Optimal feedback synthesis (49N35)
Abstract: We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to build. We embed the problem in a suitable Hilbert space H and consider the associated Hamilton-Jacobi-Bellman (HJB) equation. This kind of infinite-dimensional HJB equation has not been previously studied and is difficult due to the presence of state constraints and the lack of smoothing properties of the state equation. Our main result on the regularity of solutions to such a HJB equation seems to be completely new. More precisely we prove that the value function is continuous in a sufficiently big open set of H , that it solves in the viscosity sense the associated HJB equation and it has continuous classical derivative in the direction of the present. This regularity result is the starting point to define a feedback map in classical sense, which gives rise to a candidate optimal feedback strategy for the problem. The study of verification theorems and of the closed loop equation will be the subject of a forthcoming paper.
Recommendations
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Dynamic programming for optimal control problems with delays in the control variable
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
Cited in
(29)- Viscosity solutions to second order elliptic Hamilton-Jacobi-Bellman equations with infinite delay
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- Linear-quadratic mean field Stackelberg games with state and control delays
- Equilibrium investment-reinsurance strategy with delay and common shock dependence under Heston's SV model
- Optimal time-consistent investment-reinsurance strategy for state-dependent risk aversion with delay and common shocks
- Path-dependent Hamilton-Jacobi equations in infinite dimensions
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- A stochastic control problem with delay arising in a pension fund model
- Optimal controllability of manpower system with linear quadratic performance index
- Optimal stopping of stochastic differential equations with delay driven by Lévy noise
- Partial regularity of viscosity solutions for a class of Kolmogorov equations arising from mathematical finance
- Stochastic Control Problems with Unbounded Control Operators: Solutions Through Generalized Derivatives
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Crandall-Lions viscosity solutions for path-dependent PDEs: the case of heat equation
- Minimax solutions of Hamilton-Jacobi equations in dynamic optimization problems for hereditary systems
- Optimal control for stochastic delay evolution equations
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
- An infinite-dimensional approach to path-dependent Kolmogorov equations
- Dynamic programming for optimal control problems with delays in the control variable
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- An infinite time horizon portfolio optimization model with delays
- Finite-dimensional representations for controlled diffusions with delay
- State constrained control problems in Banach lattices and applications
- Multiple solutions in systems of functional differential equations
- When Are HJB-Equations in Stochastic Control of Delay Systems Finite Dimensional?
- Optimal pollution control with distributed delays
- Infinite horizon stochastic maximum principle for stochastic delay evolution equations in Hilbert spaces
- Optimal control of stochastic delay differential equations: optimal feedback controls
- Mild solutions of semilinear elliptic equations in Hilbert spaces
This page was built for publication: HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3083249)
