HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
From MaRDI portal
Publication:3083249
Regularity of solutions in optimal control (49N60) Control problems for functional-differential equations (34K35) Optimality conditions for problems involving ordinary differential equations (49K15) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Optimal feedback synthesis (49N35)
Abstract: We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to build. We embed the problem in a suitable Hilbert space H and consider the associated Hamilton-Jacobi-Bellman (HJB) equation. This kind of infinite-dimensional HJB equation has not been previously studied and is difficult due to the presence of state constraints and the lack of smoothing properties of the state equation. Our main result on the regularity of solutions to such a HJB equation seems to be completely new. More precisely we prove that the value function is continuous in a sufficiently big open set of H , that it solves in the viscosity sense the associated HJB equation and it has continuous classical derivative in the direction of the present. This regularity result is the starting point to define a feedback map in classical sense, which gives rise to a candidate optimal feedback strategy for the problem. The study of verification theorems and of the closed loop equation will be the subject of a forthcoming paper.
Recommendations
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Dynamic programming for optimal control problems with delays in the control variable
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
Cited in
(29)- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- Optimal time-consistent investment-reinsurance strategy for state-dependent risk aversion with delay and common shocks
- Optimal controllability of manpower system with linear quadratic performance index
- State constrained control problems in Banach lattices and applications
- A stochastic control problem with delay arising in a pension fund model
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Mild solutions of semilinear elliptic equations in Hilbert spaces
- Path-dependent Hamilton-Jacobi equations in infinite dimensions
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Linear-quadratic mean field Stackelberg games with state and control delays
- Partial regularity of viscosity solutions for a class of Kolmogorov equations arising from mathematical finance
- Equilibrium investment-reinsurance strategy with delay and common shock dependence under Heston's SV model
- Optimal control for stochastic delay evolution equations
- An infinite-dimensional approach to path-dependent Kolmogorov equations
- Stochastic Control Problems with Unbounded Control Operators: Solutions Through Generalized Derivatives
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Viscosity solutions to second order elliptic Hamilton-Jacobi-Bellman equations with infinite delay
- An infinite time horizon portfolio optimization model with delays
- Infinite horizon stochastic maximum principle for stochastic delay evolution equations in Hilbert spaces
- Multiple solutions in systems of functional differential equations
- Optimal pollution control with distributed delays
- Dynamic programming for optimal control problems with delays in the control variable
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
- Minimax solutions of Hamilton-Jacobi equations in dynamic optimization problems for hereditary systems
- Optimal stopping of stochastic differential equations with delay driven by Lévy noise
- Crandall-Lions viscosity solutions for path-dependent PDEs: the case of heat equation
- Optimal control of stochastic delay differential equations: optimal feedback controls
- Finite-dimensional representations for controlled diffusions with delay
- When Are HJB-Equations in Stochastic Control of Delay Systems Finite Dimensional?
This page was built for publication: HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3083249)
