HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
From MaRDI portal
Publication:3083249
DOI10.1137/09076742XzbMATH Open1208.49048arXiv0905.1825OpenAlexW1984960279MaRDI QIDQ3083249FDOQ3083249
Authors: Salvatore Federico, B. Goldys, Fausto Gozzi 
Publication date: 21 March 2011
Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)
Abstract: We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to build. We embed the problem in a suitable Hilbert space H and consider the associated Hamilton-Jacobi-Bellman (HJB) equation. This kind of infinite-dimensional HJB equation has not been previously studied and is difficult due to the presence of state constraints and the lack of smoothing properties of the state equation. Our main result on the regularity of solutions to such a HJB equation seems to be completely new. More precisely we prove that the value function is continuous in a sufficiently big open set of H , that it solves in the viscosity sense the associated HJB equation and it has continuous classical derivative in the direction of the present. This regularity result is the starting point to define a feedback map in classical sense, which gives rise to a candidate optimal feedback strategy for the problem. The study of verification theorems and of the closed loop equation will be the subject of a forthcoming paper.
Full work available at URL: https://arxiv.org/abs/0905.1825
Recommendations
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Dynamic programming for optimal control problems with delays in the control variable
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
Regularity of solutions in optimal control (49N60) Control problems for functional-differential equations (34K35) Optimality conditions for problems involving ordinary differential equations (49K15) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Optimal feedback synthesis (49N35)
Cited In (29)
- Optimal time-consistent investment-reinsurance strategy for state-dependent risk aversion with delay and common shocks
- Optimal controllability of manpower system with linear quadratic performance index
- A stochastic control problem with delay arising in a pension fund model
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Mild solutions of semilinear elliptic equations in Hilbert spaces
- Path-dependent Hamilton-Jacobi equations in infinite dimensions
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Linear-quadratic mean field Stackelberg games with state and control delays
- Equilibrium investment-reinsurance strategy with delay and common shock dependence under Heston's SV model
- Partial regularity of viscosity solutions for a class of Kolmogorov equations arising from mathematical finance
- Stochastic Control Problems with Unbounded Control Operators: Solutions Through Generalized Derivatives
- Optimal control for stochastic delay evolution equations
- An infinite-dimensional approach to path-dependent Kolmogorov equations
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Viscosity solutions to second order elliptic Hamilton-Jacobi-Bellman equations with infinite delay
- An infinite time horizon portfolio optimization model with delays
- Multiple solutions in systems of functional differential equations
- Infinite horizon stochastic maximum principle for stochastic delay evolution equations in Hilbert spaces
- Dynamic programming for optimal control problems with delays in the control variable
- Optimal pollution control with distributed delays
- State Constrained Control Problems in Banach Lattices and Applications
- Minimax solutions of Hamilton-Jacobi equations in dynamic optimization problems for hereditary systems
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
- Optimal stopping of stochastic differential equations with delay driven by Lévy noise
- Crandall-Lions viscosity solutions for path-dependent PDEs: the case of heat equation
- Optimal control of stochastic delay differential equations: optimal feedback controls
- Finite-dimensional representations for controlled diffusions with delay
- When Are HJB-Equations in Stochastic Control of Delay Systems Finite Dimensional?
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
This page was built for publication: HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3083249)
