HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
From MaRDI portal
(Redirected from Publication:3083249)
Control problems for functional-differential equations (34K35) Optimality conditions for problems involving ordinary differential equations (49K15) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Optimal feedback synthesis (49N35) Regularity of solutions in optimal control (49N60)
Abstract: We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to build. We embed the problem in a suitable Hilbert space H and consider the associated Hamilton-Jacobi-Bellman (HJB) equation. This kind of infinite-dimensional HJB equation has not been previously studied and is difficult due to the presence of state constraints and the lack of smoothing properties of the state equation. Our main result on the regularity of solutions to such a HJB equation seems to be completely new. More precisely we prove that the value function is continuous in a sufficiently big open set of H , that it solves in the viscosity sense the associated HJB equation and it has continuous classical derivative in the direction of the present. This regularity result is the starting point to define a feedback map in classical sense, which gives rise to a candidate optimal feedback strategy for the problem. The study of verification theorems and of the closed loop equation will be the subject of a forthcoming paper.
Recommendations
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Dynamic programming for optimal control problems with delays in the control variable
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
Cited in
(35)- Path-dependent Hamilton-Jacobi equations in infinite dimensions
- Infinite horizon stochastic maximum principle for stochastic delay evolution equations in Hilbert spaces
- Crandall-Lions viscosity solutions for path-dependent PDEs: the case of heat equation
- Finite-dimensional representations for controlled diffusions with delay
- Multiple solutions in systems of functional differential equations
- Optimal control for stochastic delay evolution equations
- An infinite-dimensional approach to path-dependent Kolmogorov equations
- HJB Equations for the Optimal Control of Differential Equations with Delays and State Constraints, II: Verification and Optimal Feedbacks
- An infinite time horizon portfolio optimization model with delays
- Optimal controllability of manpower system with linear quadratic performance index
- A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation
- Optimal pollution control with distributed delays
- When Are HJB-Equations in Stochastic Control of Delay Systems Finite Dimensional?
- A stochastic control problem with delay arising in a pension fund model
- State constrained control problems in Banach lattices and applications
- Equilibrium investment-reinsurance strategy with delay and common shock dependence under Heston's SV model
- Delay optimal control and viscosity solutions to associated Hamilton-Jacobi-Bellman equations
- Linear-quadratic mean field Stackelberg games with state and control delays
- Stochastic Optimal Control with Delay in the Control I: Solving the HJB Equation through Partial Smoothing
- Dynamic programming for optimal control problems with delays in the control variable
- Stochastic Control Problems with Unbounded Control Operators: Solutions Through Generalized Derivatives
- Optimal control of path-dependent McKean-Vlasov SDEs in infinite-dimension
- Optimal time-consistent investment-reinsurance strategy for state-dependent risk aversion with delay and common shocks
- Optimal stopping of stochastic differential equations with delay driven by Lévy noise
- Viscosity solutions to second order elliptic Hamilton-Jacobi-Bellman equations with infinite delay
- Minimax solutions of Hamilton-Jacobi equations in dynamic optimization problems for hereditary systems
- Optimal control of stochastic delay differential equations: optimal feedback controls
- Optimal control using IsoCost-based dynamic programming
- Deep-control of memory via stochastic optimal control and deep learning
- Control problems for fractional-order systems: formalism of Hamilton-Jacobi equations and methods for constructing optimal feedback strategies
- Stochastic optimal control problems with delays in the state and in the control via viscosity solutions and applications to optimal advertising and optimal investment problems
- Stochastic optimal control in Hilbert spaces: \(C^{1,1}\) regularity of the value function and optimal synthesis via viscosity solutions
- Optimal control in infinite-dimensional spaces and economic modeling: state of the art and perspectives
- Partial regularity of viscosity solutions for a class of Kolmogorov equations arising from mathematical finance
- Mild solutions of semilinear elliptic equations in Hilbert spaces
This page was built for publication: HJB equations for the optimal control of differential equations with delays and state constraints. I: Regularity of viscosity solutions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3083249)
