Extended Hamilton--Jacobi Characterization of Value Functions in Optimal Control

From MaRDI portal





In the first place the author introduces yet another type of ``generalized viscosity solution [e.g., \textit{M. Bardi} and \textit{I. Capuzzo-Dolcetta}, ``Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations (1997; Zbl 0890.49011)] using the ``outer limit \[ \partial f(x):=\{p\in R^n; \;\exists \;x_m \to x, \;p_m\in \widehat \partial f(x_m): \;p_m\to p\} \] of the (Fréchet/contingent) subdifferential: \[ \widehat \partial f(x)=D^-f(x):= \Biggl\{p\in R^n; \liminf_{y\to x} {{f(y)-f(x)-\langle p,y-x\rangle}\over {\|y-x\|}}\geq 0 \Biggr\}. \] According to author's Def.1.2, a real function \(u(.,.)\) is said to be a ``solution (actually a ``strict viscosity supersolution) of the Hamilton-Jacobi (HJ) equation: \[ u_t(t,x)+H(t,x,u_x(t,x))=0 \;\forall \;(t,x)\in (0,\infty)\times R^n, \;u(0,x)\equiv \varphi (x) \;(x \in R^n) \] if it is proper, l.s.c., \(u(0,\xi) \equiv \varphi (\xi)\) and at each point \((t,x)\in \text{dom} (u(.,.))\subset [0,\infty)\times R^n\) satisfies the differential relations: \[ p_0 +H(t,x,p)=0 \;\forall \;(p_0,p)\in \partial u(t,x), \;t>0; \;p_0 + H(0,x, p)\leq 0 \;\forall \;(p_0,p)\in \partial u(0,x), \;x\in R^n. \] The main result of the paper is Theorem 2.2 stating that under certain fairly mild hypotheses on the data \(\varphi (.)\) and \( H(.,.,.)\), if \(L(.,.,.)\) and \(\Gamma(.)\) are the associated ``Lagrangean and, respectively, the ``cost functional: \[ L(t,x,v)= \sup_{p\in R^n}[\langle p,v\rangle- H(t,x,p)], \;\Gamma(x(.)):= \varphi (x(0))+\int_0^\tau L(t,x(t),x'(t)) dt, \] then the value function: \[ V(\tau,\xi):= \begin{cases} \inf\{\Gamma(x(.)); \;x(.)\in AC, \;x(\tau)=\xi \} \quad \text{if}\quad \tau >0 \\ \varphi (\xi) \quad \text{if}\quad \tau =0, \\ +\infty \quad \text{if}\quad \tau <0 \end{cases}. \] is the unique solution (in the sense above) of the (HJ) equation in the class of proper l.s.c. functions \(u(.,.)\) that have the following ULLG (uniform lower linear growth) property: for each \(T>0\) there exists \(k>0\) such that: \[ u(t,x)\geq -k(1+\|x\|) \;\forall \;(t,x)\in [-T,T]\times R^n. \] The proof of the main result is rather complicated and it is based on some 14 auxiliary results concerning a large number of topics such as: viability, invariance, monotonicity, existence of optimal trajectories, necessary optimality conditions, reachable sets, etc.




Cited in
(18)








This page was built for publication: Extended Hamilton--Jacobi Characterization of Value Functions in Optimal Control

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4507456)