The Dual Dynamic Programming (Q4027748)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 126055
Language Label Description Also known as
default for all languages
No label defined
    English
    The Dual Dynamic Programming
    scientific article; zbMATH DE number 126055

      Statements

      1 March 1993
      0 references
      Bolza problem
      0 references
      dual dynamic programming
      0 references
      optimal control
      0 references
      The Dual Dynamic Programming (English)
      0 references
      The paper deals with the optimal control problem of Bolza: (1) minimize \(J(x,u)=\int^ b_ a L(t, x(t), u(t))dt+\ell(x(b))\) subject to (2) \(\dot x=f(t,x(t),u(t))\), (3) \(u(t)\in U(t)\), \(t\in [a,b)\), (4) \(x(a)=c\). In a previous paper by the same author this problem has been considered and two approaches for construction fields of extremals have been proposed. The first is the following: define the value function \(S(t,x)\) in a set \(T\in R^{n+1}\) as \[ S(t,x)=\inf\left\{\int^ b_ t L(\tau,x(\tau),u(\tau))d\tau+\ell(x(b))\right\}.\tag{5} \] If \(S(t,x)\) is differentiable then it satisfies the partial differential equation (6) \(S_ t(t,x)+H(t, x, S_ x(t,x))=0\), where \(H(t,x,y)=yf(t,x,u(t,x))+L(t,x,u(t,x))\), and the partial differential equation of dynamic programming (7) \(\min\bigl\{S_ t(t,x)+S_ x f(t,x,u)+L(t,x,u): u\in U(t)\bigr\}=0\). In the second method, another function is defined: \[ S_ D(t,p)=\inf\left\{-y^ 0 \int^ b_ t L(\tau,x(\tau),u(\tau))d\tau- y^ 0\ell(x(b))\right\}.\tag{8} \] Next, a new function is defined: \(V(t,p)=-S_ D(t,p)-x(t,p)y\), which satisfies the partial differential equation (9) \(V_ t(t,p)+H(t,-V_ y(t,p),p)=0\), where \(H(t,v,p)=y^ 0 L(t,v,u(t,p))+yf(t,v,u(t,p))\) and the dual partial differential equation \[ \max\bigl\{V_ t(t,p)+yf(t,-V_ y(t,p),u)+y^ 0 L(t,-V_ y(t,p),u): u\in U(t)\bigr\}=0.\tag{10} \] In the paper some properties of the value function \(S(t,x)\) are investigate by studying (8), (9), (10) directly. Several theorems are proved. An example is given.
      0 references

      Identifiers