Bellman function in stochastic control and harmonic analysis

From MaRDI portal





In the first section entitled ``Bellman equation for stochastic optimal control, the authors state that the goal of this paper is methodological. They want to consider the equation of stochastic processes in the concept of Bellman function. See the authors' paper [J. Am. Math. Soc. 12, No. 4, 909-928 (1999; Zbl 0951.42007)] and \textit{F. L. Nazarov} and \textit{S. P. Treil'} [St. Petersbg. Math. J. 8, No. 5, 721-824 (1997); translation from Algebra Anal. 8, No. 5, 32-132 (1996; Zbl 0873.42011)]. The authors want also to connect the ideas behind the construction of Burkholder's function \(b(x,y)= (|x|+ (p-1)|y|+|y|^{p-1}\) to the concept of the Bellman equation. For general stochastic processes see the book of \textit{N. V. Krylov} [``Controlled diffusion processes (1980; Zbl 0459.93002)]. Let \(x^t\) be a stochastic process in \(\mathbb{R}^d\), satisfying the integral equation \[ x^t= x+\int^t_0 \sigma(\alpha^s, x^s) dw^s+ \int^t_0 b(\alpha^s, x^s) ds.\tag{1} \] The choice of the stochastic process \(\alpha^s\) gives different ``motions-different solutions of (1). The problem on existence and uniqueness of the solution exists and is unique. The optimal average gain is what is called the Bellman function for stochastic control: \(v(x)= \sup_\alpha v^\alpha(x)\). The deduction of the Bellman equation for the stochastic optimal control is based on two things: Bellman's principle, Itô's formula. Section 2 is devoted to the harmonic analysis Bellman function and Section 3 treats new creatures from Bellman's zoo. In Section 4 the authors study the Burkholder meets Bellman and consider the Bellman equation for Burkholder's theorem. The conclusions of the paper are very interesting. For the entire collection see [Zbl 0972.00051].




Cited in
(56)








This page was built for publication: Bellman function in stochastic control and harmonic analysis

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4534560)