On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions (Q1780376)
From MaRDI portal
| This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use this page instead for the normal view: On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions |
scientific article; zbMATH DE number 2174293
| Language | Label | Description | Also known as |
|---|---|---|---|
| default for all languages | No label defined |
||
| English | On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions |
scientific article; zbMATH DE number 2174293 |
Statements
On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions (English)
0 references
7 June 2005
0 references
The author is concerned with the quadratic control problem to minimize the expected cost with discount factor \(\beta > 0\): \[ J(c)=E\left[\int_0^\infty e^{-\beta t}\{h(x_t) +| c_t| ^2\}\,dt\right] \] over \(c\in\mathcal A\) subject to the degenerate stochastic differential equation \[ dx_t = [Ax_t + c_t]\,dt + \sigma x_t\,dw_t,\quad x_0 = x\in\mathbb R,\quad t\geq 0, \] for non-zero constants \(A\), \(\sigma\neq 0\), and a continuous function \(h\) on \(\mathbb R\), where \(w_t\) is a one-dimensional standard Brownian motion on a complete probability space \((\Omega,\mathcal F, P)\) endowed with the natural filtration \(\mathcal F_t\) generated by \(\sigma(w_s, s\leq t)\), and \(\mathcal A\) denotes the class of all \(\mathcal F_t\)-progressively measurable processes \(c = (c_t)\) with \(J(c) < \infty\). It is assumed that \(h\) satisfies the following properties: \(h(x)\geq 0\) convex and there exists \(C>0\) such that \(h(x)\leq C(1 + | x| ^n)\), \(x\in\mathbb R\), \(n\geq2\). The purpose of this paper is to show the existence of a smooth solution \(u\) of the associated Hamilton-Jacobi-Bellman (in short, HJB) equation of the form: \[ -\beta u +\frac{1}{2}\sigma^2x^2u'' + Axu' + \min_{r\in\mathbb R}(r^2 + ru') + h(x) = 0\quad \text{in}\,\mathbb R,\tag{1} \] and to give a synthesis of optimal control. The author establishes the existence of a classical solution of the degenerate HJB equation (1) associated with this problem by the technique of viscosity solutions, and hence derives an optimal control from the optimality conditions in the HJB equation.
0 references
linear-quadratic regulator control problem
0 references
stochastic differential equation
0 references
Hamilton-Jacobi-Bellman equation
0 references
linear-quadratic problem
0 references
viscosity solutions
0 references
applications to control theory
0 references
0.9289208650588988
0 references
0.8985574841499329
0 references
0.8708835244178772
0 references
0.8239074945449829
0 references
0.8097862005233765
0 references