Stochastic HJB equations and regular singular points

DOI10.1007/978-3-030-25498-8_15MaRDI QIDQ2337433zbMATH OpenOpenAlexFDO

Authors Arthur Krener

Publication date 20 November 2019

Full work available at URL https://arxiv.org/abs/1806.04120

zbMATH Keywords

infinite horizon problemsstochastic algebraic Riccati equationsstochastic optimal control

Mathematics Subject Classification ID

Stochastic partial differential equations (aspects of stochastic analysis) (60H15) Optimal stochastic control (93E20)

Abstract: IIn this paper we show that some HJB equations arising from both finite and infinite horizon stochastic optimal control problems have a regular singular point at the origin. This makes them amenable to solution by power series techniques. This extends the work of Al'brecht who showed that the HJB equations of an infinite horizon deterministic optimal control problem can have a regular singular point at the origin, Al'brekht solved the HJB equations by power series, degree by degree. In particular, we show that the infinite horizon stochastic optimal control problem with linear dynamics, quadratic cost and bilinear noise leads to a new type of algebraic Riccati equation which we call the Stochastic Algebraic Riccati Equation (SARE). If SARE can be solved then one has a complete solution to this infinite horizon stochastic optimal control problem. We also show that a finite horizon stochastic optimal control problem with linear dynamics, quadratic cost and bilinear noise leads to a Stochastic Differential Riccati Equation (SDRE) that is well known. If these problems are the linear-quadratic-bilinear part of a nonlinear finite horizon stochastic optimal control problem then we show how the higher degree terms of the solutions can be computed degree by degree. To our knowledge this computation is new.

Recommendations

• Infinite horizon and ergodic optimal quadratic control for an affine equation with stochastic coefficients
• Local solutions to the Hamilton-Jacobi-Bellman equation in stochastic problems of optimal control
• Stochastic singular optimal control problem with state delays: regularization, singular perturbation, and minimizing sequence
• scientific article; zbMATH DE number 4123658
• Some topics in stochastic control

Cited in

(1)

• Hogan–Weintraub singularity and explosive behaviour in the Black–Derman–Toy model

This page was built for publication: Stochastic HJB equations and regular singular points

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2337433)