Linearly solvable stochastic control Lyapunov functions
From MaRDI portal
(Redirected from Linearly solvable stochastic control Lyapunov functions)
Abstract: This paper presents a new method for synthesizing stochastic control Lyapunov functions for a class of nonlinear stochastic control systems. The technique relies on a transformation of the classical nonlinear Hamilton-Jacobi-Bellman partial differential equation to a linear partial differential equation for a class of problems with a particular constraint on the stochastic forcing. This linear partial differential equation can then be relaxed to a linear differential inclusion, allowing for relaxed solutions to be generated using sum of squares programming. The resulting relaxed solutions are in fact viscosity super/subsolutions, and by the maximum principle are pointwise upper and lower bounds to the underlying value function, even for coarse polynomial approximations. Furthermore, the pointwise upper bound is shown to be a stochastic control Lyapunov function, yielding a method for generating nonlinear controllers with pointwise bounded distance from the optimal cost when using the optimal controller. These approximate solutions may be computed with non-increasing error via a hierarchy of semidefinite optimization problems. Finally, this paper develops a-priori bounds on trajectory suboptimality when using these approximate value functions, as well as demonstrates that these methods, and bounds, can be applied to a more general class of nonlinear systems not obeying the constraint on stochastic forcing. Simulated examples illustrate the methodology.
Recommendations
- Stochastic nonlinear stabilization. II: Inverse optimality
- Nonlinear-nonquadratic optimal and inverse optimal control for stochastic dynamical systems
- Stabilization of a class of nonlinear stochastic systems
- An approach to \(H _{\infty }\) control of a class of nonlinear stochastic systems
- Performance bounds for linear stochastic control
Cites work
- A Lyapunov-Like Characterization of Asymptotic Controllability
- A new energy characterization of the smallest eigenvalue of the schrödinger equation
- A stochastic control approach to reciprocal diffusion processes
- Adaptive nonlinear control without overparametrization
- Analysis of Non-polynomial Systems Using the Sum of Squares Decomposition
- Controlled Markov processes and viscosity solutions
- Efficient computation of optimal actions
- Feedback Stabilization of Affine in the Control Stochastic Differential Systems by the Control Lyapunov Function Method
- Global optimization with polynomials and the problem of moments
- scientific article; zbMATH DE number 3792086 (Why is no real title available?)
- scientific article; zbMATH DE number 1489799 (Why is no real title available?)
- scientific article; zbMATH DE number 3238721 (Why is no real title available?)
- Nonlinear Optimal Control via Occupation Measures and LMI-Relaxations
- Path integrals and symmetry breaking for optimal control theory
- Relative entropy and efficiency measure for diffusion-mediated transport processes
- Robust and adaptive control. With aerospace applications.
- Semidefinite programming relaxations for semialgebraic problems
- Stability of regime-switching stochastic differential equations
- Stochastic nonlinear stabilization. I: A backstepping design
- User’s guide to viscosity solutions of second order partial differential equations
Cited in
(4)- Performance bounds for linear stochastic control
- Lyapunov function computation for autonomous linear stochastic differential equations using sum-of-squares programming
- A novel stochastic locally transversal linearization (LTL) technique for engineering dynamical systems: strong solutions
- Moving least-squares approximations for linearly-solvable stochastic optimal control problems
This page was built for publication: Linearly solvable stochastic control Lyapunov functions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5298487)
