Controller design and value function approximation for nonlinear dynamical systems
From MaRDI portal
Publication:259396
Abstract: This work considers the infinite-time discounted optimal control problem for continuous time input-affine polynomial dynamical systems subject to polynomial state and box input constraints. We propose a sequence of sum-of-squares (SOS) approximations of this problem obtained by first lifting the original problem into the space of measures with continuous densities and then restricting these densities to polynomials. These approximations are tightenings, rather than relaxations, of the original problem and provide a sequence of rational controllers with value functions associated to these controllers converging (under some technical assumptions) to the value function of the original problem. In addition, we describe a method to obtain polynomial approximations from above and from below to the value function of the extracted rational controllers, and a method to obtain approximations from below to the optimal value function of the original problem, thereby obtaining a sequence of asymptotically optimal rational controllers with explicit estimates of suboptimality. Numerical examples demonstrate the approach.
Recommendations
- Quadratic approximate dynamic programming for input-affine systems
- Value and Policy Function Approximations in Infinite-Horizon Optimization Problems
- Nonlinear Optimal Control via Occupation Measures and LMI-Relaxations
- Undiscounted control policy generation for continuous-valued optimal control by approximate dynamic programming
- Suboptimal solutions to dynamic optimization problems via approximations of the policy functions
Cites work
- scientific article; zbMATH DE number 5016447 (Why is no real title available?)
- scientific article; zbMATH DE number 3927757 (Why is no real title available?)
- scientific article; zbMATH DE number 4029251 (Why is no real title available?)
- scientific article; zbMATH DE number 527343 (Why is no real title available?)
- scientific article; zbMATH DE number 3283642 (Why is no real title available?)
- scientific article; zbMATH DE number 3400017 (Why is no real title available?)
- A New Look at Nonnegativity on Closed Sets and Polynomial Optimization
- A dual to Lyapunov's stability theorem
- Controller design and value function approximation for nonlinear dynamical systems
- Convex Computation of the Region of Attraction of Polynomial Control Systems
- Convex computation of the maximum controlled invariant set for polynomial control systems
- Density and cost in nonlinear control
- Existence, uniqueness, stability and differentiability properties of the flow associated to weakly differentiable vector fields
- Global optimization with polynomials and the problem of moments
- Linear programming approach to deterministic infinite horizon optimal control problems with discounting
- Nonlinear Control Synthesis by Convex Optimization
- Nonlinear Optimal Control via Occupation Measures and LMI-Relaxations
- Optimal Stabilization Using Lyapunov Measures
- Optimal control computation for nonlinear systems with state-dependent stopping criteria
- Strong duality conditions in semidefinite programming
- The Equivalence of Strong and Weak Formulations for Certain Problems in Optimal Control
- The flow associated to weakly differentiable vector fields
Cited in
(12)- Simultaneous stabilization of polynomial nonlinear systems via density functions
- Quadratic approximate dynamic programming for input-affine systems
- Nonlinear controller design: an iterative relaxation method
- Model reference control of non-linear systems via implicit function emulation
- Undiscounted control policy generation for continuous-valued optimal control by approximate dynamic programming
- Convex computation of extremal invariant measures of nonlinear dynamical systems and Markov processes
- Controller Design For Nonlinear Systems Based on Simultaneous Stabilization Theory and Describing Function Models
- Computable Primal and Dual Bounds for Stochastic Control
- Interval arithmetic techniques for the design of controllers for nonlinear dynamical systems with applications in mechatronics. II
- Controller design and value function approximation for nonlinear dynamical systems
- Performance enhancements for a generic conic interior point algorithm
- Bounding extreme events in nonlinear dynamics using convex optimization
This page was built for publication: Controller design and value function approximation for nonlinear dynamical systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q259396)