Controller design and value function approximation for nonlinear dynamical systems
From MaRDI portal
Publication:259396
DOI10.1016/J.AUTOMATICA.2016.01.022zbMATH Open1335.49050arXiv1503.06650OpenAlexW1803866159MaRDI QIDQ259396FDOQ259396
Milan Korda, Colin N. Jones, Didier Henrion
Publication date: 11 March 2016
Published in: Automatica (Search for Journal in Brave)
Abstract: This work considers the infinite-time discounted optimal control problem for continuous time input-affine polynomial dynamical systems subject to polynomial state and box input constraints. We propose a sequence of sum-of-squares (SOS) approximations of this problem obtained by first lifting the original problem into the space of measures with continuous densities and then restricting these densities to polynomials. These approximations are tightenings, rather than relaxations, of the original problem and provide a sequence of rational controllers with value functions associated to these controllers converging (under some technical assumptions) to the value function of the original problem. In addition, we describe a method to obtain polynomial approximations from above and from below to the value function of the extracted rational controllers, and a method to obtain approximations from below to the optimal value function of the original problem, thereby obtaining a sequence of asymptotically optimal rational controllers with explicit estimates of suboptimality. Numerical examples demonstrate the approach.
Full work available at URL: https://arxiv.org/abs/1503.06650
semidefinite programmingnonlinear controloccupation measuresoptimal controlsum-of-squaresvalue function approximation
Cites Work
- Global optimization with polynomials and the problem of moments
- Title not available (Why is that?)
- Linear Programming Approach to Deterministic Infinite Horizon Optimal Control Problems with Discounting
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Optimal control computation for nonlinear systems with state-dependent stopping criteria
- Density and cost in nonlinear control
- Controller design and value function approximation for nonlinear dynamical systems
- Optimal Stabilization Using Lyapunov Measures
- Convex Computation of the Region of Attraction of Polynomial Control Systems
- A New Look at Nonnegativity on Closed Sets and Polynomial Optimization
- Title not available (Why is that?)
- Title not available (Why is that?)
- The Equivalence of Strong and Weak Formulations for Certain Problems in Optimal Control
- Title not available (Why is that?)
- Convex Computation of the Maximum Controlled Invariant Set For Polynomial Control Systems
- Nonlinear Control Synthesis by Convex Optimization
- Nonlinear Optimal Control via Occupation Measures and LMI-Relaxations
- Title not available (Why is that?)
- Title not available (Why is that?)
- A dual to Lyapunov's stability theorem
Cited In (10)
- Controller design and value function approximation for nonlinear dynamical systems
- Nonlinear controller design: an iterative relaxation method
- Interval arithmetic techniques for the design of controllers for nonlinear dynamical systems with applications in mechatronics. II
- Bounding Extreme Events in Nonlinear Dynamics Using Convex Optimization
- Convex computation of extremal invariant measures of nonlinear dynamical systems and Markov processes
- Performance enhancements for a generic conic interior point algorithm
- Model reference control of non-linear systems via implicit function emulation
- Computable Primal and Dual Bounds for Stochastic Control
- Simultaneous stabilization of polynomial nonlinear systems via density functions
- Controller Design For Nonlinear Systems Based on Simultaneous Stabilization Theory and Describing Function Models
Uses Software
This page was built for publication: Controller design and value function approximation for nonlinear dynamical systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q259396)