Polynomial approximation of high-dimensional Hamilton-Jacobi-Bellman equations and applications to feedback control of semilinear parabolic PDEs
From MaRDI portal
Publication:4607635
Abstract: A procedure for the numerical approximation of high-dimensional Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control problems for semilinear parabolic equations is proposed. Its main ingredients are a pseudospectral collocation approximation of the PDE dynamics, and an iterative method for the nonlinear HJB equation associated to the feedback synthesis. The latter is known as the Successive Galerkin Approximation. It can also be interpreted as Newton iteration for the HJB equation. At every step, the associated linear Generalized HJB equation is approximated via a separable polynomial approximation ansatz. Stabilizing feedback controls are obtained from solutions to the HJB equations for systems of dimension up to fourteen.
Recommendations
- Tensor decomposition methods for high-dimensional Hamilton-Jacobi-Bellman equations
- On application of an alternating direction method to Hamilton--Jacobin--Bellman equations.
- Adaptive deep learning for high-dimensional Hamilton-Jacobi-Bellman equations
- Optimal feedback control for undamped wave equations by solving a HJB equation
- Suboptimal feedback control of PDEs by solving HJB equations on adaptive sparse grids
Cites work
- scientific article; zbMATH DE number 3128787 (Why is no real title available?)
- scientific article; zbMATH DE number 3148886 (Why is no real title available?)
- scientific article; zbMATH DE number 3168214 (Why is no real title available?)
- scientific article; zbMATH DE number 1147075 (Why is no real title available?)
- (Un)conditional consensus emergence under perturbed and decentralized feedback controls
- A continuous analogue of the tensor-train decomposition
- A generalization of Zubov's method to perturbed systems
- A pseudospectral method of solution of Fisher's equation
- Algorithms for Numerical Analysis in High Dimensions
- An adaptive POD approximation method for the control of advection-diffusion equations
- An adaptive sparse grid semi-Lagrangian scheme for first order Hamilton-Jacobi Bellman equations
- An efficient policy iteration algorithm for dynamic programming equations
- Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation
- Boundary feedback stabilization of the Schlögl system
- Feedback control methodologies for nonlinear systems
- Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
- HJB-POD-Based Feedback Design for the Optimal Control of Evolution Problems
- Hamilton-Jacobi equations in infinite dimensions. I: Uniqueness of viscosity solutions
- High-dimensional adaptive sparse polynomial interpolation and applications to parametric PDEs
- Mitigating the curse of dimensionality: sparse grid characteristics method for optimal feedback control and HJB equations
- Nonlinear feedback stabilization of a two-dimensional Burgers equation
- Numerical approximation of partial differential equations
- Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations
- Remarks on the internal exponential stabilization to a nonstationary solution for 1D Burgers equations
- Semi-Lagrangian approximation schemes for linear and Hamilton-Jacobi equations
- Some Convergence Results for Howard's Algorithm
- Sparse grids
- Sparse tensor Galerkin discretization of parametric and random parabolic PDEs---analytic regularity and generalized polynomial chaos approximation
- Sparse tensor discretizations of high-dimensional parametric and stochastic PDEs
- Stability Analysis of Discrete-Time Infinite-Horizon Optimal Control With Discounted Cost
- Stabilization of strictly dissipative discrete time systems with discounted optimal control
- Suboptimal feedback control for nonlinear systems
- Suboptimal feedback control of PDEs by solving HJB equations on adaptive sparse grids
Cited in
(44)- An iterative algorithm for POD basis adaptation in solving parametric convection-diffusion equations
- A new scalable algorithm for computational optimal control under uncertainty
- Error Estimates for a POD Method for Solving Viscous G-Equations in Incompressible Cellular Flows
- Error Estimates for a Tree Structure Algorithm Solving Finite Horizon Control Problems
- Numerical study of polynomial feedback laws for a bilinear control problem
- On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton-Jacobi partial differential equations
- Value-Gradient Based Formulation of Optimal Control Problem and Machine Learning Algorithm
- Semiglobal exponential stabilization of nonautonomous semilinear parabolic-like systems
- Hamilton-Jacobi-Bellman quasi-variational inequality arising in an environmental problem and its numerical discretization
- Robust Feedback Control of Nonlinear PDEs by Numerical Approximation of High-Dimensional Hamilton--Jacobi--Isaacs Equations
- An HJB-POD approach for the control of nonlinear PDEs on a tree structure
- Two-sided space-time \(L^1\) polynomial approximation of hypographs within polynomial optimal control
- Overcoming the curse of dimensionality for some Hamilton-Jacobi partial differential equations via neural network architectures
- A feedback design for numerical solution to optimal control problems based on Hamilton-Jacobi-Bellman equation
- A neural network-based policy iteration algorithm with global \(H^2\)-superlinear convergence for stochastic games on domains
- A tree structure approach to reachability analysis
- Approximating the stationary Bellman equation by hierarchical tensor products
- The nonlinear progressive accommodation: design and methodology
- Rectified deep neural networks overcome the curse of dimensionality for nonsmooth value functions in zero-sum games of nonlinear stiff systems
- Optimal feedback control for undamped wave equations by solving a HJB equation
- SympOCnet: Solving Optimal Control Problems with Applications to High-Dimensional Multiagent Path Planning Problems
- Pseudospectral methods for continuous-time heterogeneous-agent models
- Approximation of optimal control surfaces for \(2\times 2\) skew-symmetric evolutionary game dynamics
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- Numerical realization of the Mortensen observer via a Hessian-augmented polynomial approximation of the value function
- Policy Iterations on the Hamilton–Jacobi–Isaacs Equation for $H_{\infty}$ State Feedback Control With Input Saturation
- HJB-RBF based approach for the control of PDEs
- Lax-Oleinik-type formulas and efficient algorithms for certain high-dimensional optimal control problems
- Approximation of compositional functions with ReLU neural networks
- Adaptive deep learning for high-dimensional Hamilton-Jacobi-Bellman equations
- Suboptimal feedback control of PDEs by solving HJB equations on adaptive sparse grids
- Semiglobal optimal feedback stabilization of autonomous systems via deep neural network approximation
- An efficient DP algorithm on a tree-structure for finite horizon optimal control problems
- Actor-critic method for high dimensional static Hamilton-Jacobi-Bellman partial differential equations based on neural networks
- scientific article; zbMATH DE number 7370565 (Why is no real title available?)
- Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats
- Consistent smooth approximation of feedback laws for infinite horizon control problems with non-smooth value functions
- State-dependent Riccati equation feedback stabilization for nonlinear PDEs
- Optimal polynomial feedback laws for finite horizon control problems
- Mini-workshop: Analysis of data-driven optimal control. Abstracts from the mini-workshop held May 9--15, 2021 (hybrid meeting)
- Reduced-order finite element approximation based on POD for the parabolic optimal control problem
- Tensor decomposition methods for high-dimensional Hamilton-Jacobi-Bellman equations
- Feedback control of parametrized PDEs via model order reduction and dynamic programming principle
- Approximation of optimal feedback controls for stochastic reaction-diffusion equations
This page was built for publication: Polynomial approximation of high-dimensional Hamilton-Jacobi-Bellman equations and applications to feedback control of semilinear parabolic PDEs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4607635)
