Symplectic Runge-Kutta discretization of a regularized forward-backward sweep iteration for optimal control problems
From MaRDI portal
Publication:2199787
Discretization methods and integrators (symplectic, variational, geometric, etc.) for dynamical systems (37M15) Optimality conditions for problems involving ordinary differential equations (49K15) Numerical methods of relaxation type (49M20) Multistep, Runge-Kutta and extrapolation methods for ordinary differential equations (65L06)
Abstract: Li, Chen, Tai & E. (J. Machine Learning Research, 2018) have proposed a regularization of the forward-backward sweep iteration for solving the Pontryagin maximum principle in optimal control problems. The authors prove the global convergence of the iteration in the continuous time case. In this article we show that their proof can be extended to the case of numerical discretization by symplectic Runge-Kutta pairs. We demonstrate the convergence with a simple numerical experiment.
Recommendations
- The regularized iterative Pontryagin maximum principle in optimal control. I: Optimization of a lumped system.
- scientific article; zbMATH DE number 1664845
- An improved symplectic method for solving optimal control problems
- Convergence of the forward-backward sweep method in optimal control
- Convergence results for smooth regularizations of hybrid nonlinear optimal control problems
Cites work
- Anderson acceleration for fixed-point iterations
- Convergence of the forward-backward sweep method in optimal control
- Damped Anderson Acceleration With Restarts and Monotonicity Control for Accelerating EM and EM-like Algorithms
- Data Assimilation for Linear Parabolic Equations: Minimax Projection Method
- Discrete mechanics and variational integrators
- Dynamic programming and optimal control. Vol. 1.
- Fundamentals of stochastic filtering
- Geometric Numerical Integration
- scientific article; zbMATH DE number 702482 (Why is no real title available?)
- scientific article; zbMATH DE number 940566 (Why is no real title available?)
- Maximum principle based algorithms for deep learning
- Probabilistic theory of mean field games with applications I. Mean field FBSDEs, control, and games
- Reinforcement learning. An introduction
- Runge-Kutta methods in optimal control and the transformed adjoint system
- Solving Ordinary Differential Equations I
- Symplectic integration of boundary value problems
- Symplectic Runge-Kutta schemes for adjoint equations, automatic differentiation, optimal control, and more
Cited in
(15)- A sequential quadratic Hamiltonian algorithm for training explicit RK neural networks
- Discrete LQR and ILQR methods based on high order Runge-Kutta discretizations
- Discrete adjoint implicit peer methods in optimal control
- scientific article; zbMATH DE number 5217550 (Why is no real title available?)
- A viscoelastic model with non-local damping application to the human lungs
- Explicit Stabilized Integrators for Stiff Optimal Control Problems
- A warm-started trajectory planner for fixed-wing unmanned aerial vehicle formation
- Efficient low rank approximations for parabolic control problems with unknown heat source
- Implicit peer triplets in gradient-based solution algorithms for ODE constrained optimal control
- Variable-stepsize implicit peer triplets in ODE constrained optimal control
- On the convergence of conjugate gradient and GMRES algorithms in the forward backward sweep method for optimal control
- A closed-loop symplectic regularized algorithm for constrained time-varying optimal control
- Convergence of the forward-backward sweep method in optimal control
- Coupling dynamic characteristics of simplified model for tethered satellite system
- A symplectic Newton interior-point algorithm for constrained time-optimal control
This page was built for publication: Symplectic Runge-Kutta discretization of a regularized forward-backward sweep iteration for optimal control problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2199787)