Optimization with momentum: dynamical, control-theoretic, and symplectic perspectives
From MaRDI portal
Publication:4998976
Recommendations
- Generalized momentum-based methods: a Hamiltonian perspective
- Conformal symplectic and relativistic optimization
- A Lyapunov analysis of accelerated methods in optimization
- The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems
- On dissipative symplectic integration with applications to gradient-based optimization
Cites work
- A differential equation for modeling Nesterov's accelerated gradient method: theory and insights
- A trust region algorithm with a worst-case iteration complexity of \(\mathcal{O}(\epsilon ^{-3/2})\) for nonconvex optimization
- A variational perspective on accelerated methods in optimization
- Analysis and design of optimization algorithms via integral quadratic constraints
- Asymptotic analysis of differential equations
- Cubic regularization of Newton method and its global performance
- Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
- scientific article; zbMATH DE number 3850830 (Why is no real title available?)
- scientific article; zbMATH DE number 48893 (Why is no real title available?)
- scientific article; zbMATH DE number 53382 (Why is no real title available?)
- scientific article; zbMATH DE number 88931 (Why is no real title available?)
- scientific article; zbMATH DE number 193048 (Why is no real title available?)
- scientific article; zbMATH DE number 3539473 (Why is no real title available?)
- scientific article; zbMATH DE number 1745051 (Why is no real title available?)
- scientific article; zbMATH DE number 2171469 (Why is no real title available?)
- scientific article; zbMATH DE number 1418991 (Why is no real title available?)
- Introductory lectures on convex optimization. A basic course.
- Morse Theory. (AM-51)
- Nonlinear systems. Analysis, stability, and control
- Some methods of speeding up the convergence of iteration methods
- Stochastic heavy ball
- The approximate duality gap technique: a unified theory of first-order methods
Cited in
(18)- How does momentum benefit deep neural networks architecture design? A few case studies
- A control-theoretic perspective on optimal high-order optimization
- Continuous time analysis of momentum methods
- A Lyapunov analysis of accelerated methods in optimization
- DYNAMICAL, SYMPLECTIC AND STOCHASTIC PERSPECTIVES ON GRADIENT-BASED OPTIMIZATION
- Fast optimization via inertial dynamics with closed-loop damping
- Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectives
- Self-consistent dynamical field theory of kernel evolution in wide neural networks
- Decentralized concurrent learning with coordinated momentum and restart
- Accelerated optimization landscape of linear-quadratic regulator
- Accelerated first-order optimization under nonlinear constraints
- An accelerated Lyapunov function for Polyak's heavy-ball on convex quadratics
- Accelerating optimization over the space of probability measures
- On the connections between optimization algorithms, Lyapunov functions, and differential equations: theory and insights
- A continuous-time perspective on global acceleration for monotone equation problems
- Riemannian acceleration with preconditioning for symmetric eigenvalue problems
- EPIC: a provable accelerated eigensolver based on preconditioning and implicit convexity
- Analysis of linear-quadratic optimal control via a hybrid control lens
This page was built for publication: Optimization with momentum: dynamical, control-theoretic, and symplectic perspectives
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4998976)
