An adaptive Polyak heavy-ball method
From MaRDI portal
Publication:2102380
Recommendations
- Stochastic heavy ball
- On the convergence analysis of aggregated heavy-ball method
- A robust control approach to asymptotic optimality of the heavy ball method for optimization of quadratic functions
- Convergence rates of the heavy ball method for quasi-strongly convex optimization
- Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition
Cites work
- A literature survey of benchmark functions for global optimisation problems
- A New Class of Incremental Gradient Methods for Least Squares Problems
- A Stochastic Approximation Method
- Accelerated gradient methods for nonconvex nonlinear and stochastic programming
- Adaptive subgradient methods for online learning and stochastic optimization
- An accelerated randomized proximal coordinate gradient method and its application to regularized empirical risk minimization
- Analysis and design of optimization algorithms via integral quadratic constraints
- Automated adaptation strategies for stream learning
- First-order methods in optimization
- Heavy-ball method in nonconvex optimization problems
- scientific article; zbMATH DE number 7306906 (Why is no real title available?)
- ImageNet
- Introductory lectures on convex optimization. A basic course.
- iPiano: inertial proximal algorithm for nonconvex optimization
- iPiasco: inertial proximal algorithm for strongly convex optimization
- Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods
- Some methods of speeding up the convergence of iteration methods
- Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming
- Stochastic gradient descent with Polyak's learning rate
- Stochastic heavy ball
- Tunability: importance of hyperparameters of machine learning algorithms
Cited in
(9)- Non-monotone Behavior of the Heavy Ball Method
- Stochastic momentum methods for non-convex learning without bounded assumptions
- A multivariate adaptive gradient algorithm with reduced tuning efforts
- On adaptive stochastic heavy ball momentum for solving linear systems
- A globally convergent gradient method with momentum
- Convergence of Adam for non-convex objectives: relaxed hyperparameters and non-ergodic case
- An adaptive momentum-accelerated two-point gradient method for solving ill-posed inverse problems
- Application of Runge-Kutta method with non-standard finite difference for the construction of preconditioned gradient methods
- Efficient globalization of heavy-ball type methods for unconstrained optimization based on curve searches
Describes a project that uses
Uses Software
This page was built for publication: An adaptive Polyak heavy-ball method
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2102380)
