Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods (Q2023684): Difference between revisions

@@ Property / arXiv ID @@
+.09677
@@ Property / arXiv ID: 1712.09677 / rank @@
+Normal rank
@@ Property / cites work @@
+Katyusha: the first direct acceleration of stochastic gradient methods
+Normal rank
@@ Property / cites work @@
+A Convergent Incremental Gradient Method with a Constant Step Size
+Normal rank
@@ Property / cites work @@
+Q3546603
@@ Property / cites work: Q3546603 / rank @@
+Normal rank
@@ Property / cites work @@
+Q5432585
@@ Property / cites work: Q5432585 / rank @@
+Normal rank
@@ Property / cites work @@
+Stochastic Primal-Dual Hybrid Gradient Algorithm with Arbitrary Sampling and Imaging Applications
+Normal rank
@@ Property / cites work @@
+Old and new results on algebraic connectivity of graphs
+Normal rank
@@ Property / cites work @@
+Q4679023
@@ Property / cites work: Q4679023 / rank @@
+Normal rank
@@ Property / cites work @@
+Acceleration of randomized Kaczmarz method via the Johnson-Lindenstrauss lemma
+Normal rank
@@ Property / cites work @@
+Accelerated, Parallel, and Proximal Coordinate Descent
+Normal rank
@@ Property / cites work @@
+Linear Recursive Sequences
@@ Property / cites work: Linear Recursive Sequences / rank @@
+Normal rank
@@ Property / cites work @@
+Stochastic heavy ball
@@ Property / cites work: Stochastic heavy ball / rank @@
+Normal rank
@@ Property / cites work @@
+A limit theorem for the norm of random matrices
@@ Property / cites work: A limit theorem for the norm of random matrices / rank @@
+Normal rank
@@ Property / cites work @@
+Accelerated gradient methods for nonconvex nonlinear and stochastic programming
+Normal rank
@@ Property / cites work @@
+Randomized Iterative Methods for Linear Systems
@@ Property / cites work: Randomized Iterative Methods for Linear Systems / rank @@
+Normal rank
@@ Property / cites work @@
+Randomized Quasi-Newton Updates Are Linearly Convergent Matrix Inversion Algorithms
+Normal rank
@@ Property / cites work @@
+On the Convergence Rate of Incremental Aggregated Gradient Algorithms
+Normal rank
@@ Property / cites work @@
+Analysis and Design of Optimization Algorithms via Integral Quadratic Constraints
+Normal rank
@@ Property / cites work @@
+Randomized Methods for Linear Constraints: Convergence Rates and Conditioning
+Normal rank
@@ Property / cites work @@
+An accelerated randomized Kaczmarz algorithm
@@ Property / cites work: An accelerated randomized Kaczmarz algorithm / rank @@
+Normal rank
@@ Property / cites work @@
+Convergence Properties of the Randomized Extended Gauss--Seidel and Kaczmarz Methods
+Normal rank
@@ Property / cites work @@
+Randomized Kaczmarz solver for noisy linear systems
+Normal rank
@@ Property / cites work @@
+Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm
+Normal rank
@@ Property / cites work @@
+Paved with good intentions: analysis of a randomized block Kaczmarz method
+Normal rank
@@ Property / cites work @@
+Randomized block Kaczmarz method with projection for solving least squares
+Normal rank
@@ Property / cites work @@
+Q3967358
@@ Property / cites work: Q3967358 / rank @@
+Normal rank
@@ Property / cites work @@
+Q3320132
@@ Property / cites work: Q3320132 / rank @@
+Normal rank
@@ Property / cites work @@
+Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems
+Normal rank
@@ Property / cites work @@
+iPiasco: inertial proximal algorithm for strongly convex optimization
+Normal rank
@@ Property / cites work @@
+iPiano: Inertial Proximal Algorithm for Nonconvex Optimization
+Normal rank
@@ Property / cites work @@
+Random Geometric Graphs
@@ Property / cites work: Random Geometric Graphs / rank @@
+Normal rank
@@ Property / cites work @@
+Some methods of speeding up the convergence of iteration methods
+Normal rank
@@ Property / cites work @@
+Q3028166
@@ Property / cites work: Q3028166 / rank @@
+Normal rank
@@ Property / cites work @@
+Least-squares solution of overdetermined inconsistent linear systems using kaczmarz's relaxation
+Normal rank
@@ Property / cites work @@
+Convergence rates for Kaczmarz-type algorithms
@@ Property / cites work: Convergence rates for Kaczmarz-type algorithms / rank @@
+Normal rank
@@ Property / cites work @@
+Coordinate descent with arbitrary sampling I: algorithms and complexity<sup>†</sup>
+Normal rank
@@ Property / cites work @@
+Coordinate descent with arbitrary sampling II: expected separable overapproximation
+Normal rank
@@ Property / cites work @@
+Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function
+Normal rank
@@ Property / cites work @@
+Parallel coordinate descent methods for big data optimization
+Normal rank
@@ Property / cites work @@
+Stochastic Reformulations of Linear Systems: Algorithms and Convergence Theory
+Normal rank
@@ Property / cites work @@
+A Stochastic Approximation Method
@@ Property / cites work: A Stochastic Approximation Method / rank @@
+Normal rank
@@ Property / cites work @@
+Minimizing finite sums with the stochastic average gradient
+Normal rank
@@ Property / cites work @@
+Stochastic Dual Coordinate Ascent Methods for Regularized Loss Minimization
+Normal rank
@@ Property / cites work @@
+A randomized Kaczmarz algorithm with exponential convergence
+Normal rank
@@ Property / cites work @@
+An Incremental Gradient(-Projection) Method with Momentum Term and Adaptive Stepsize Rule
+Normal rank
@@ Property / cites work @@
+Coordinate descent algorithms
@@ Property / cites work: Coordinate descent algorithms / rank @@
+Normal rank
@@ Property / cites work @@
+Heavy-ball method in nonconvex optimization problems
+Normal rank
@@ Property / cites work @@
+Randomized Extended Kaczmarz for Solving Least Squares
+Normal rank