Randomized Kaczmarz Converges Along Small Singular Vectors

DOI10.1137/20M1350947MaRDI QIDQ4986830

Stefan Steinerberger

Publication date: 28 April 2021

Published in: SIAM Journal on Matrix Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2006.16978

zbMATH Keywords

ARTKaczmarz methodsingular vectorprojection onto convex setsrandomized Kaczmarz methodalgebraic reconstruction techniquePOCS

Mathematics Subject Classification ID

Iterative numerical methods for linear systems (65F10) Mathematical programming (90Cxx)

Related Items (15)

An Optimal Scheduled Learning Rate for a Randomized Kaczmarz Algorithm ⋮ Eigenvector phase retrieval: recovering eigenvectors from the absolute value of their entries ⋮ A semi-randomized Kaczmarz method with simple random sampling for large-scale linear systems ⋮ Approximate Solutions of Linear Systems at a Universal Rate ⋮ On the convergence of randomized and greedy relaxation schemes for solving nonsingular linear systems of equations ⋮ Randomized Douglas–Rachford Methods for Linear Systems: Improved Accuracy and Efficiency ⋮ Linearly convergent adjoint free solution of least squares problems by random descent ⋮ The method of randomized Bregman projections for stochastic feasibility problems ⋮ Side effects of learning from low-dimensional data embedded in a Euclidean space ⋮ Randomized Kaczmarz algorithm with averaging and block projection ⋮ Sharp Analysis of Sketch-and-Project Methods via a Connection to Randomized Singular Value Decomposition ⋮ A weighted randomized Kaczmarz method for solving linear systems ⋮ On the regularization effect of stochastic gradient descent applied to least-squares ⋮ Surrounding the solution of a linear system of equations from all sides ⋮ Developing Kaczmarz method for solving Sylvester matrix equations

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Randomized block Kaczmarz method with projection for solving least squares
• Acceleration of randomized Kaczmarz method via the Johnson-Lindenstrauss lemma
• Randomized Kaczmarz solver for noisy linear systems
• A randomized Kaczmarz algorithm with exponential convergence
• The conjugate gradient regularization method in computed tomography problems
• On convergence rate of the randomized Kaczmarz method
• Paved with good intentions: analysis of a randomized block Kaczmarz method
• Randomized Extended Kaczmarz for Solving Least Squares
• Randomized Methods for Linear Constraints: Convergence Rates and Conditioning
• An accelerated randomized Kaczmarz algorithm
• Convergence Properties of the Randomized Extended Gauss--Seidel and Kaczmarz Methods
• Randomized Iterative Methods for Linear Systems
• Preasymptotic convergence of randomized Kaczmarz method
• On the regularizing property of stochastic gradient descent
• Phase retrieval via randomized Kaczmarz: theoretical guarantees
• Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm

This page was built for publication: Randomized Kaczmarz Converges Along Small Singular Vectors