Randomized extended Kaczmarz for solving least squares
From MaRDI portal
Publication:2848636
Abstract: We present a randomized iterative algorithm that exponentially converges in expectation to the minimum Euclidean norm least squares solution of a given linear system of equations. The expected number of arithmetic operations required to obtain an estimate of given accuracy is proportional to the square condition number of the system multiplied by the number of non-zeros entries of the input matrix. The proposed algorithm is an extension of the randomized Kaczmarz method that was analyzed by Strohmer and Vershynin.
Recommendations
- Randomized extended average block Kaczmarz for solving least squares
- Randomized block Kaczmarz method with projection for solving least squares
- Single projection Kaczmarz extended algorithms
- Randomized double and triple Kaczmarz for solving extended normal equations
- On two-subspace randomized extended Kaczmarz method for solving large linear least-squares problems
Cited in
(only showing first 100 items - show all)- Rows versus Columns: Randomized Kaczmarz or Gauss--Seidel for Ridge Regression
- Randomized Douglas–Rachford Methods for Linear Systems: Improved Accuracy and Efficiency
- Choosing relaxation parameter in randomized Kaczmarz method
- On relaxed greedy randomized coordinate descent methods for solving large linear least-squares problems
- Randomized Kaczmarz with averaging
- On extended Kaczmarz methods with random sampling and maximum-distance for solving large inconsistent linear systems
- A new randomized Kaczmarz based kernel canonical correlation analysis algorithm with applications to information retrieval
- Randomized extended average block Kaczmarz for solving least squares
- A geometric probability randomized Kaczmarz method for large scale linear systems
- Learning theory of randomized sparse Kaczmarz method
- A weighted randomized sparse Kaczmarz method for solving linear systems
- Effects of depth, width, and initialization: a convergence analysis of layer-wise training for deep linear neural networks
- An accelerated randomized Kaczmarz algorithm
- A randomized sparse Kaczmarz solver for sparse signal recovery via minimax-concave penalty
- On constrained Kaczmarz algorithm with momentum for image reconstruction
- Surrounding the solution of a linear system of equations from all sides
- Faster randomized block sparse Kaczmarz by averaging
- On greedy randomized average block Kaczmarz method for solving large linear systems
- Maximal residual extended Kaczmarz and Gauss-Seidel methods-convergence properties and applications
- A modified partially randomized extended Kaczmarz iteration method
- A sampling Kaczmarz-Motzkin algorithm for linear feasibility
- On Motzkin's method for inconsistent linear systems
- A refinement of an iterative orthogonal projection method
- Enhancement of the Kaczmarz algorithm with projection adjustment
- A class of pseudoinverse-free greedy block nonlinear Kaczmarz methods for nonlinear systems of equations
- Projected randomized Kaczmarz methods
- On adaptive stochastic heavy ball momentum for solving linear systems
- On a fast deterministic block Kaczmarz method for solving large-scale linear systems
- Machine learning with kernels for portfolio valuation and risk management
- On partially randomized extended Kaczmarz method for solving large sparse overdetermined inconsistent linear systems
- Optimization of random feature method in the high-precision regime
- Accelerating the distributed Kaczmarz algorithm by strong over-relaxation
- A weighted randomized Kaczmarz method for solving linear systems
- Sampled limited memory methods for massive linear inverse problems
- A fast block coordinate descent method for solving linear least-squares problems
- Randomized Kaczmarz Converges Along Small Singular Vectors
- On Adaptive Sketch-and-Project for Solving Linear Systems
- On multi-step extended maximum residual Kaczmarz method for solving large inconsistent linear systems
- Quantile-based iterative methods for corrupted systems of linear equations
- Stochastic iterative methods for online rank aggregation from pairwise comparisons
- Tensor randomized extended Kaczmarz methods for large inconsistent tensor linear equations with t-product
- Average block column action methods for solving least squares problems
- Randomized block Kaczmarz methods with \(k\)-means clustering for solving large linear systems
- A fast Kaczmarz-Kovarik algorithm for consistent least-squares problems
- The randomized Kaczmarz method with mismatched adjoint
- A subspace constrained randomized Kaczmarz method for structure or external knowledge exploitation
- Incremental regularized least squares for dimensionality reduction of large-scale data
- Kaczmarz-type methods for solving matrix equations
- A randomized block Douglas-Rachford method for solving linear matrix equation
- Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems
- On multi-step randomized extended Kaczmarz method for solving large sparse inconsistent linear systems
- On maximum residual nonlinear Kaczmarz-type algorithms for large nonlinear systems of equations
- Constrained ERM learning of canonical correlation analysis: a least squares perspective
- Randomized Block Adaptive Linear System Solvers
- Sequential approximation of functions in Sobolev spaces using random samples
- Quantile-based Random Kaczmarz for corrupted linear systems of equations
- Stochastic reformulations of linear systems: algorithms and convergence theory
- Adaptive Bregman-Kaczmarz: an approach to solve linear inverse problems with independent noise exactly
- Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods
- A residual-based surrogate hyperplane extended Kaczmarz algorithm for large least squares problems
- On relaxed greedy randomized augmented Kaczmarz methods for solving large sparse inconsistent linear systems
- Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm
- On convergence rates of Kaczmarz-type methods with different selection rules of working rows
- Sequential function approximation with noisy data
- Greedy block extended Kaczmarz method for solving the least squares problems
- Convergence analysis for Kaczmarz-type methods in a Hilbert space framework
- A Deterministic Kaczmarz Algorithm for Solving Linear Systems
- On adaptive block coordinate descent methods for ridge regression
- An Optimal Scheduled Learning Rate for a Randomized Kaczmarz Algorithm
- A semi-randomized Kaczmarz method with simple random sampling for large-scale linear systems
- On the Kaczmarz methods based on relaxed greedy selection for solving matrix equation \(A X B = C\)
- Sampling Kaczmarz-Motzkin method for linear feasibility problems: generalization and acceleration
- The greedy randomized extended Kaczmarz algorithm for noisy linear systems
- scientific article; zbMATH DE number 6402625 (Why is no real title available?)
- Accelerated sampling Kaczmarz Motzkin algorithm for the linear feasibility problem
- Regularized Kaczmarz Algorithms for Tensor Recovery
- Acceleration and restart for the randomized Bregman-Kaczmarz method
- A stochastic Kaczmarz algorithm for network tomography
- Greed Works: An Improved Analysis of Sampling Kaczmarz--Motzkin
- Randomized Kaczmarz algorithm with averaging and block projection
- Convergence of the multiplicative algebraic reconstruction technique for the inconsistent system of equations
- A Kaczmarz-inspired approach to accelerate the optimization of neural network wavefunctions
- Faster randomized block Kaczmarz algorithms
- scientific article; zbMATH DE number 7708789 (Why is no real title available?)
- A randomized tensor quadrature method for high dimensional polynomial approximation
- On maximum residual block and two-step Gauss-Seidel algorithms for linear least-squares problems
- Randomized double and triple Kaczmarz for solving extended normal equations
- Towards Practical Large-Scale Randomized Iterative Least Squares Solvers through Uncertainty Quantification
- The extensions of convergence rates of Kaczmarz-type methods
- Greedy Kaczmarz algorithm using optimal intermediate projection technique for coherent linear systems
- A linearly convergent doubly stochastic Gauss-Seidel algorithm for solving linear equations and a certain class of over-parameterized optimization problems
- The Kaczmarz algorithm, row action methods, and statistical learning algorithms
- A two-step randomized Gauss-Seidel method for solving large-scale linear least squares problems
- A randomized algorithm for multivariate function approximation
- A randomised iterative method for solving factorised linear systems
- Randomized Kaczmarz iteration methods: algorithmic extensions and convergence theory
- A class of residual-based extended Kaczmarz methods for solving inconsistent linear systems
- Randomized approximate class-specific kernel spectral regression analysis for large-scale face verification
- Subspace correction methods in algebraic multi-level frames
- A greedy block Kaczmarz algorithm for solving large-scale linear systems
This page was built for publication: Randomized extended Kaczmarz for solving least squares
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2848636)
