GMRES algorithms over 35 years

DOI10.1016/J.AMC.2023.127869OpenAlexW4317951399MaRDI QIDQ2698151FDOQ2698151

Authors: Qinmeng Zou 

Publication date: 21 April 2023

Published in: Applied Mathematics and Computation (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2110.04017

Recommendations

• GMRES methods for least squares problems
• Implementations of the GMRES method
• A new computational GMRES method
• A fast implementation for GMRES method
• scientific article; zbMATH DE number 1618000
• Generalizations and modifications of the GMRES iterative method
• scientific article; zbMATH DE number 440646
• A comparison of some GMRES-like methods
• GMRESR: a family of nested GMRES methods
• GMRES implementations and residual smoothing techniques for solving ill-posed linear systems

zbMATH Keywords

preconditioninglinear systemsparallel computingGram-Schmidtmixed precision

Mathematics Subject Classification ID

Parallel numerical computation (65Y05) Iterative numerical methods for linear systems (65F10)

Cites Work

• Field-of-values analysis of preconditioned iterative methods for nonsymmetric elliptic problems
• Error Analysis of Krylov Methods In a Nutshell
• A New Analysis of Iterative Refinement and Its Application to Accurate Solution of Ill-Conditioned Sparse Linear Systems
• Block Krylov Subspace Methods for Functions of Matrices II: Modified Block FOM
• On Improving Linear Solver Performance: A Block Variant of GMRES
• Spectral deflation in Krylov solvers: a theory of coordinate space based methods
• Expressions and bounds for the GMRES residual
• Rounding Error Analysis of Mixed Precision Block Householder QR Algorithms
• On the convergence behavior of the restarted GMRES algorithm for solving nonsymmetric linear systems
• Parallel conjugate gradient-like algorithms for solving sparse nonsymmetric linear systems on a vector multiprocessor
• The worst-case GMRES for normal matrices
• Accelerating the Solution of Linear Systems by Iterative Refinement in Three Precisions
• Iterative methods for linear systems of equations: A brief historical journey
• Block Gram-Schmidt algorithms and their stability properties
• On Best Approximations of Polynomials in Matrices in the Matrix 2-Norm
• The Coefficients of the FOM and GMRES Residual Polynomials
• Communication lower bounds and optimal algorithms for numerical linear algebra
• GMRES vs. Ideal GMRES
• Max-Min Properties of Matrix Factor Norms
• A Robust GMRES-Based Adaptive Polynomial Preconditioning Algorithm for Nonsymmetric Linear Systems
• Multipreconditioned Gmres for Shifted Systems
• A modified block flexible GMRES method with deflation at each iteration for the solution of non-Hermitian linear systems with multiple right-hand sides
• GMRES convergence bounds that depend on the right-hand-side vector
• GMRES convergence for perturbed coefficient matrices, with application to approximate deflation preconditioning
• GMRES with multiple preconditioners
• Flexible variants of block restarted GMRES methods with application to geophysics
• Parallelism and robustness in GMRES with a Newton basis and deflated restarting
• Flexible GMRES with deflated restarting
• On the convergence rate of DGMRES
• Weighted and deflated global GMRES algorithms for solving large Sylvester matrix equations
• A comparison of preconditioned Krylov subspace methods for large‐scale nonsymmetric linear systems
• Some uses of the field of values in numerical analysis
• On restarted and deflated block FOM and GMRES methods for sequences of shifted linear systems
• Admissible and Attainable Convergence Behavior of Block Arnoldi and GMRES
• Randomized Gram--Schmidt Process with Application to GMRES
• On GMRES for Singular EP and GP Systems
• Low synchronization Gram–Schmidt and generalized minimal residual algorithms
• The Stability of Block Variants of Classical Gram--Schmidt
• Block Modified Gram--Schmidt Algorithms and Their Analysis
• Structure Preserving Quaternion Generalized Minimal Residual Method
• Two new variants of the simpler block GMRES method with vector deflation and eigenvalue deflation for multiple linear systems
• Enlarged GMRES for solving linear systems with one or multiple right-hand sides
• Krylov type methods for linear systems exploiting properties of the quadratic numerical range
• Stability of Linear GMRES Convergence with Respect to Compact Perturbations
• On the cost of iterative computations
• The complete stagnation of GMRES for \(n \leq 4\)
• Residual and backward error bounds in minimum residual Krylov subspace methods
• On the similarities between the quasi-Newton least squares method and GMRes
• Pseudoeigenvector bases and deflated GMRES for highly nonnormal matrices
• Squeezing a Matrix into Half Precision, with an Application to Solving Linear Systems
• On Fixed-Point, Krylov, and $2\times 2$ Block Preconditioners for Nonsymmetric Problems
• Pipelined, flexible Krylov subspace methods
• Proxy-GMRES: Preconditioning via GMRES in Polynomial Space
• A GMRES Convergence Analysis for Localized Invariant Subspace Ill-Conditioning
• Properties of Worst-Case GMRES
• Polynomial Preconditioned Arnoldi with Stability Control
• Algorithm 842
• CMRH: A new method for solving nonsymmetric linear systems based on the Hessenberg reduction algorithm
• Title not available (Why is that?)
• DGMRES: A GMRES-type algorithm for Drazin-inverse solution of singular nonsymmetric linear systems
• Reorthogonalization and Stable Algorithms for Updating the Gram-Schmidt QR Factorization
• Preconditioning techniques for large linear systems: A survey
• Title not available (Why is that?)
• Title not available (Why is that?)
• Anderson acceleration for fixed-point iterations
• GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
• Extrapolation Methods for Vector Sequences
• Parallel iterative methods for sparse linear systems
• Communication-optimal parallel and sequential QR and LU factorizations
• Computational Methods for Linear Matrix Equations
• Numerical methods for large eigenvalue problems
• GMRES On (Nearly) Singular Systems
• Numerical solution of saddle point problems
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Reduced storage matrix methods in stiff ODE systems
• Minimum residual methods for augmented systems
• A parallel GMRES version for general sparse matrices
• GMRES methods for least squares problems
• Solution of Sparse Indefinite Systems of Linear Equations
• Truncation Strategies for Optimal Krylov Subspace Methods
• Title not available (Why is that?)
• The rate of convergence of conjugate gradients
• Variations on Arnoldi's method for computing eigenelements of large unsymmetric matrices
• Krylov sequences of maximal length and convergence of GMRES
• GMRES-type methods for inconsistent systems
• On the regularizing properties of the GMRES method
• GMRES and the Arioli, Pták, and Strakoš parametrization
• On investigating GMRES convergence using unitary matrices
• The Idea behind Krylov Methods
• Any admissible cycle-convergence behavior is possible for restarted GMRES at its initial cycles.
• Variational Iterative Methods for Nonsymmetric Systems of Linear Equations
• Recent computational developments in Krylov subspace methods for linear systems
• Geometric aspects of the theory of Krylov subspace methods
• Recycling Krylov Subspaces for Sequences of Linear Systems
• Krylov Subspace Methods for Solving Large Unsymmetric Linear Systems
• Prescribing the behavior of early terminating GMRES and Arnoldi iterations
• How Fast are Nonsymmetric Matrix Iterations?
• GMRES/CR and Arnoldi/Lanczos as Matrix Approximation Problems
• Title not available (Why is that?)
• A new look at CMRH and its relation to GMRES
• GMRES with Deflated Restarting
• A simpler GMRES
• Relations between Galerkin and Norm-Minimizing Iterative Methods for Solving Linear Systems
• Any Nonincreasing Convergence Curve is Possible for GMRES
• Any Ritz value behavior is possible for Arnoldi and for GMRES
• A Theoretical Comparison of the Arnoldi and GMRES Algorithms
• The principle of minimized iterations in the solution of the matrix eigenvalue problem
• On the simplification of generalized conjugate-gradient methods for nonsymmetrizable linear systems
• A Restarted GMRES Method Augmented with Eigenvectors
• The superlinear convergence behaviour of GMRES
• Global FOM and GMRES algorithms for matrix equations
• Nested Krylov methods based on GCR
• Convergence properties of block GMRES and matrix polynomials
• Least squares residuals and minimal residual methods
• Title not available (Why is that?)
• GMRESR: a family of nested GMRES methods
• A Flexible Inner-Outer Preconditioned GMRES Algorithm
• Breakdown-free GMRES for Singular Systems
• Rounding error analysis of the classical Gram-Schmidt orthogonalization process
• Thick-restart Lanczos method for large symmetric eigenvalue problems
• How to Make Simpler GMRES and GCR More Stable
• Deflation Techniques for an Implicitly Restarted Arnoldi Iteration
• An Iterative Method for Nonsymmetric Systems with Multiple Right-Hand Sides
• Restarted block-GMRES with deflation of eigenvalues
• Numerical stability of GMRES
• Multilevel Projection-Based Nested Krylov Iteration for Boundary Value Problems
• Deflated and Augmented Krylov Subspace Techniques
• Theory of Inexact Krylov Subspace Methods and Applications to Scientific Computing
• Iterative Krylov Methods for Large Linear Systems
• Applying GMRES to the Helmholtz equation with shifted Laplacian preconditioning: What is the largest shift for which wavenumber-independent convergence is guaranteed?
• Convergence in Backward Error of Relaxed GMRES
• Solving linear least squares problems by Gram-Schmidt orthogonalization
• A note on the error analysis of classical Gram-Schmidt
• Reducing the effect of global communication in \(\text{GMRES} (m)\) and CG on parallel distributed memory computers
• Hiding global communication latency in the GMRES algorithm on massively parallel machines
• Conjugate gradient type methods for unsymmetric and inconsistent systems of linear equations
• Generalized conjugate-gradient acceleration of nonsymmetrizable iterative methods
• A projection method to solve linear systems in tensor format
• A hybrid Arnoldi-Faber iterative method for nonsymmetric systems of linear equations
• Krylov subspace recycling for sequences of shifted linear systems
• On the asymptotic directions of the s-dimensional optimum gradient method
• The loss of orthogonality in the Gram-Schmidt orthogonalization process
• A parallel implementation of the restarted GMRES iterative algorithm for nonsymmetric systems of linear equations
• A framework for deflated and augmented Krylov subspace methods
• Gram-Schmidt orthogonalization: 100 years and more
• Locally optimal and heavy ball GMRES methods
• A Hybrid GMRES Algorithm for Nonsymmetric Linear Systems
• A Newton basis GMRES implementation
• Restarted GMRES for Shifted Linear Systems
• Krylov subspace methods. Principles and analysis.
• Convergence of GMRES for Tridiagonal Toeplitz Matrices
• On the Occurrence of Superlinear Convergence of Exact and Inexact Krylov Subspace Methods
• Deflated GMRES for systems with multiple shifts and multiple right-hand sides
• A comparison of some GMRES-like methods
• Accelerating with rank-one updates
• Implicitly Restarted GMRES and Arnoldi Methods for Nonsymmetric Systems of Equations
• Restarted GMRES preconditioned by deflation
• GMRES and the minimal polynomial
• On the similarities between the quasi-Newton inverse least squares method and GMRES
• Adaptively Preconditioned GMRES Algorithms
• The Tortoise and the Hare Restart GMRES
• Analysis of acceleration strategies for restarted minimal residual methods
• Title not available (Why is that?)
• Complete stagnation of GMRES
• Further analysis of minimum residual iterations
• Ritz and harmonic Ritz values and the convergence of FOM and GMRES
• Computable Convergence Bounds for GMRES
• A Note on GMRES Preconditioned by a Perturbed $L D L^T$ Decomposition with Static Pivoting
• A Note on the Superlinear Convergence of GMRES
• On computing givens rotations reliably and efficiently
• Using FGMRES to obtain backward stability in mixed precision
• Randomized numerical linear algebra: Foundations and algorithms
• Weighted FOM and GMRES for solving nonsymmetric linear systems
• Implementations of the GMRES method
• A fast implementation for GMRES method
• Theoretical and numerical comparisons of GMRES and WZ-GMRES
• Augmented GMRES-type methods
• Implementation of the GMRES Method Using Householder Transformations
• GMRES implementations and residual smoothing techniques for solving ill-posed linear systems
• Title not available (Why is that?)
• Solving ill-posed linear systems with GMRES and a singular preconditioner
• Title not available (Why is that?)
• A new computational GMRES method
• New conditions for non-stagnation of minimal residual methods
• Fields of values and iterative methods
• Efficient High Accuracy Solutions with ${\text{GMRES}}(m)$
• Parallelizable restarted iterative methods for nonsymmetric linear systems. part I: Theory
• Parallelizable restarted iterative methods for nonsymmetric linear systems. II: parallel implementation
• On the generation of Krylov subspace bases
• Modified Gram-Schmidt (MGS), Least Squares, and Backward Stability of MGS-GMRES
• GMRES Convergence Analysis for a Convection-Diffusion Model Problem
• A continuation/GMRES method for fast computation of nonlinear receding horizon control
• Title not available (Why is that?)
• Extrapolation vs. projection methods for linear systems of equations
• Inexact Krylov Subspace Methods for Linear Systems
• The polynomial numerical hulls of Jordan blocks and related matrices.
• Generalizations of the field of values useful in the study of polynomial functions of a matrix
• Some theoretical results derived from polynomial numerical hulls of Jordan blocks
• New insights in GMRES-like methods with variable preconditioners
• Arnoldi decomposition, GMRES, and preconditioning for linear discrete ill-posed problems
• Minimal Residual Method Stronger than Polynomial Preconditioning
• On worst-case GMRES, ideal GMRES, and the polynomial numerical hull of a Jordan block
• A note on weighted FOM and GMRES for solving nonsymmetric linear systems
• The cycle-convergence of restarted GMRES for normal matrices is sublinear
• Analysis of Augmented Krylov Subspace Methods
• Some observations on weighted GMRES
• A Technique for Accelerating the Convergence of Restarted GMRES
• Weighted Inner Products for GMRES and GMRES-DR
• Accelerate weighted GMRES by augmenting error approximations
• Physics based GMRES preconditioner for compressible and incompressible Navier-Stokes equations
• Numerical behaviour of the modified Gram-Schmidt GMRES implementation
• Analysis of the convergence of the minimal and the orthogonal residual methods
• Some properties of range restricted GMRES methods
• Inexact Matrix-Vector Products in Krylov Methods for Solving Linear Systems: A Relaxation Strategy
• Two recursive GMRES-type methods for shifted linear systems with general preconditioning
• Some Remarks on the Elman Estimate for GMRES
• Adaptive version of simpler GMRES
• Eigenvalue translation based preconditioners for the GMRES(k) method
• Block GMRES Method with Inexact Breakdowns and Deflated Restarting
• Exact and inexact breakdowns in the block GMRES method
• The block grade of a block Krylov space
• Iterative Refinement in Floating Point
• Convergence properties of some block Krylov subspace methods for multiple linear systems
• A convergence analysis of GMRES and FOM methods for Sylvester equations
• A polynomial preconditioner for the GMRES algorithm
• Polynomial Preconditioned GMRES and GMRES-DR
• Toward efficient polynomial preconditioning for GMRES
• Implicitly restarted and deflated GMRES
• A simple strategy for varying the restart parameter in GMRES\((m)\)
• Improving the Accuracy of GMRes with Deflated Restarting
• The DEFLATED-GMRES(m,k) method with switching the restart frequency dynamically
• Numerical range, GMRES and Faber polynomials.
• A block GMRES method augmented with eigenvectors
• On a non-stagnation condition for GMRES and application to saddle point matrices
• Evaluation of the performance of inexact GMRES
• Convergence analysis of Krylov subspace methods
• On a multilevel Krylov method for the Helmholtz equation preconditioned by shifted Laplacian
• TT-GMRES: solution to a linear system in the structured tensor format
• Reorthogonalized block classical Gram-Schmidt
• Krylov Methods for Nonsymmetric Linear Systems
• Preconditioning
• An Iterative Least-Square Method Suitable for Solving Large Sparse Matrices
• A Flexible Krylov Solver for Shifted Systems with Application to Oscillatory Hydraulic Tomography
• Varying the \(s\) in your \(s\)-step GMRES
• A projection method and Kronecker product preconditioner for solving Sylvester tensor equations
• Any admissible harmonic Ritz value set is possible for GMRES
• On the choice of preconditioner for minimum residual methods for non-Hermitian matrices
• Necessary and sufficient conditions for GMRES complete and partial stagnation
• Generalization of convergence conditions for a restarted GMRES
• A block GMRES method with deflated restarting for solving linear systems with multiple shifts and multiple right‐hand sides
• Shanks Sequence Transformations and Anderson Acceleration
• On the residual norms, the Ritz values and the harmonic Ritz values that can be generated by restarted GMRES
• Some remarks on the restarted and augmented GMRES method
• Algebraic properties of the block GMRES and block Arnoldi methods

Cited In (3)

• Probabilistic rounding error analysis of modified Gram-Schmidt
• GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
• GMRES algorithms over 35 years

Uses Software

• GMRES
• DQGMRES
• CMRH
• DGMRES
• TRLan
• Eigtool
• Anderson
• LSODA

This page was built for publication: GMRES algorithms over 35 years

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2698151)