A survey of subspace recycling iterative methods
From MaRDI portal
Publication:6144044
DOI10.1002/GAMM.202000016arXiv2001.10347OpenAlexW3089315482MaRDI QIDQ6144044FDOQ6144044
Authors: Kirk M. Soodhalter, E. de Sturler, Misha E. Kilmer
Publication date: 5 January 2024
Published in: GAMM-Mitteilungen (Search for Journal in Brave)
Abstract: This survey concerns subspace recycling methods, a popular class of iterative methods that enable effective reuse of subspace information in order to speed up convergence and find good initial guesses over a sequence of linear systems with slowly changing coefficient matrices, multiple right-hand sides, or both. The subspace information that is recycled is usually generated during the run of an iterative method (usually a Krylov subspace method) on one or more of the systems. Following introduction of definitions and notation, we examine the history of early augmentation schemes along with deflation preconditioning schemes and their influence on the development of recycling methods. We then discuss a general residual constraint framework through which many augmented Krylov and recycling methods can both be viewed. We review several augmented and recycling methods within this framework. We then discuss some known effective strategies for choosing subspaces to recycle before taking the reader through more recent developments that have generalized recycling for (sequences of) shifted linear systems, some of them with multiple right-hand sides in mind. We round out our survey with a brief review of application areas that have seen benefit from subspace recycling methods.
Full work available at URL: https://arxiv.org/abs/2001.10347
Recommendations
- Recycling Krylov Subspaces for Sequences of Linear Systems
- Recycling Krylov subspace methods for sequences of linear systems. Analysis and applications
- Krylov subspace recycling for sequences of shifted linear systems
- A note on augmented unprojected Krylov subspace methods
- Subspace Recycling--Based Regularization Methods
Numerical methods for partial differential equations, boundary value problems (65Nxx) Numerical linear algebra (65Fxx) Computer aspects of numerical algorithms (65Yxx)
Cites Work
- A Robust GMRES-Based Adaptive Polynomial Preconditioning Algorithm for Nonsymmetric Linear Systems
- Multipreconditioned GMRES for shifted systems
- Enabling off-design linearised aerodynamics analysis using Krylov subspace recycling technique
- Robust and efficient adjoint solver for complex flow conditions
- A combination of the fast multipole boundary element method and Krylov subspace recycling solvers
- Krylov-subspace recycling via the POD-augmented conjugate-gradient method
- GMRES convergence for perturbed coefficient matrices, with application to approximate deflation preconditioning
- Comparison of the deflated preconditioned conjugate gradient method and algebraic multigrid for composite materials
- Computing reduced order models via inner-outer Krylov recycling in diffuse optical tomography
- Flexible GMRES with deflated restarting
- A block \(\mathrm{GCROT}(m, k)\) method for linear systems with multiple right-hand sides
- A flexible generalized conjugate residual method with inner orthogonalization and deflated restarting
- Enriched Krylov subspace methods for ill-posed problems
- Mstab: stabilized induced dimension reduction for Krylov subspace recycling
- Subspace recycling accelerates the parametric macro-modeling of MEMS
- Fast Algorithms for Hyperspectral Diffuse Optical Tomography
- The adaptive augmented GMRES method for solving ill-posed problems
- LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares
- IRBL: An Implicitly Restarted Block-Lanczos Method for Large-Scale Hermitian Eigenproblems
- Title not available (Why is that?)
- CGS, A Fast Lanczos-Type Solver for Nonsymmetric Linear systems
- Preconditioned recycling Krylov subspace methods for self-adjoint problems
- Probabilistic numerics and uncertainty in computations
- GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
- Methods of conjugate gradients for solving linear systems
- Parallel iterative methods for sparse linear systems
- QMR: A quasi-minimal residual method for non-Hermitian linear systems
- Title not available (Why is that?)
- Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems
- Augmented Implicitly Restarted Lanczos Bidiagonalization Methods
- BiCGstab(\(l\)) for linear equations involving unsymmetric matrices with complex spectrum
- An implicitly restarted block Lanczos bidiagonalization method using Leja shifts
- Balancing domain decomposition
- A simplified and flexible variant of \texttt{GCROT} for solving nonsymmetric linear systems
- IDR(\(s\)): A family of simple and fast algorithms for solving large nonsymmetric systems of linear equations
- Solution of Sparse Indefinite Systems of Linear Equations
- Title not available (Why is that?)
- Truncation Strategies for Optimal Krylov Subspace Methods
- Title not available (Why is that?)
- A Transpose-Free Quasi-Minimal Residual Algorithm for Non-Hermitian Linear Systems
- The rate of convergence of conjugate gradients
- On the convergence of restarted Krylov subspace methods
- On the construction of deflation-based preconditioners
- Deflation of Conjugate Gradients with Applications to Boundary Value Problems
- Variational Iterative Methods for Nonsymmetric Systems of Linear Equations
- An overview of the Trilinos project
- Recycling Krylov Subspaces for Sequences of Linear Systems
- Deflation and Balancing Preconditioners for Krylov Subspace Methods Applied to Nonsymmetric Matrices
- Iterative Krylov Methods for Large Linear Systems
- GMRES with Deflated Restarting
- Any Nonincreasing Convergence Curve is Possible for GMRES
- A Restarted GMRES Method Augmented with Eigenvectors
- Nested Krylov methods based on GCR
- On the numerical solution of \(AX-XB=C\)
- GMRESR: a family of nested GMRES methods
- An Iterative Method for Nonsymmetric Systems with Multiple Right-Hand Sides
- Restarted block-GMRES with deflation of eigenvalues
- An introduction to domain decomposition methods. Algorithms, theory, and parallel implementation
- Deflated and Augmented Krylov Subspace Techniques
- A Deflated Version of the Conjugate Gradient Algorithm
- Low-rank tensor Krylov subspace methods for parametrized linear systems
- Fast CG-Based Methods for Tikhonov--Phillips Regularization
- Computational aspects of the stochastic finite element method
- An implicit restarted Lanczos method for large symmetric eigenvalue problems
- Krylov subspace recycling for sequences of shifted linear systems
- Incremental spectral preconditioners for sequences of linear systems
- A framework for deflated and augmented Krylov subspace methods
- Parallel Domain Decomposition Methods for Stochastic Elliptic Equations
- A numerical study of various algorithms related to the preconditioned conjugate gradient method
- A Hybrid GMRES Algorithm for Nonsymmetric Linear Systems
- Restarted GMRES for Shifted Linear Systems
- Deflated and augmented Krylov subspace methods: A framework for deflated BiCG and related solvers
- On the Occurrence of Superlinear Convergence of Exact and Inexact Krylov Subspace Methods
- Integral Equation Based Domain Decomposition Method for Solving Electromagnetic Wave Scattering From Non-Penetrable Objects
- Deflated GMRES for systems with multiple shifts and multiple right-hand sides
- Accelerating with rank-one updates
- An augmented LSQR method
- Implicitly Restarted GMRES and Arnoldi Methods for Nonsymmetric Systems of Equations
- Restarted GMRES preconditioned by deflation
- Large-scale topology optimization using preconditioned Krylov subspace methods with recycling
- Adaptively Preconditioned GMRES Algorithms
- Restarted full orthogonalization method for shifted linear systems
- Necessary and Sufficient Conditions for the Existence of a Conjugate Gradient Method
- BiCGStab(\(\ell\)) for families of shifted linear systems
- Title not available (Why is that?)
- A Rayleigh-Ritz preconditioner for the iterative solution to large scale nonlinear problems
- Analysis of acceleration strategies for restarted minimal residual methods
- Title not available (Why is that?)
- Recycling Subspace Information for Diffuse Optical Tomography
- Augmented GMRES-type methods
- Decomposition methods for large linear discrete ill-posed problems
- Title not available (Why is that?)
- An Augmented Conjugate Gradient Method for Solving Consecutive Symmetric Positive Definite Linear Systems
- R\(^3\)GMRES: including prior information in GMRES-type methods for discrete inverse problems
- Minimal Residual Method Stronger than Polynomial Preconditioning
- On the Lanczos Method for Solving Symmetric Linear Systems with Several Right-Hand Sides
- Analysis of Augmented Krylov Subspace Methods
- Computing and deflating eigenvalues while solving multiple right-hand side linear systems with an application to quantum chromodynamics
- Flexible conjugate gradients
- Deflated and restarted symmetric Lanczos methods for eigenvalues and linear equations with multiple right-hand sides
- Analysis of Projection Methods for Solving Linear Systems with Multiple Right-Hand Sides
- The deflated conjugate gradient method: convergence, perturbation and accuracy
- Two recursive GMRES-type methods for shifted linear systems with general preconditioning
- Eigenvalue translation based preconditioners for the GMRES(k) method
- Block GMRES method with inexact breakdowns and deflated restarting
- Iterative accelerating algorithms with Krylov subspaces for the solution to large-scale nonlinear problems
- QMR-based projection techniques for the solution of non-Hermitian systems with multiple right-hand sides
- Recycling Krylov subspaces for efficient large-scale electrical impedance tomography
- Recycling Krylov subspaces for CFD applications and a new hybrid recycling solver
- Recycling BiCGSTAB with an application to parametric model order reduction
- Galerkin Projection Methods for Solving Multiple Linear Systems
- Accelerating the shifted Laplace preconditioner for the Helmholtz equation by multilevel deflation
- Recycling BICG with an application to model reduction
- Extending the eigCG algorithm to nonsymmetric Lanczos for linear systems with multiple right-hand sides.
- Projection techniques for iterative solution of \(A\underline x=\underline b\) with successive right-hand sides
- Total and selective reuse of Krylov subspaces for the resolution of sequences of nonlinear structural problems
- The Lanczos method for parameterized symmetric linear systems with multiple right-hand sides
Cited In (8)
- A sketch-and-select Arnoldi process
- Deflation for the Off-Diagonal Block in Symmetric Saddle Point Systems
- Recycling Krylov subspace methods for sequences of linear systems. Analysis and applications
- A rational filtering algorithm for sequences of shifted symmetric linear systems with applications to frequency response analysis
- Subspace Acceleration for a Sequence of Linear Systems and Application to Plasma Simulation
- Krylov subspace recycling with randomized sketching for matrix functions
- Iterative Methods by Space Decomposition and Subspace Correction
- Acceleration of the subspace iteration method by selective repeated inverse iteration
This page was built for publication: A survey of subspace recycling iterative methods
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6144044)