GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems

DOI10.1137/0907058zbMath0599.65018WikidataQ56564057 ScholiaQ56564057MaRDI QIDQ3734971

Yousef Saad, Martin H. Schultz

Publication date: 1986

Published in: SIAM Journal on Scientific and Statistical Computing (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/0907058

zbMATH Keywords

iterative algorithm; minimal residual method; numerical comparisons; Krylov subspace; generalized conjugate residual method; ORTHODIR method

Mathematics Subject Classification ID

65F10: Iterative numerical methods for linear systems

65F25: Orthogonalization in numerical linear algebra

Related Items

Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, An Anisotropic Artificial Viscosity Method: Application to the Simulation of Compressible Viscous Flows, Solution of Lyapunov and Riccati equations in a multiprocessor environment, Solving optimal control problems by GAs, An Iteration for Indefinite Systems and Its Application to the Navier--Stokes Equations, Additive schwarz methods for indefinite hypersingular integral equations in R³- the p-version, Computer simulation of liquid encapsulated vertical bridgman crystal growth: pseudo steady‐state calculations, Parallel adaptive finite element analysis of viscous flows based on a combined compressible‐incompressible formulation, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Potential energy in steep and breaking waves, Preconditioning convection dominated convection‐diffusion problems, Preconditioned cg‐like methods for solving non‐linear convection—diffusion equations, Transport processes in periodic porous media, On restarting the Arnoldi method for large nonsymmetric eigenvalue problems, Preconditioning by approximations of the discrete Laplacian for 2‐D non‐linear free convection elliptic equations, Finite Element Modeling of 3D Fluid Dynamics in Crystal Growth Systems, Unnamed Item, Recursive interpolation algorithm: A formalism for solving systems of linear equations. II: Iterative methods, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Quasi‐variational inequality and shape optimization for solution of a free boundary problem, Discrete krylov subspace methods for equations of the second kind, GMRES as a multi-step transport sweep accelerator, Spectral distribution of preconditioned elliptic operators, A direct solver for the least‐squares problem arising from GMRES(k), Simulation of the hydrodynamic model of semiconductor devices by a finite element method, A new iterative method for large sparse linear systems, Multilevel source iteration accelerators for the linear transport equation in slab geometry, The numerical solution of a control problem governed by a phase filed model, Moderate and steep Faraday waves: instabilities, modulation and temporal asymmetries, Iterative Schemes for Nonsymmetric and Indefinite Elliptic Boundary Value Problems, Fast Spectrally-Accurate Solution of Variable-Coefficient Elliptic Problems, Robust preconditioning of large, sparse, symmetric eigenvalue problems, A hybrid block GMRES method for nonsymmetric systems with multiple right-hand sides, Nested Krylov methods based on GCR, Restarted GMRES preconditioned by deflation, A linear system solver based on a modified Krylov subspace method for breakdown recovery, Ritz and pseudo-Ritz values using matrix polynomials, An inverse iteration method using multigrid for quantum chemistry, Jacobi-Davidson type methods for generalized eigenproblems and polynomial eigenproblems, Convergence estimates for solution of integral equations with GMRES, A structured matrix problem in dynamical systems, A fast multipole boundary integral equation method for crack problems in 3D, Iterative solution of large-scale 3D-BEM industrial problems, Iterative solvers for BEM algebraic systems of equations, Physics based GMRES preconditioner for compressible and incompressible Navier-Stokes equations, Application of an element-by-element BiCGSTAB iterative solver to a monotonic finite element model, Bifurcations of the von Kármán equations with Robin boundary conditions, Integral equation methods for particle simulations in creeping flows, A parallelizable preconditioner for the iterative solution of implicit Runge-Kutta-type methods, A boundary integral method applied to a convection-diffusion problem, Preconditioners for nonconforming domain decomposition methods, Physics-based simulation of nonlinear distortion in semiconductor devices using the harmonic balance method, A finite element formulation of compressible flows using various sets of independent variables, Convergence properties of Krylov subspace methods for singular linear systems with arbitrary index, Finite element analysis of compressible viscoplasticity using a three-field formulation. Application to metal powder hot compaction, Convergence and domain decomposition algorithm for nonconforming and mixed methods for nonselfadjoint and indefinite problems, A posteriori error estimates for spectral element solutions to viscoelastic flow problems, The shear-slip mesh update method, Multi-domain parallel computation of wake flows, Multiphysics simulation of flow-induced vibrations and aeroelasticity on parallel computing platforms, Enhanced-discretization interface-capturing technique (EDICT) for computation of unsteady flows with interfaces, Microstructural evolution in orthotropic elastic media, A wavenumber based extrapolation and interpolation method for use in conjunction with high-order finite difference schemes, An implicit energy-conservative 2D Fokker-Planck algorithm. II: Jacobian-free Newton-Krylov solver, Convergence analysis of iterative methods by pseudodifference operators, Aerodynamic design optimization on unstructured grids with a continuous adjoint formulation, On the numerical evaluation of elastostatic fields in locally isotropic two-dimensional composites, GMRES computation of high frequency electrical field propagation in land mine detection, Efficient time integration of Navier-Stokes equations, On parameter choice and iterative convergence for stabilised discretisations of advection-diffusion problems, A discretization scheme for an extended drift-diffusion model including trap-assisted phenomena., Using successive approximations for improving the convergence of GMRES method, Bifurcations of corank greater than two, Continuation-minimization methods for stability problems, An analysis of element-by-element preconditioners for nonsymmetric problems, Algorithmic bombardment for the iterative solution of linear systems: A poly-iterative approach, On the comparison of four different implementations of a third-order ENO scheme of box type for the computation of compressible flow, Laminar pulsatile two-phase non-Newtonian flow through a pipe, A simple ILU preconditioning coupled to orthomin method, Condition number of the Krylov bases and subspaces, Convergence properties of block GMRES and matrix polynomials, GMRES and the minimal polynomial, Convergence of Krylov methods for sums of two operators, Unnamed Item, Modified Lanczos method for solving large sparse linear systems, Computational experience with globally convergent descent methods for large sparse systems of nonlinear equations^∗, Higher-Order Flux-Limiting Schemes for the Finite Volume Computation of Incompressible Flow, Preconditioned iterative methods for elliptic problems on decomposed domains, Block jacobi preconditioning of the conjugate gradient method on a vector processor, Parallel preconditioned conjugate-gradient type algorithms for general sparsity structures, Explicitly preconditioned conjugate gradient method for the solution of unsymmetric linear systems, Parallelizable restarted iterative methods for nonsymmetric linear systems. part I: Theory, Parallelizable restarted iterative methods for nonsymmetric linear systems. II: parallel implementation, Drop tolerance preconditioning for incompressible viscous flow, Parallel-vector computation with high-pelement-by-element methods, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, A Preconditioned GMRES Method for Nonsymmetric or Indefinite Problems, Unnamed Item, Unnamed Item, Unnamed Item, The convergence of Krylov subspace methods for large unsymmetric linear systems, Unnamed Item, A block varaint of the GMRES method for unsymmetric linear systems, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Coupling of BEM and FEM by a multiplicative Schwarz method and its parallel implementation, Domain Decomposition Methods for Sensitivity Analysis of a Nonlinear Aeroelasticity Problem, A preconditioned GMRES method, Flow simulation and high performance computing, A hybrid method for moving interface problems with application to the Hele-Shaw flow, Unconventional schemes for a class of ordinary differential equations - with applications to the Korteweg-de Vries equation, A note on the convergence behavior of GMRES, Multigrid with inexact minimal residual smoothing acceleration, A domain decomposition method for almost incompressible flow, Nonlinear iteration methods for high speed laminar compressible Navier-Stokes equations, Numerical behaviour of the modified Gram-Schmidt GMRES implementation, Fully implicit kinetic solution of collisional plasmas, Numerically implemented perturbation method for the nonlinear magnetic moment of an anisotropic superconductor, On the numerical evaluation of electrostatic fields in dense random dispersions of cylinders, Numerical conformal mapping via the Bergman kernel, Conjugate gradient and minimal residual method for solving symmetric indefinite systems, Multilevel preconditioning based on discrete symmetrization for convection-diffusion equations, An inexact Newton method for systems arising from the finite element method, ROWMAP -- a ROW-code with Krylov techniques for large stiff ODEs, Multigrid methods to accelerate convergence of element-by-element solution algorithms for viscous incompressible flows, A finite volume method for solute segregation in directional solidification and comparison with a finite element method, A new computational algorithm for Green's functions: Fourier transform of the Newton polynomial expansion, On a variable smoothing procedure for Krylov subspace methods, Residual cutting method for elliptic boundary value problems: Application to Poisson's equation, An inexact Newton method for fully coupled solution of the Navier-Stokes equations with heat and mass transport, Iterative solution of multiple radiation and scattering problems in structural acoustics using a block quasi-minimal residual algorithm, Parallelized implicit propagators for the finite-difference Schrödinger equation, Truncated trust region methods based on preconditioned iterative subalgorithms for large sparse systems of nonlinear equations, Multigrid methods for 3-D definite and indefinite problems, Computing eigenvalues occurring in continuation methods with the Jacobi-Davidson QZ method, High order perturbation theory for Helmholtz/Schrödinger equations via a separable preconditioner, A calculation method for fully developed flows in curved rectangular tubes, An algebraic multilevel parallelizable preconditioner for large-scale CFD problems, The numerical solution of stochastic automata networks, Physics-based preconditioning and the Newton-Krylov method for non-equilibrium radiation diffusion, Sharp error bounds of some Krylov subspace methods for non-Hermitian linear systems, Numerical conformal mapping via the Bergman kernel using the generalized minimum residual method, Some recursions on Arnoldi's method and IOM for large non-Hermitian linear systems, A domain decomposition preconditioner for an advection-diffusion problem, A scaled and minimum overlap restricted additive Schwarz method with application to aerodynamics, On the performance of high aspect ratio elements for incompressible flows, Effect of the storage format of sparse linear systems on parallel CFD computations, A numerically efficient model for simulation of defibrillation in an active bidomain sheet of myocardium, Convergence to steady-state solutions for stabilized finite element simulations of compressible flows, Complex conjugate gradient methods, A comparison of GMRES and CGSTAB accelerations for incompressible Navier- Stokes problems, The GMRES method improved by securing fast wave propagation, Krylov space methods on state-space control models, Conjugate gradient type methods for semilinear elliptic problems with symmetry, A multigrid preconditioner for stabilised discretisations of advection-diffusion problems, Extreme singular values and eigenvalues of non-Hermitian block Toeplitz matrices, A unified finite element formulation for compressible and incompressible flows using augmented conservation variables, An arbitrary Lagrangian-Eulerian finite element method for solving three-dimensional free surface flows, Additive Schwarz algorithms for parabolic convection-diffusion equations, Finite element modeling of blood in arteries, Finite element computation of unsteady viscous compressible flows, On the condition number of some spectral collocation operators and their finite element preconditioning, Invariant discretization of the \(k\)-\(\varepsilon\) model in general co- ordinates for prediction of turbulent flow in complicated geometries, Numerical solution of the incompressible Navier-Stokes equations by Krylov subspace and multigrid methods, A parallel implementation of the restarted GMRES iterative algorithm for nonsymmetric systems of linear equations, On iterative solution of linear equations arising in BVPs of ODEs, A polynomial preconditioner for the GMRES algorithm, An extension of the theory of secant preconditioners, Projection-minimization methods for nonsymmetric linear systems, New insights in GMRES-like methods with variable preconditioners, SOR as a preconditioner, Reducing the effect of global communication in \(\text{GMRES} (m)\) and CG on parallel distributed memory computers, Maintaining convergence properties of BiCGStab methods in finite precision arithmetic, Numerical stability of GMRES, Generic rank-one corrections for value iteration in Markovian decision problems, A block incomplete orthogonalization method for large nonsymmetric eigenproblems, The methods of Vorobyev and Lanczos, Perturbation analysis for some linear boundary integral operators, Reliable updated residuals in hybrid Bi-CG methods, Numerical solution of the Lyapunov equation by approximate power iteration, Finite element solution strategies for large-scale flow simulations, Massively parallel finite element computation of incompressible flows involving fluid-body interactions, An efficient communications strategy for finite element methods on the Connection Machine CM-5 system, Robust linear and nonlinear strategies for solution of the transonic Euler equations, Parallelizable block diagonal preconditioners for the compressible Navier-Stokes equations, Finite element solution of compressible viscous flows using conservative variables, Scalability of finite element applications on distributed-memory parallel computers, Massively parallel finite element computations of three-dimensional, time-dependent, incompressible flows in materials processing systems, Massively parallel finite element simulation of compressible and incompressible flows, Roundoff error analysis of algorithms based on Krylov subspace methods, Combining the preconditioned conjugate gradient method and a matrix iterative method, Tensor-Krylov methods for large nonlinear equations, The parallel iterative methods (PIM) package for the solution of systems of linear equations on parallel computers, Large scale finite element computations with GMRES-like methods on a Cray Y-MP, Incomplete block LU preconditioners on slightly overlapping subdomains for a massively parallel computer, An engineering approach to generalized conjugate gradient methods and beyond, A theoretical overview of Krylov subspace methods, An overview of approaches for the stable computation of hybrid BiCG methods, Peaks, plateaus, numerical instabilities in a Galerkin minimal residual pair of methods for solving \(Ax=b\), Residual smoothing and peak/plateau behavior in Krylov subspace methods, A new family of preconditioned iterative solvers for nonsymmetric linear systems, Design of an iterative solution module for a parallel sparse matrix library (P\_SPARSLIB), On the performance of parallel waveform relaxations for differential systems, Numerical methods and software for sensitivity analysis of differential-algebraic systems, A comparison of preconditioners in the solution of parabolic systems in three space dimensions using DASPK and a high order finite element method, Computing spacetime curvature via differential algebraic equations, Conjugate gradient methods for continuation problems. II, Iterative methods for solving \(Ax=b\), GMRES/FOM versus QMR/BiCG, Additive multilevel preconditioners based on bilinear interpolation, matrix-dependent geometric coarsening and algebraic multigrid coarsening for second-order elliptic PDEs, Microstructural evolution in inhomogeneous elastic media, An element-by-element BICGSTAB iterative method for three-dimensional steady Navier-Stokes equations, The use of the CADNA library for validating the numerical results of the hybrid GMRES algorithm, Parallel implementation of BVM methods, On the use of conjugate gradient-type methods for boundary integral equations, On the numerical solution of the biharmonic equation in the plane, Numerical solution of differential-algebraic equations in mechanical systems simulation, Preconditioned Newton methods using incremental unknowns methods for the resolution of a steady-state Navier-Stokes-like problem, Numerical continuation and the Gelfand problem, A convergence result for a parallel algorithm for solving the Navier-Stokes equations, Pointwise control of Burgers' equation -- a numerical approach, QMR: A quasi-minimal residual method for non-Hermitian linear systems, A parallel preconditioned conjugate gradient package for solving sparse linear systems on a Cray Y-MP, Solution of nonlinear Poisson-type equations, Efficient implementation of minimal polynomial and reduced rank extrapolation methods, A comparison of some GMRES-like methods, Conjugate gradient methods for continuation problems, Preconditioning second-order elliptic operators: Condition numbers and the distribution of the singular values, Krylov-subspace methods for the Sylvester equation, Quasi-kernel polynomials and their use in non-Hermitian matrix iterations, Effective numerical algorithms for the solution of algebraic systems arising in spectral methods, Towards a cost-effective ILU preconditioner with high level fill, On the implementation of the GMRES \((m)\) method to elliptic equations in meteorology, A cost comparison of boundary element and finite element methods for problems of time-harmonic acoustics, A globally convergent matrix-free algorithm for implicit time-marching schemes arising in finite element analysis in fluids, Penalty finite element analysis of incompressible flows using element by element solution algorithms, A new mixed preconditioning method for finite element computations, A data parallel finite element method for computational fluid dynamics on the Connection Machine system, An adaptive method for solving nonsymmetric linear systems involving applications of SCPACK, Equilibrium attractivity of Krylov-\(W\)-methods for nonlinear stiff ODEs, On boundary-hybrid finite element methods for the Laplace equation, 3D computation of unsteady flow past a sphere with a parallel finite element method, Multigrid strategies for viscous flow solvers on anisotropic unstructured meshes, Rapid parallel evaluation of integrals in potential theory on general three-dimensional regions, Minimum residual methods for augmented systems, Krylov methods for solving models with forward-looking variables, Krylov sequences of maximal length and convergence of GMRES, A framework for polynomial preconditioners based on fast transforms. II: PDE applications, Finite difference schemes and block Rayleigh quotient iteration for electronic structure calculations on composite grids, Computing flows on general three-dimensional nonsmooth staggered grids, A multilevel iterative field solver for implicit, kinetic, plasma simulation, On performance of methods with third- and fifth-order compact upwind differencing, Comparison of different Krylov subspace methods embedded in an implicit finite volume scheme for the computation of viscous and inviscid flow fields on unstructured grids, On IGMRES: An incomplete generalized minimal residual method for large unsymmetric linear systems, An improved convection scheme applied to recombining divertor plasma flows, Efficient iterative solution of the three-dimensional Helmholtz equation, Acceleration and stabilization properties of minimal residual smoothing technique in multigrid, A new implementation of EN method, Two-grid analysis of minimal residual smoothing as a multigrid acceleration technique, VML: a class of virtual multi-level iterative methods for solving partial differential equations, SOR as a preconditioner. II, Numerical experiments with Krylov integrators, Discrete QMR and BCG in the numerical solution of linear systems of ODEs, Penalty methods for American options with stochastic volatility, Smoothing iterative block methods for linear systems with multiple right-hand sides, On the stable implementation of the generalized minimal error method, Vector sequence transformations: Methodology and applications to linear systems, Efficient iterative solution of constrained finite element analyses, Preconditioning by approximations of the Gram matrix for convection-diffusion equations, The effects of inexact solvers in algorithms for symmetric eigenvalue problems, Three-dimensional stability analysis of free surface flows: Application to forward deformable roll coating, Multigrid methods for incompressible heat flow problems with an unknown interface, A multigrid Newton-Krylov method for multimaterial equilibrium radiation diffusion, An efficient preconditioned CG method for the solution of a class of layered problems with extreme contrasts in the coefficients, Computation of incompressible flows with implicit finite element implementations on the Connection Machine, A minimal residual class of algorithms for linear systems, An efficient implementation of certain iterative refinement preconditioners, Using program package NSPCG to analyze the trunk reservation service protection method, A Krylov multisplitting algorithm for solving linear systems of equations, The superlinear convergence behaviour of GMRES, Experiments with Krylov subspace methods on a massively parallel computer, Subspace projection variants on Newton's method, Preconditioned iterative methods for sparse linear algebra problems arising in circuit simulation, A stopping criterion for classical iterative methods in inexact affine- invariant Newton techniques, A hybrid Arnoldi-Faber iterative method for nonsymmetric systems of linear equations, Preconditioning \(P_ 1\) conforming finite elements: Condition numbers and singular value distributions, Vectorizing matrix operations arising from PDE discretization on 9-point stencils, Approximation of parabolic problems on grids locally refined in time and space, Numerical solution of large nonsymmetric eigenvalue problems, Domain decomposition methods for the parallel computation of reacting flows, An overview of NSPCG: A nonsymmetric preconditioned conjugate gradient package, Implementations of the GMRES method, A composite step bi-conjugate gradient algorithm for nonsymmetric linear systems, BiCGstab(\(l\)) and other hybrid Bi-CG methods, Deflated Krylov subspace methods for nearly singular linear systems, Application of direct methods to solve difference problems of physics of gas discharge physics, Removing the stiffness from interfacial flows with surface tension, A Petrov-Galerkin spectral element technique for heterogeneous porous media flow, Region-dependent optimal \(m\)-stage Runge-Kutta schemes for solving a class of nonsymmetric linear systems, On the squared unsymmetric Lanczos method, Preconditioning techniques for the Newton-Krylov solution of compressible flows, Simple algorithm for solving linear integrodifferential equations with variable limits, Breakdowns and stagnation in iterative methods, A preconditioning strategy for the solution of linear boundary element systems using the GMRES method, Hybrid vector transformations, Minimal residual smoothing in multi-level iterative method, A div-curl-grad formulation for compressible buoyant flows solved by the least-squares finite element method, On the numerical solution of the three-dimensional semiconductor device equations on vector-concurrent computers