Some History of the Conjugate Gradient and Lanczos Algorithms: 1948–1976

DOI10.1137/1031003zbMath0673.65017OpenAlexW1986914969MaRDI QIDQ3827469

Dianne P. O'Leary, Gene H. Golub

Publication date: 1989

Published in: SIAM Review (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/1031003

zbMATH Keywords

surveypreconditioningeigenvalue problemsLanczos algorithmmatrix splittingsconjugate gradient algorithms1948-1976National Applied Mathematics Laboratories

Mathematics Subject Classification ID

Numerical computation of eigenvalues and eigenvectors of matrices (65F15) Numerical computation of solutions to systems of equations (65H10) Development of contemporary mathematics (01A65) Iterative numerical methods for linear systems (65F10) History of numerical analysis (65-03)

Related Items (47)

Regularization properties of Krylov iterative solvers CGME and LSMR for linear discrete ill-posed problems with an application to truncated randomized SVDs ⋮ The Optimization Landscape for Fitting a Rank-2 Tensor with a Rank-1 Tensor ⋮ Look-ahead in Bi-CGSTAB and other product methods for linear systems ⋮ Breakdowns and stagnation in iterative methods ⋮ An application of the discrete-time Toda lattice to the progressive algorithm by Lanczos and related problems ⋮ Determination of eigenstates via Lanczos-based forward substitution and filter- diagonalization ⋮ A theoretical overview of Krylov subspace methods ⋮ Efficient approximate solution of sparse linear systems ⋮ On conjugate gradient-like methods for eigen-like problems ⋮ Another conjugate gradient algorithm with guaranteed descent and conjugacy conditions for large-scale unconstrained optimization ⋮ Explicit approximate inverse preconditioning techniques ⋮ A modified steepest descent method for solving non-smooth inverse problems ⋮ Stability of the Lanczos algorithm on matrices with regular spectral distributions ⋮ The genesis and early developments of Aitken's process, Shanks' transformation, the \(\varepsilon\)-algorithm, and related fixed point methods ⋮ Analysis of preconditioners for conjugate gradients through distribution of eigenvalues ⋮ Jacobian-free Newton-Krylov methods: a survey of approaches and applications. ⋮ Saddle point methods, and alogorithms, for non-symmetric linear equations^∗ ⋮ A convergence analysis of a method of steepest descent and a two–step algorothm for nonlinear ill–posed problems ⋮ An augmented analysis of the perturbed two-sided Lanczos tridiagonalization process ⋮ Periodically preconditioned conjugate gradient-restoration algorithm ⋮ Quadratically constrained least squares and quadratic problems ⋮ Convergence rate results for steepest descent type method for nonlinear ill-posed equations ⋮ Partitioned multiply scaled pseudo conjugate gradient schemes ⋮ Breakdowns in the implementation of the Lánczos method for solving linear systems ⋮ Scaled conjugate gradient algorithms for unconstrained optimization ⋮ An incomplete inverse as a preconditioner for the conjugate gradient method ⋮ On IOM(q): The Incomplete Orthogonalization Method for Large Unsymmetric Linear Systems ⋮ Box spline interpolation; a computational study ⋮ Milestones in the development of iterative solution methods ⋮ A class of iterative methods of conjugate gradient type ⋮ Towards understanding CG and GMRES through examples ⋮ Wavelet preconditioned Newton-Krylov method for elastohydrodynamic lubrication of line contact problems ⋮ Acceleration of sequential subspace optimization in Banach spaces by orthogonal search directions ⋮ An efficient implementation of the ensemble Kalman filter based on an iterative Sherman-Morrison formula ⋮ Lanczos-type algorithms for solving systems of linear equations ⋮ Enlarged Krylov Subspace Conjugate Gradient Methods for Reducing Communication ⋮ Equivalent operator preconditioning for elliptic problems ⋮ Pipelined, Flexible Krylov Subspace Methods ⋮ Approximation accuracy of the Krylov subspaces for linear discrete ill-posed problems ⋮ Algorithmic optimizations of a conjugate gradient solver on shared memory architectures ⋮ Preconditioned Barzilai-Borwein method for the numerical solution of partial differential equations ⋮ Iterative methods for linear systems of equations: A brief historical journey ⋮ Unnamed Item ⋮ Superlinear Convergence of Krylov Subspace Methods for Self-Adjoint Problems in Hilbert Space ⋮ Iterative solution of linear systems in the 20th century ⋮ A parallel alternating direction implicit preconditioning method ⋮ Preconditioning techniques for large linear systems: A survey

This page was built for publication: Some History of the Conjugate Gradient and Lanczos Algorithms: 1948–1976