The genesis and early developments of Aitken's process, Shanks' transformation, the \(\varepsilon\)-algorithm, and related fixed point methods

DOI10.1007/S11075-018-0567-2zbMath1477.65011OpenAlexW2888051195MaRDI QIDQ1710714

Michela Redivo-Zaglia, Claude Brezinski

Publication date: 23 January 2019

Published in: Numerical Algorithms (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s11075-018-0567-2

zbMATH Keywords

fixed pointsextrapolationAnderson accelerationMPEAitken's processepsilon-algorithmsMMPEPulay mixingRREShanks' transformations

Mathematics Subject Classification ID

Numerical computation of solutions to systems of equations (65H10) Extrapolation to the limit, deferred corrections (65B05) Iterative numerical methods for linear systems (65F10) History of numerical analysis (65-03) Numerical methods for difference equations (65Q10)

Related Items (16)

Geometrical inverse matrix approximation for least-squares problems and acceleration strategies ⋮ Convergence of a Constrained Vector Extrapolation Scheme ⋮ Generalizations of Shanks transformation and corresponding convergence acceleration algorithms via Pfaffians ⋮ On the kernel of vector \(\varepsilon \)-algorithm and related topics ⋮ Generalized discrete Lotka-Volterra equation, orthogonal polynomials and generalized epsilon algorithm ⋮ Acceleration of sequences with transformations involving hypergeometric functions ⋮ An application of a qd‐type discrete hungry Lotka–Volterra equation over finite fields to a decoding problem ⋮ Reuben Louis Rosenberg (1909--1986) and the Stein-Rosenberg theorem ⋮ Matrix completion with \(\varepsilon\)-algorithm. In memory of Peter Wynn (1931--2017) ⋮ Functions and eigenvectors of partially known matrices with applications to network analysis ⋮ A survey of Shanks' extrapolation methods and their applications ⋮ Construction of new generalizations of Wynn's epsilon and rho algorithm by solving finite difference equations in the transformation order ⋮ A novel iterative method for discrete Helmholtz decomposition ⋮ Some unusual results on extrapolation methods ⋮ On the Effectiveness of Richardson Extrapolation in Data Science ⋮ Extrapolation and prediction of sequences in a vector space

Uses Software

• Maple
• Matlab
• SQUAREM
• Anderson
• EPSfun
• ALGOL 60
• GRPIA

Cites Work

• On the Similarities Between the Quasi-Newton Inverse Least Squares Method and GMRes
• From qd to LR, or, how were the qd and LR algorithms discovered?
• Anderson Acceleration for Fixed-Point Iterations
• Convergence Acceleration Algorithm via an Equation Related to the Lattice Boussinesq Equation
• Confluent Form of the Multistep ɛ-Algorithm, and the Relevant Integrable System
• Accelerating convergence of iterative processes
• The Secant method for simultaneous nonlinear equations
• The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints
• Acceleration Techniques for Iterated Vector and Matrix Problems
• The g-Algorithm
• The $\varepsilon $-Algorithm and Padé-Approximants in Operator Theory
• Exact Solution of the Korteweg—de Vries Equation for Multiple Collisions of Solitons
• Cross rules and non-Abelian lattice equations for the discrete and confluent non-scalar ε-algorithms
• Méthodes de projection-minimisation pour les problèmes linéaires
• Weakly convergent expansions of a plane wave and their use in Fourier integrals
• Acceleration of Convergence of Vector Sequences
• GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
• Convergence and Stability Properties of Minimal Polynomial and Reduced Rank Extrapolation Algorithms
• Extrapolation Methods for Vector Sequences
• An Algorithm for a Generalization of the Richardson Extrapolation Process
• Implementation of the Topological $\varepsilon $-Algorithm
• CGS, A Fast Lanczos-Type Solver for Nonsymmetric Linear systems
• Some History of the Conjugate Gradient and Lanczos Algorithms: 1948–1976
• Computation of the periodic steady-state response of nonlinear networks by extrapolation methods
• Acceleration of the convergence of iterative processes and a method of solving systems of non-linear equations
• On the Rates of Convergence of the Lanczos and the Block-Lanczos Methods
• Variable Metric Method for Minimization
• The Solution of Systems of Equations Using the ε-Algorithm, and an Application to Boundary-Value Problems
• On the Convergence and Stability of the Epsilon Algorithm
• A Polynomial Extrapolation Method for Finding Limits and Antilimits of Vector Sequences
• Generalized neville type extrapolation schemes
• Nonlinear hybrid procedures and fixed point iterations
• The Toda molecule equation and the 𝜖-algorithm
• Stabilité de la conjecture de Baum—Connes pour certains produits semi-directs de groupes
• Practical Extrapolation Methods
• XII.—Further Numerical Studies in Algebraic Equations and Matrices
• Shanks Sequence Transformations and Anderson Acceleration
• Vector Extrapolation Methods with Applications
• Higher order recurrences and row sequences of Hermite–Padé approximation
• Multiparameter Iterative Schemes for the Solution of Systems of Linear and Nonlinear Equations
• Brève communication. Transformations de suites
• A Characterization of Superlinear Convergence and Its Application to Quasi-Newton Methods
• Some properties of the recursive projection and interpolation algorithms
• Cross rules of some extrapolation algorithms
• LU implementation of the modified minimal polynomial extrapolation method for solving linear and nonlinear systems
• Extrapolation methods for fixed‐point multilinear PageRank computations
• Remark Concerning a Non‐Linear Sequence‐to‐Sequence Transform
• A Class of Methods for Solving Nonlinear Simultaneous Equations
• A Rapidly Convergent Descent Method for Minimization
• Function minimization by conjugate gradients
• Convergence of Multipoint Iterative Methods
• Scientific Computing - An Introduction using Maple and MATLAB
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Iterative Procedures for Nonlinear Integral Equations
• Estimates for Some Computational Techniques in Linear Algebra
• Obituary: A. C. Aitken, D.Sc, F.R.S.
• Derivative-Free Iteration Processes
• The use of badly converging iterative processes for the solution of sets of linear equations
• Accelerating the Convergence of Matrix Iterative Processes
• Survey of Extrapolation Processes in Numerical Analysis
• Higher OrderG-Transformation
• The Padé Table and Its Relation to Certain Algorithms of Numerical Analysis
• On the Solution of Systems of Equations by the Epsilon Algorithm of Wynn
• An Algorithm for the Computation of the Higher OrderG-Transformation
• Prony’s Method,Z-Transforms, and Padé Approximation
• Upon A Second Confluent Form of the Ɛ-Algorithm
• Singular rules for certain non-linear algorithms
• The principle of minimized iterations in the solution of the matrix eigenvalue problem
• Verbesserung einer Iterationsfolge bei Gleichungssystemen
• Solving linear algebraic equations can be interesting
• A Convergent Iterative Process
• On a Device for Computing the e m (S n ) Transformation
• Convergence acceleration during the 20th century
• The discrete relativistic Toda molecule equation and a Padé approximation algorithm
• On condition numbers of the Shanks transformation
• The vector epsilon algorithm -- a residual approach
• On the vector \(\varepsilon\)-algorithm for solving linear systems of equations
• Recursive interpolation algorithm: A formalism for solving systems of linear equations. I: Direct methods
• Recursive interpolation algorithm: A formalism for solving systems of linear equations. II: Iterative methods
• Block extrapolation methods with applications
• The early history of convergence acceleration methods
• Geometric approach to the parallel sum of vectors and application to the vector \(\varepsilon \)-algorithm
• The simplified topological \(\varepsilon\)-algorithms: software and applications
• Vector orthogonal relations. Vector QD-algorithm
• Recursive interpolation, extrapolation and projection
• Vector valued rational interpolants. I
• An analysis for the DIIS acceleration method used in quantum chemistry calculations
• Quasilinear vector extrapolation methods
• The quadratic convergence of the topological epsilon algorithm for systems of nonlinear equations
• Aitken's and Steffensen's accelerations in several variables
• Application of vector extrapolation methods to consistent singular linear systems
• Padé-type approximation and general orthogonal polynomials
• On the propagation of error in certain non-linear algorithms
• Confluent forms of certain non-linear algorithms
• A note on a confluent form of the \(\varepsilon\)-algorithm
• Sequences of transformations and triangular recursion schemes, with applications in numerical analysis
• Sequence transformations and their applications
• The Steffensen iteration method for systems of nonlinear equations
• Acceleration of extended Fibonacci sequences
• An extended cross rule for vector Padé approximants
• The epsilon algorithm in a noncommutative algebra
• A new proof of the cross-rule for the \(\epsilon\)-algorithm based on Schur-complements
• Laplace transform inversion and Padé-type approximants
• Convergence and stability analyses for some vector extrapolation methods in the presence of defective iteration matrices
• Extrapolation vs. projection methods for linear systems of equations
• Recursive algorithms for vector extrapolation methods
• Other manifestations of the Schur complement
• Matrix recursive interpolation algorithm for block linear systems: Direct methods
• Résultats négatifs en accélération de la convergence
• A general extrapolation algorithm
• Convergence acceleration of non-scalar sequences with non-linear transformations
• Acceleration by aggregation of successive approximation methods
• Methods of aggregation
• The epsilon-algorithm and multivariate Padé-approximants
• Efficient implementation of minimal polynomial and reduced rank extrapolation methods
• Some results about vector extrapolation methods and related fixed-point iterations
• Extrapolation methods theory and practice
• Shanks's transformation revisited
• Extrapolation methods for vector sequences
• Vereinfachte Rekursionen zur Richardson-Extrapolation in Spezialfällen
• Lower estimates for the error of best uniform approximation
• Particular rules for the vector \(\varepsilon\)-algorithm
• Généralisations de la transformation de Shanks, de la table de Padé et de l'\(\varepsilon\)-algorithme
• Convergence acceleration for the iterative solution of the equations X = AX + f
• Accélération de la convergence en analyse numérique
• About Henrici's transformation for accelerating vector sequences
• The rise and fall of the vector epsilon algorithm
• Matrix recursive projection and interpolation algorithms
• Non-commutative extrapolation algorithms
• From matrix to vector Padé approximants
• Analysis of some vector extrapolation methods for solving systems of linear equations
• Matrix extrapolation algorithms
• Projection methods for systems of equations
• The epsilon algorithm and related topics
• Vector extrapolation methods. Applications and numerical comparison
• Iterative solution of linear systems in the 20th century
• Historical developments in convergence analysis for Newton's and Newton-like methods
• Recursive polynomial interpolation algorithm (RPIA)
• Obituary: Reminiscences of Peter Wynn
• Comments on: ``Anderson acceleration, mixing and extrapolation
• GRPIA: a new algorithm for computing interpolation polynomials
• A new integrable convergence acceleration algorithm for computing Brezinski-Durbin-Redivo-Zaglia's sequence transformation via Pfaffians
• The Schur complement and its applications
• A general projection algorithm for solving systems of linear equations
• Vector-valued, rational interpolants. III
• Shanks' convergence acceleration transform, Padé approximants and partitions
• Forme confluente de l'\(\varepsilon\)-algorithme topologique
• Upon some continuous prediction algorithms. II
• Computational aspects of linear control
• Pseudo-Schur complements and their properties
• Some Schur complement identities and applications to matrix extrapolation methods
• A new approach to acceleration of convergence of a sequence of vectors
• An algebraic approach to the vector \(\varepsilon\)-algorithm
• The generalizations of Newton's interpolation formula due to Mühlbach and Andoyer
• Discrete soliton equations and convergence acceleration algorithms
• Least-square acceleration of iterative methods for linear equations
• Some results in the theory of the vector \(\varepsilon\)-algorithm
• Shifted and extrapolated power methods for tensor \(\ell^p\)-eigenpairs
• Minimal polynomial and reduced rank extrapolation methods are related
• Integrable lattices and convergence acceleration algorithms
• Shanks function transformations in a vector space
• Chiò's and Dodgson's determinantal identities
• Matrix polynomial and epsilon-type extrapolation methods with applications
• A generalized inverse \(\epsilon\)-algorithm for constructing intersection projection matrices, with applications
• Upon systems of recursions which obtain among the quotients of the Padé table
• The \(\delta^ 2\)-process and related topies
• Le trasformazioni razionali di una successione
• A note on the \(\epsilon\)-algorithm
• Partial differential equations associated with certain non-linear algorithms
• Invariants associated with the epsilon algorithm and its first confluent form
• New iterative schemes for nonlinear fixed point problems, with applications to problems with bifurcations and incomplete-data problems
• General purpose vector epsilon algorithm ALGOL procedures
• Continued fractions whose coefficients obey a non-commutative law of multiplication
• Ein infinitesimales Analogon zum Quotienten-Differenzen-Algorithmus
• Anwendungen des Quotienten-Differenzen-Algorithmus
• The discrete Lotka-Volterra system computes singular values
• Multistep $𝜖$–algorithm, Shanks’ transformation, and the Lotka–Volterra system by Hirota’s method
• The Simplified Topological $\varepsilon$-Algorithms for Accelerating Sequences in a Vector Space
• Two classes of multisecant methods for nonlinear acceleration

This page was built for publication: The genesis and early developments of Aitken's process, Shanks' transformation, the \(\varepsilon\)-algorithm, and related fixed point methods