Geometric interpretation of some Cauchy related methods
For solving systems of linear equations \(Qz = b\) with a symmetric and positive definite matrix \(Q\), a class of iterative methods of the type \(x_{n+1} = x_n + 2 \alpha_n r_n + \alpha_n^2 Q r_n\) with \(r_n = Qx_n - b\) is considered. The real number \(\alpha_n\) is computed from \(x_0, x_1, \dots x_n\), \(Q\), and \(b\). This class includes the Cauchy-Barzilai-Borwein (CBB) method, presented by \textit{M.~Raydan} and \textit{B.~F.~Svaiter} [Comput. Optim. Appl. 21, No. 2, 155--167 (2002; Zbl 0988.90049)] which combines the Cauchy method (steepest descent method) and the Barzilai-Borwein method [see \textit{J.~Barzilai} and \textit{J.~M.~Borwein}, IMA J. Numer. Anal. 8, No. 1, 141--148 (1988; Zbl 0638.65055)]. A geometric interpretation of this class of iterative methods with the help of Bézier parabolas is given. This is used to localize the iterates of the Cauchy, the CBB, and the RBB methods in the plane of the Bézier parabola, where RBB is a combination of the classical Richardson and the Barzilai-Borwein methods. This localization gives some insight into the baviour of these methods. Finally, numerical examples are presented to compare the behaviour of the different methods.
- Geometric methods in rational interpolation theory
- scientific article; zbMATH DE number 2164713
- scientific article; zbMATH DE number 4002462
- scientific article; zbMATH DE number 1944653
- Geometric methods in partial differential equations
- scientific article; zbMATH DE number 1433473
- scientific article; zbMATH DE number 5582918
- The geometric basis of numerical methods
- scientific article; zbMATH DE number 1166337
- Linear Methods in Geometric Function Theory
- Acceleration schemes with application to the EM algorithm
- Gradient Method with Retards and Generalizations
- scientific article; zbMATH DE number 3257775 (Why is no real title available?)
- Hybrid procedures for solving linear systems
- New iterative schemes for nonlinear fixed point problems, with applications to problems with bifurcations and incomplete-data problems
- On the Barzilai and Borwein choice of steplength for the gradient method
- Relaxed steepest descent and Cauchy-Barzilai-Borwein method
- Squared polynomial extrapolation methods with cycling: an application to the positron emission tomography problem
- Two-Point Step Size Gradient Methods
This page was built for publication: Geometric interpretation of some Cauchy related methods
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q647366)
