The accuracy of least squares calculations with the Cholesky algorithm (Q911243)
From MaRDI portal
scientific article
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | The accuracy of least squares calculations with the Cholesky algorithm |
scientific article |
Statements
The accuracy of least squares calculations with the Cholesky algorithm (English)
0 references
1990
0 references
An extensive study is made of the accuracy with which the Cholesky (or square root) method computes the solution to the normal equation of least squares. The influence of scaling and centering in the polynomial regression model on accuracy of estimation is investigated. It is demonstrated using computer evaluations that scaling does not improve the accuracy. It is shown that loss of accuracy with the Cholesky method is traceable directly to cancellation of common leading digits in subtraction. The double Cholesky algorithm with appropriate centering is proposed and investigated too. Simple formulas for prediction accuracy from the maximum variance inflation factor are evaluated, methods which are improved accuracy are discussed.
0 references
Cholesky algorithm
0 references
least squares method
0 references
ill-conditioned linear systems
0 references
computer errors
0 references
accuracy
0 references
normal equation
0 references
scaling
0 references
centering
0 references
polynomial regression model
0 references
maximum variance inflation factor
0 references
0 references
0 references
0 references
