Algebraic relations between the total least squares and least squares problems with more than one solution (Q1203413)

This paper completes our discussion on the total least squares (TLS) and the least squares (LS) problems for the linear system \(AX=B\) which may contain more than one solution. It generalizes the work of \textit{G. H. Golub} and \textit{C. F. Van Loan} [SIAM J. Numer. Analysis 17, 883-893 (1980; Zbl 0468.63011)], and of \textit{S. Van Huffel} and \textit{J. Vandewalle} [Numer. Math. 55, No. 4, 431-449 (1989; Zbl 0663.65038)]. The TLS problem is extended to a more general case. The sets of the solutions and the squared residuals for the TLS and LS problems are compared. The concept of the weighted squared residuals is extended and the difference between the TLS and the LS approaches is derived. The connection between the approximate subspaces and the perturbation theories are studied. It is proved that under some moderate conditions, all the corresponding quantities for the solution sets of the TLS and the modified LS problems are close to each other, while the quantities for the solution set of the LS problem are close to the corresponding ones of a subset of that of the TLS problem.