A relation between Newton and Gauss-Newton steps for singular nonlinear equations (Q1090072)

The Gauss-Newton step belonging to an appropriately chosen bordered nonlinear system is analyzed. It is proved that the Gauss-Newton step calculated after a sequence of Newton steps is equal to the doubled Newton step within the accuracy of \(O(\| x-x^ *\| ^ 2)\). The theoretical insight given by the proof can be exploited to derive a Gauss-Newton-like algorithm for the solution of singular equations.