Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search (Q662895): Difference between revisions

Based on the modified secant equation, the authors propose a modified Hestenes-Stiefel (HS) conjugate gradient method that has similar form as the CG-DESCENT method proposed by \textit{W. W. Hager} and \textit{H. Zhang} [SIAM J. Optim. 16, No. 1, 170--192 (2005; Zbl 1093.90085)]. The presented method can generate sufficient descent directions without any line search. Under some mild conditions, it is shown that the new method is globally convergent with Armijo line search. Moreover, the R-linear convergence rate of the modified HS method is established. Preliminary numerical results show that the proposed method is promising and competitive with the well-known CG-DESCENT method.