Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search (Q662895)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search
scientific article

    Statements

    Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search (English)
    0 references
    0 references
    0 references
    13 February 2012
    0 references
    Based on the modified secant equation, the authors propose a modified Hestenes-Stiefel (HS) conjugate gradient method that has similar form as the CG-DESCENT method proposed by \textit{W. W. Hager} and \textit{H. Zhang} [SIAM J. Optim. 16, No. 1, 170--192 (2005; Zbl 1093.90085)]. The presented method can generate sufficient descent directions without any line search. Under some mild conditions, it is shown that the new method is globally convergent with Armijo line search. Moreover, the R-linear convergence rate of the modified HS method is established. Preliminary numerical results show that the proposed method is promising and competitive with the well-known CG-DESCENT method.
    0 references
    0 references
    unconstrained optimization
    0 references
    sufficient descent property
    0 references
    \(R\)-linear convergence
    0 references
    global convergence
    0 references
    secant equation
    0 references
    Hestenes-Stiefel conjugate gradient method
    0 references
    Armijo line search
    0 references
    numerical results
    0 references
    0 references
    0 references
    0 references