Global Convergence Properties of Conjugate Gradient Methods for Optimization

DOI10.1137/0802003zbMath0767.90082DBLPjournals/siamjo/GilbertN92OpenAlexW2108560279WikidataQ94867071 ScholiaQ94867071MaRDI QIDQ4018383

Nocedal, Jorge, Gilbert, Jean Charles

Publication date: 16 January 1993

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/0802003

zbMATH Keywords

unconstrained optimizationglobal convergencenonlinear conjugate gradient methodsconvergence properties

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Methods of reduced gradient type (90C52) Computational methods for problems pertaining to operations research and mathematical programming (90-08)

Related Items (only showing first 100 items - show all)

The Hager–Zhang conjugate gradient algorithm for large-scale nonlinear equations ⋮ Some new three-term Hestenes–Stiefel conjugate gradient methods with affine combination ⋮ Global convergence of a new sufficient descent spectral three-term conjugate gradient class for large-scale optimization ⋮ Riemannian Conjugate Gradient Methods: General Framework and Specific Algorithms with Convergence Analyses ⋮ A family of hybrid conjugate gradient methods for unconstrained optimization ⋮ A modified conjugate gradient method based on a modified secant equation ⋮ Convergence conditions, line search algorithms and trust region implementations for the Polak–Ribière conjugate gradient method ⋮ A derivative-free three-term Hestenes–Stiefel type method for constrained nonlinear equations and image restoration ⋮ Technical Note—A Monge Sequence-Based Approach to Characterize the Competitive Newsvendor Problem ⋮ Globally convergence of nonlinear conjugate gradient method for unconstrained optimization ⋮ A new black box method for monotone nonlinear equations ⋮ Unnamed Item ⋮ An accelerated descent CG algorithm with clustering the eigenvalues for large-scale nonconvex unconstrained optimization and its application in image restoration problems ⋮ A nonlinear conjugate gradient method using inexact first-order information ⋮ An Accelerated Three-Term Extension of a Descent Nonlinear Conjugate Gradient Method ⋮ A mini-batch stochastic conjugate gradient algorithm with variance reduction ⋮ Two diagonal conjugate gradient like methods for unconstrained optimization ⋮ A truncated three-term conjugate gradient method with complexity guarantees with applications to nonconvex regression problem ⋮ A modified four-term extension of the Dai-Liao conjugate gradient method ⋮ A three-term conjugate gradient algorithm with restart procedure to solve image restoration problems ⋮ A modified PRP-type conjugate gradient algorithm with complexity analysis and its application to image restoration problems ⋮ Accelerated sparse recovery via gradient descent with nonlinear conjugate gradient momentum ⋮ Nonmonotone quasi-Newton-based conjugate gradient methods with application to signal processing ⋮ Modified globally convergent Polak-Ribière-Polyak conjugate gradient methods with self-correcting property for large-scale unconstrained optimization ⋮ A nonlinear conjugate gradient method with complexity guarantees and its application to nonconvex regression ⋮ A comparison of edge-preserving approaches for differential interference contrast microscopy ⋮ A three-term conjugate gradient method with a random parameter for large-scale unconstrained optimization and its application in regression model ⋮ A family of the modified three-term Hestenes-Stiefel conjugate gradient method with sufficient descent and conjugacy conditions ⋮ On the convergence rate of Fletcher‐Reeves nonlinear conjugate gradient methods satisfying strong Wolfe conditions: Application to parameter identification in problems governed by general dynamics ⋮ A family of gradient methods using Householder transformation with application to hypergraph partitioning ⋮ A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems ⋮ A restart scheme for the memoryless BFGS method ⋮ A hybrid HS-LS conjugate gradient algorithm for unconstrained optimization with applications in motion control and image recovery ⋮ Globally convergent conjugate gradient algorithms without the Lipschitz condition for nonconvex optimization ⋮ A descent family of the spectral Hestenes–Stiefel method by considering the quasi-Newton method ⋮ Global convergence properties of the BBB conjugate gradient method ⋮ A non-linear conjugate gradient in dual space for \(L_p\)-norm regularized non-linear least squares with application in data assimilation ⋮ An overview of nonlinear optimization ⋮ Unnamed Item ⋮ A modified Hestenes–Stiefel conjugate gradient method with an optimal property ⋮ An efficient adaptive three-term extension of the Hestenes–Stiefel conjugate gradient method ⋮ A New Dai-Liao Conjugate Gradient Method with Optimal Parameter Choice ⋮ A modified Hestense–Stiefel conjugate gradient method close to the memoryless BFGS quasi-Newton method ⋮ A modified conjugate gradient algorithm with backtracking line search technique for large-scale nonlinear equations ⋮ Improving the Dai-Liao parameter choices using a fixed point equation ⋮ Nonsmooth Variants of Powell's BFGS Convergence Theorem ⋮ GLOBAL CONVERGENCE OF SHORTEST-RESIDUAL FAMILY OF CONJUGATE GRADIENT METHODS WITHOUT LINE SEARCH ⋮ Higher order curvature information and its application in a modified diagonal Secant method ⋮ A globally convergent gradient-like method based on the Armijo line search ⋮ An efficient hybrid conjugate gradient method for unconstrained optimization ⋮ Two fundamental convergence theorems for nonlinear conjugate gradient methods and their applications ⋮ Global convergence of the general three-term conjugate gradient methods with the relaxed strong Wolfe line-search ⋮ Modeling and control through leadership of a refined flocking system ⋮ A modified Polak–Ribi‘ere–Polyak descent method for unconstrained optimization ⋮ On the convergence properties of the unmodified PRP method with a non-descent line search ⋮ A derivative-free PRP method for solving large-scale nonlinear systems of equations and its global convergence ⋮ A descent family of Dai–Liao conjugate gradient methods ⋮ A new class of memory gradient methods with inexact line searches ⋮ REFLECTOR DESIGN FROM RADIANCE DISTRIBUTIONS ⋮ Global convergence of the DY conjugate gradient method with Armijo line search for unconstrained optimization problems ⋮ Some descent three-term conjugate gradient methods and their global convergence ⋮ The spherical quadratic steepest descent (SQSD) method for unconstrained minimization with no explicit line searches ⋮ A Two-Term PRP-Based Descent Method ⋮ An efficient conjugate direction method with orthogonalization for large-scale quadratic optimization problems ⋮ Minimax control problems of periodic competing parabolic systems with logistic growth terms ⋮ Global convergence property of \(s\)-dependent GFR conjugate gradient method ⋮ Nonlinear Conjugate Gradient Methods for Vector Optimization ⋮ Low cost optimization techniques for solving the nonlinear seismic reflection tomography problem ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Modified Hestenes-Steifel conjugate gradient coefficient for unconstrained optimization ⋮ Second-order adjoints for solving PDE-constrained optimization problems ⋮ A new efficient conjugate gradient method for unconstrained optimization ⋮ New hybrid conjugate gradient method as a convex combination of LS and CD methods ⋮ CALIBRATION OF LÉVY PROCESSES USING OPTIMAL CONTROL OF KOLMOGOROV EQUATIONS WITH PERIODIC BOUNDARY CONDITIONS ⋮ A Conjugate Gradient Method Based on a Modified Secant Relation for Unconstrained Optimization ⋮ Modelling and position control of voltage forced electromechanical actuator ⋮ Scaled memoryless BFGS preconditioned steepest descent method for very large-scale unconstrained optimization ⋮ A new classical conjugate gradient coefficient with exact line search ⋮ Unnamed Item ⋮ Two hybrid nonlinear conjugate gradient methods based on a modified secant equation ⋮ A new two-parameter family of nonlinear conjugate gradient methods ⋮ A NEW THREE–TERM CONJUGATE GRADIENT METHOD WITH DESCENT DIRECTION FOR UNCONSTRAINED OPTIMIZATION ⋮ A one-parameter class of three-term conjugate gradient methods with an adaptive parameter choice ⋮ Regularization tools for training large feed-forward neural networks using automatic differentiation^∗ ⋮ An Efficient Hybrid Conjugate Gradient Method for Unconstrained Optimisation ⋮ Eigenvalues versus singular values study in conjugate gradient algorithms for large-scale unconstrained optimization ⋮ A new class of nonlinear conjugate gradient coefficients for unconstrained optimization ⋮ Free terminal time optimal control problem of an HIV model based on a conjugate gradient method ⋮ An efficient modification of the Hestenes-Stiefel nonlinear conjugate gradient method with restart property ⋮ Multigrid optimization methods for the optimal control of convection-diffusion problems with bilinear control ⋮ Some modified conjugate gradient methods for unconstrained optimization ⋮ New hybrid conjugate gradient method for unconstrained optimization ⋮ Spectral method and its application to the conjugate gradient method ⋮ An optimal parameter for Dai-Liao family of conjugate gradient methods ⋮ A modified PRP conjugate gradient algorithm with nonmonotone line search for nonsmooth convex optimization problems ⋮ A Polak-Ribière-Polyak method for solving large-scale nonlinear systems of equations and its global convergence ⋮ A novel variational algorithmic formulation for wrinkling at finite strains based on energy minimization: application to mesh adaption ⋮ On the global convergence rate of the gradient descent method for functions with Hölder continuous gradients

This page was built for publication: Global Convergence Properties of Conjugate Gradient Methods for Optimization