A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence
From MaRDI portal
Publication:3413523
DOI10.1093/imanum/drl016zbMath1106.65056OpenAlexW1978621794MaRDI QIDQ3413523
Weijun Zhou, Li Zhang, Dong-hui Li
Publication date: 12 December 2006
Published in: IMA Journal of Numerical Analysis (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1093/imanum/drl016
Numerical mathematical programming methods (65K05) Iterative numerical methods for linear systems (65F10) Methods of reduced gradient type (90C52)
Related Items
A conjugate gradient algorithm for large-scale unconstrained optimization problems and nonlinear equations ⋮ An accelerated three-term conjugate gradient method with sufficient descent condition and conjugacy condition ⋮ A self-adaptive three-term conjugate gradient method for monotone nonlinear equations with convex constraints ⋮ A modified PRP conjugate gradient algorithm with nonmonotone line search for nonsmooth convex optimization problems ⋮ A Polak-Ribière-Polyak method for solving large-scale nonlinear systems of equations and its global convergence ⋮ A family of three-term nonlinear conjugate gradient methods close to the memoryless BFGS method ⋮ Sufficient descent nonlinear conjugate gradient methods with conjugacy condition ⋮ A PRP-based residual method for large-scale monotone nonlinear equations ⋮ Convergence properties of a class of nonlinear conjugate gradient methods ⋮ Two accelerated nonmonotone adaptive trust region line search methods ⋮ A Barzilai-Borwein conjugate gradient method ⋮ Two extensions of the Dai-Liao method with sufficient descent property based on a penalization scheme ⋮ Modified nonlinear conjugate gradient method with sufficient descent condition for unconstrained optimization ⋮ A short note on the global convergence of the unmodified PRP method ⋮ An improved spectral conjugate gradient algorithm for nonconvex unconstrained optimization problems ⋮ Two derivative-free projection approaches for systems of large-scale nonlinear monotone equations ⋮ A self-adjusting spectral conjugate gradient method for large-scale unconstrained optimization ⋮ New spectral PRP conjugate gradient method for unconstrained optimization ⋮ The convergence rate of a restart MFR conjugate gradient method with inexact line search ⋮ A simple sufficient descent method for unconstrained optimization ⋮ An active set modified Polak-Ribiére-Polyak method for large-scale nonlinear bound constrained optimization ⋮ A new descent memory gradient method and its global convergence ⋮ Nonmonotone spectral method for large-scale symmetric nonlinear equations ⋮ Global convergence of a nonlinear conjugate gradient method ⋮ Global convergence of a modified spectral conjugate gradient method ⋮ Conjugate gradient type methods for the nondifferentiable convex minimization ⋮ A new conjugate gradient algorithm for training neural networks based on a modified secant equation ⋮ Three-term conjugate gradient method for the convex optimization problem over the fixed point set of a nonexpansive mapping ⋮ \(n\)-step quadratic convergence of the MPRP method with a restart strategy ⋮ Globally convergent three-term conjugate gradient methods that use secant conditions and generate descent search directions for unconstrained optimization ⋮ The global convergence of a new mixed conjugate gradient method for unconstrained optimization ⋮ Comments on: ``A family of derivative-free conjugate gradient methods for large-scale nonlinear systems of equations ⋮ Global convergence of some modified PRP nonlinear conjugate gradient methods ⋮ A new conjugate gradient method based on quasi-Newton equation for unconstrained optimization ⋮ An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints ⋮ An improved three-term derivative-free method for solving nonlinear equations ⋮ An accelerated subspace minimization three-term conjugate gradient algorithm for unconstrained optimization ⋮ A modified scaled memoryless BFGS preconditioned conjugate gradient algorithm for nonsmooth convex optimization ⋮ Two modified three-term type conjugate gradient methods and their global convergence for unconstrained optimization ⋮ Two minimal positive bases based direct search conjugate gradient methods for computationally expensive functions ⋮ A conjugate gradient algorithm under Yuan-Wei-Lu line search technique for large-scale minimization optimization models ⋮ A three-term conjugate gradient algorithm with quadratic convergence for unconstrained optimization problems ⋮ Sufficient descent Polak-Ribière-Polyak conjugate gradient algorithm for large-scale box-constrained optimization ⋮ A new modified three-term Hestenes-Stiefel conjugate gradient method with sufficient descent property and its global convergence ⋮ On the strong convergence of a sufficient descent Polak-Ribière-Polyak conjugate gradient method ⋮ A globally convergent matrix-free method for constrained equations and its linear convergence rate ⋮ A new method with sufficient descent property for unconstrained optimization ⋮ New hybrid conjugate gradient and Broyden-Fletcher-Goldfarb-Shanno conjugate gradient methods ⋮ Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search ⋮ A new class of conjugate gradient methods for unconstrained smooth optimization and absolute value equations ⋮ New version of the three-term conjugate gradient method based on spectral scaling conjugacy condition that generates descent search direction ⋮ FR type methods for systems of large-scale nonlinear monotone equations ⋮ A new class of nonmonotone conjugate gradient training algorithms ⋮ A modified Perry's conjugate gradient method-based derivative-free method for solving large-scale nonlinear monotone equations ⋮ Norm descent conjugate gradient methods for solving symmetric nonlinear equations ⋮ Some nonlinear conjugate gradient methods with sufficient descent condition and global convergence ⋮ A limited memory descent Perry conjugate gradient method ⋮ Identification of random dynamic force using an improved maximum entropy regularization combined with a novel conjugate gradient ⋮ A derivative-free conjugate gradient method and its global convergence for solving symmetric nonlinear equations ⋮ A modified three-term PRP conjugate gradient algorithm for optimization models ⋮ Conjugate gradient methods using value of objective function for unconstrained optimization ⋮ A modified three-term conjugate gradient method with sufficient descent property ⋮ A conjugate gradient method for unconstrained optimization problems ⋮ A modified CG-DESCENT method for unconstrained optimization ⋮ A globally convergent derivative-free method for solving large-scale nonlinear monotone equations ⋮ A new hybrid PRPFR conjugate gradient method for solving nonlinear monotone equations and image restoration problems ⋮ A modified three-term type CD conjugate gradient algorithm for unconstrained optimization problems ⋮ A scaled three-term conjugate gradient method for large-scale unconstrained optimization problem ⋮ A conjugate gradient algorithm for large-scale nonlinear equations and image restoration problems ⋮ Some nonlinear conjugate gradient methods based on spectral scaling secant equations ⋮ A new globalization technique for nonlinear conjugate gradient methods for nonconvex minimization ⋮ A hybridization of the Polak-Ribière-Polyak and Fletcher-Reeves conjugate gradient methods ⋮ Some three-term conjugate gradient methods with the inexact line search condition ⋮ A norm descent derivative-free algorithm for solving large-scale nonlinear symmetric equations ⋮ On three-term conjugate gradient algorithms for unconstrained optimization ⋮ A new three-term conjugate gradient algorithm for unconstrained optimization ⋮ Scaled three-term derivative-free methods for solving large-scale nonlinear monotone equations ⋮ A conjugate gradient method with descent direction for unconstrained optimization ⋮ Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems ⋮ A new Liu-Storey type nonlinear conjugate gradient method for unconstrained optimization problems ⋮ A spectral three-term Hestenes-Stiefel conjugate gradient method ⋮ A limited memory BFGS-type method for large-scale unconstrained optimization ⋮ A nonmonotone supermemory gradient algorithm for unconstrained optimization ⋮ A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications ⋮ Two modified Dai-Yuan nonlinear conjugate gradient methods ⋮ A conjugate gradient method with sufficient descent property ⋮ A new descent spectral Polak-Ribière-Polyak method based on the memoryless BFGS update ⋮ A modified PRP conjugate gradient method ⋮ Descent three-term DY-type conjugate gradient methods for constrained monotone equations with application ⋮ A conjugate gradient algorithm and its application in large-scale optimization problems and image restoration ⋮ Solving unconstrained optimization problems via hybrid CD-DY conjugate gradient methods with applications ⋮ Least-squares-based three-term conjugate gradient methods ⋮ A \(q\)-Polak-Ribière-Polyak conjugate gradient algorithm for unconstrained optimization problems ⋮ Global convergence of a descent PRP type conjugate gradient method for nonconvex optimization ⋮ Nonlinear conjugate gradient methods with sufficient descent condition for large-scale unconstrained optimization ⋮ A modified PRP-type conjugate gradient projection algorithm for solving large-scale monotone nonlinear equations with convex constraint ⋮ An improved Wei-Yao-Liu nonlinear conjugate gradient method for optimization computation ⋮ Global convergence of a modified spectral three-term CG algorithm for nonconvex unconstrained optimization problems ⋮ A nonmonotone scaled Fletcher-Reeves conjugate gradient method with application in image reconstruction ⋮ A modified Hestenes and Stiefel conjugate gradient algorithm for large-scale nonsmooth minimizations and nonlinear equations ⋮ The Hager–Zhang conjugate gradient algorithm for large-scale nonlinear equations ⋮ Sufficient descent conjugate gradient methods for large-scale optimization problems ⋮ Derivative-free method based on DFP updating formula for solving convex constrained nonlinear monotone equations and application ⋮ A hybrid FR-DY conjugate gradient algorithm for unconstrained optimization with application in portfolio selection ⋮ A memory gradient method based on the nonmonotone technique ⋮ A scaled three-term conjugate gradient method for unconstrained optimization ⋮ Large sparse signal recovery by conjugate gradient algorithm based on smoothing technique ⋮ A new constrained optimization model for solving the nonsymmetric stochastic inverse eigenvalue problem ⋮ A conjugate gradient type method for the nonnegative constraints optimization problems ⋮ An improved three-term conjugate gradient algorithm for solving unconstrained optimization problems ⋮ Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing ⋮ A modified sufficient descent Polak-Ribiére-Polyak type conjugate gradient method for unconstrained optimization problems ⋮ A hybrid conjugate gradient based approach for solving unconstrained optimization and motion control problems ⋮ A modified Hager-Zhang conjugate gradient method with optimal choices for solving monotone nonlinear equations ⋮ A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization ⋮ Adaptive three-term PRP algorithms without gradient Lipschitz continuity condition for nonconvex functions ⋮ A new family of hybrid three-term conjugate gradient methods with applications in image restoration ⋮ A descent extension of the Polak-Ribière-Polyak conjugate gradient method ⋮ New three-term conjugate gradient method with guaranteed global convergence ⋮ Global convergence of a modified conjugate gradient method ⋮ A new modified three-term conjugate gradient method with sufficient descent property and its global convergence ⋮ A modified descent Polak-Ribiére-Polyak conjugate gradient method with global convergence property for nonconvex functions ⋮ Riemannian Modified Polak--Ribière--Polyak Conjugate Gradient Order Reduced Model by Tensor Techniques ⋮ A descent extension of a modified Polak-Ribière-Polyak method with application in image restoration problem ⋮ A modified nonlinear Polak-Ribière-Polyak conjugate gradient method with sufficient descent property ⋮ Some modified Hestenes-Stiefel conjugate gradient algorithms with application in image restoration ⋮ Global convergence of a modified Fletcher-Reeves conjugate gradient method with Armijo-type line search ⋮ Some modified Yabe–Takano conjugate gradient methods with sufficient descent condition ⋮ AN EFFICIENT METHOD FOR SOLVING A CLASS OF MATRIX TRACE FUNCTION MINIMIZATION PROBLEM IN MULTIVARIATE STATISTICAL ⋮ A hybrid Riemannian conjugate gradient method for nonconvex optimization problems ⋮ A class of three-term derivative-free methods for large-scale nonlinear monotone system of equations and applications to image restoration problems ⋮ An accelerated conjugate gradient algorithm for solving nonlinear monotone equations and image restoration problems ⋮ Modified three-term Liu-Storey conjugate gradient method for solving unconstrained optimization problems and image restoration problems ⋮ Global convergence via descent modified three-term conjugate gradient projection algorithm with applications to signal recovery ⋮ Unnamed Item ⋮ A derivative-free Liu-Storey method for solving large-scale nonlinear systems of equations ⋮ An accurate active set conjugate gradient algorithm with project search for bound constrained optimization ⋮ A Modified Nonmonotone Hestenes–Stiefel Type Conjugate Gradient Methods for Large-Scale Unconstrained Problems ⋮ Spectral conjugate gradient methods with sufficient descent property for large-scale unconstrained optimization ⋮ Projected Newton method for noise constrained ℓ p regularization ⋮ A smoothing conjugate gradient method for solving systems of nonsmooth equations ⋮ An efficient adaptive three-term extension of the Hestenes–Stiefel conjugate gradient method ⋮ PRP-like algorithm for monotone operator equations ⋮ A Subspace Modified PRP Method for Large-scale Nonlinear Box-Constrained Optimization ⋮ Extrapolated sequential constraint method for variational inequality over the intersection of fixed-point sets ⋮ A modified Hestense–Stiefel conjugate gradient method close to the memoryless BFGS quasi-Newton method ⋮ A derivative-free three-term projection algorithm involving spectral quotient for solving nonlinear monotone equations ⋮ A family of quasi-Newton methods for unconstrained optimization problems ⋮ A Modified PRP Conjugate Gradient Algorithm with Trust Region for Optimization Problems ⋮ A practical PR+ conjugate gradient method only using gradient ⋮ A modified Polak-Ribière-Polyak conjugate gradient algorithm for nonsmooth convex programs ⋮ GLOBAL CONVERGENCE OF TWO KINDS OF THREE-TERM CONJUGATE GRADIENT METHODS WITHOUT LINE SEARCH ⋮ Two descent hybrid conjugate gradient methods for optimization ⋮ Convergence properties of an iterative method for solving symmetric non-linear equations ⋮ An efficient modified PRP-FR hybrid conjugate gradient method for solving unconstrained optimization problems ⋮ Global convergence of the Polak-Ribière-Polyak conjugate gradient method with an Armijo-type inexact line search for nonconvex unconstrained optimization problems ⋮ A sufficient descent three-term conjugate gradient method via symmetric rank-one update for large-scale optimization ⋮ Signal reconstruction by conjugate gradient algorithm based on smoothing \(l_1\)-norm ⋮ Two Modified Polak–Ribière–Polyak-Type Nonlinear Conjugate Methods with Sufficient Descent Property ⋮ Unnamed Item ⋮ Unnamed Item ⋮ A Riemannian Fletcher--Reeves Conjugate Gradient Method for Doubly Stochastic Inverse Eigenvalue Problems ⋮ A class of derivative-free CG projection methods for nonsmooth equations with an application to the LASSO problem ⋮ Some sufficient descent conjugate gradient methods and their global convergence ⋮ Acceleration method for convex optimization over the fixed point set of a nonexpansive mapping ⋮ A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization ⋮ A modified Hestenes-Stiefel conjugate gradient method with sufficient descent condition and conjugacy condition ⋮ Optimization for Inconsistent Split Feasibility Problems ⋮ A family of derivative-free conjugate gradient methods for large-scale nonlinear systems of equations ⋮ A sufficient descent Liu–Storey conjugate gradient method and its global convergence ⋮ A modified spectral PRP conjugate gradient projection method for solving large-scale monotone equations and its application in compressed sensing ⋮ Modified three-term conjugate gradient method and its applications ⋮ Dynamic force identification problem based on a novel improved Tikhonov regularization method ⋮ Two families of scaled three-term conjugate gradient methods with sufficient descent property for nonconvex optimization ⋮ A Trust Region Algorithm with Conjugate Gradient Technique for Optimization Problems ⋮ Some three-term conjugate gradient methods with the new direction structure ⋮ The PRP conjugate gradient algorithm with a modified WWP line search and its application in the image restoration problems ⋮ A conjugate gradient projection method for solving equations with convex constraints ⋮ A descent hybrid modification of the Polak–Ribière–Polyak conjugate gradient method ⋮ A fast conjugate gradient algorithm with active set prediction for ℓ1 optimization ⋮ A modified Polak–Ribière–Polyak conjugate gradient algorithm for unconstrained optimization ⋮ A Perry-type derivative-free algorithm for solving nonlinear system of equations and minimizing ℓ1regularized problem ⋮ A MODIFIED PROJECTED CONJUGATE GRADIENT ALGORITHM FOR UNCONSTRAINED OPTIMIZATION PROBLEMS ⋮ A Modified Hestenes-Stiefel Conjugate Gradient Algorithm for Large-Scale Optimization ⋮ A three term Polak-Ribière-Polyak conjugate gradient method close to the memoryless BFGS quasi-Newton method ⋮ A NEW THREE–TERM CONJUGATE GRADIENT METHOD WITH DESCENT DIRECTION FOR UNCONSTRAINED OPTIMIZATION ⋮ Three modified Polak-Ribière-Polyak conjugate gradient methods with sufficient descent property ⋮ A class of line search-type methods for nonsmooth convex regularized minimization ⋮ Globally convergent diagonal Polak-Ribière-Polyak like algorithm for nonlinear equations ⋮ A modified HZ conjugate gradient algorithm without gradient Lipschitz continuous condition for non convex functions ⋮ Two spectral conjugate gradient methods for unconstrained optimization problems ⋮ A three-terms Polak-Ribière-Polyak conjugate gradient algorithm for large-scale nonlinear equations ⋮ A self-adjusting conjugate gradient method with sufficient descent condition and conjugacy condition ⋮ Modified optimal Perry conjugate gradient method for solving system of monotone equations with applications ⋮ Adaptive three-term family of conjugate residual methods for system of monotone nonlinear equations ⋮ Avoiding bad steps in Frank-Wolfe variants ⋮ A NEW DERIVATIVE-FREE CONJUGATE GRADIENT METHOD FOR LARGE-SCALE NONLINEAR SYSTEMS OF EQUATIONS ⋮ Dai-Liao extensions of a descent hybrid nonlinear conjugate gradient method with application in signal processing ⋮ Two modified spectral conjugate gradient methods and their global convergence for unconstrained optimization ⋮ A modified Perry conjugate gradient method and its global convergence ⋮ An adaptive nonmonotone global Barzilai–Borwein gradient method for unconstrained optimization ⋮ Some new three-term Hestenes–Stiefel conjugate gradient methods with affine combination ⋮ A family of hybrid conjugate gradient method with restart procedure for unconstrained optimizations and image restorations ⋮ A nonlinear conjugate gradient method using inexact first-order information ⋮ An Accelerated Three-Term Extension of a Descent Nonlinear Conjugate Gradient Method ⋮ An efficient modified residual-based algorithm for large scale symmetric nonlinear equations by approximating successive iterated gradients ⋮ Two diagonal conjugate gradient like methods for unconstrained optimization ⋮ A truncated three-term conjugate gradient method with complexity guarantees with applications to nonconvex regression problem ⋮ A modified PRP-type conjugate gradient algorithm with complexity analysis and its application to image restoration problems ⋮ A new three-term spectral subgradient method for solving absolute value equation ⋮ Modified globally convergent Polak-Ribière-Polyak conjugate gradient methods with self-correcting property for large-scale unconstrained optimization ⋮ Adaptive trust-region method on Riemannian manifold ⋮ A hybrid conjugate gradient algorithm for nonconvex functions and its applications in image restoration problems ⋮ A dynamic distributed conjugate gradient method for variational inequality problem over the common fixed-point constraints ⋮ Memoryless quasi-Newton methods based on the spectral-scaling Broyden family for Riemannian optimization ⋮ A hybrid HS-LS conjugate gradient algorithm for unconstrained optimization with applications in motion control and image recovery ⋮ A descent family of the spectral Hestenes–Stiefel method by considering the quasi-Newton method ⋮ An Liu-Storey-Type Method for Solving Large-Scale Nonlinear Monotone Equations ⋮ A Geometric Nonlinear Conjugate Gradient Method for Stochastic Inverse Eigenvalue Problems ⋮ A modified Polak–Ribi‘ere–Polyak descent method for unconstrained optimization ⋮ On the convergence properties of the unmodified PRP method with a non-descent line search ⋮ A derivative-free PRP method for solving large-scale nonlinear systems of equations and its global convergence ⋮ Some descent three-term conjugate gradient methods and their global convergence ⋮ A Two-Term PRP-Based Descent Method ⋮ The convergence rate of a three-term HS method with restart strategy for unconstrained optimization problems ⋮ A new class of nonlinear conjugate gradient coefficients for unconstrained optimization
Uses Software
This page was built for publication: A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence
