Stochastic three-term conjugate gradient method with variance technique for non-convex learning

DOI10.1007/S11222-024-10409-5zbMATH Open1541.62018MaRDI QIDQ6570331FDOQ6570331

Chenkaixiang Lu, Gonglin Yuan, Xiong Zhao, Chen Ouyang, Ruping Huang, Yiyan Jiang

Publication date: 10 July 2024

Published in: Statistics and Computing (Search for Journal in Brave)

zbMATH Keywords

machine learninglinear convergencestochastic conjugate gradientempirical risk loss function minimization

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Numerical mathematical programming methods (65K05) Nonconvex programming, global optimization (90C26) Methods of reduced gradient type (90C52)

Cites Work

• Function minimization by conjugate gradients
• A Stochastic Approximation Method
• Title not available (Why is that?)
• A Nonlinear Conjugate Gradient Method with a Strong Global Convergence Property
• A New Conjugate Gradient Method with Guaranteed Descent and an Efficient Line Search
• Some descent three-term conjugate gradient methods and their global convergence
• Convergence Conditions for Ascent Methods
• The conjugate gradient method in extremal problems
• Title not available (Why is that?)
• Conjugate gradient methods with Armijo-type line searches.
• Large-Scale Machine Learning with Stochastic Gradient Descent
• Minimizing finite sums with the stochastic average gradient
• Optimization Methods for Large-Scale Machine Learning
• The global convergence of the Polak-Ribière-Polyak conjugate gradient algorithm under inexact line search for nonconvex functions
• The modified PRP conjugate gradient algorithm under a non-descent line search and its application in the Muskingum model and image restoration problems
• A modified HZ conjugate gradient algorithm without gradient Lipschitz continuous condition for non convex functions
• Adaptive three-term PRP algorithms without gradient Lipschitz continuity condition for nonconvex functions
• A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

This page was built for publication: Stochastic three-term conjugate gradient method with variance technique for non-convex learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6570331)