A mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize

DOI10.1007/S40305-022-00436-2zbMATH Open1524.90222MaRDI QIDQ6097380FDOQ6097380

Authors: Tengteng Yu, Xinwei Liu, Yuhong Dai, Jie Sun 

Publication date: 5 June 2023

Published in: Journal of the Operations Research Society of China (Search for Journal in Brave)

zbMATH Keywords

Barzilai-Borwein methodcomposite optimizationproximal gradient algorithmstochastic recursive gradient

Mathematics Subject Classification ID

Convex programming (90C25) Large-scale problems in mathematical programming (90C06) Applications of mathematical programming (90C90) Nonlinear programming (90C30)

Cites Work

• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Title not available (Why is that?)
• First-order methods in optimization
• A Stochastic Approximation Method
• Two-Point Step Size Gradient Methods
• Deep learning
• Parallel stochastic gradient algorithms for large-scale matrix completion
• Understanding machine learning. From theory to algorithms
• An optimal method for stochastic composite optimization
• A proximal stochastic gradient method with progressive variance reduction
• Title not available (Why is that?)
• Minimizing finite sums with the stochastic average gradient
• The restricted strong convexity revisited: analysis of equivalence to error bound and quadratic growth
• A linearly convergent stochastic recursive gradient method for convex optimization
• Optimization methods for large-scale machine learning
• Stochastic variance reduced gradient methods using a trust-region-like scheme
• An inexact accelerated stochastic ADMM for separable convex optimization
• Inexact proximal stochastic gradient method for convex composite optimization
• A family of spectral gradient methods for optimization
• Stochastic proximal quasi-Newton methods for non-convex composite optimization
• Variable metric proximal stochastic variance reduced gradient methods for nonconvex nonsmooth optimization

Cited In (2)

• An adaptive projection algorithm for solving nonlinear monotone equations with convex constraints
• Stochastic gradient descent with Barzilai-Borwein update step for SVM

This page was built for publication: A mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6097380)