Scale invariant stochastic gradient method with momentum

DOI10.37560/MATBIL23472147NzbMATH Open1545.90176MaRDI QIDQ6603344FDOQ6603344

Authors: Filip Nikolovski, Irena Stojkovska 

Publication date: 12 September 2024

Published in: Matematichki Bilten (Search for Journal in Brave)

Recommendations

• Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods
• Stochastic gradient method with Barzilai-Borwein step for unconstrained nonlinear optimization
• Stochastic approximation with adaptive step sizes for optimization in noisy environment and its application in regression models
• A gradient method for unconstrained optimization in noisy environment
• A stochastic variance reduced gradient method with adaptive step for stochastic optimization

zbMATH Keywords

Barzilai-Borwein methodnumerical optimizationscale invariancestochastic gradient methodmomentum methodhigh probablity convergence

Mathematics Subject Classification ID

Nonlinear programming (90C30) Stochastic programming (90C15)

This page was built for publication: Scale invariant stochastic gradient method with momentum

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6603344)