Unified convergence analysis for adaptive optimization with moving average estimator

DOI10.1007/S10994-024-06650-8MaRDI QIDQ6984743zbMATH OpenFDO

Authors Zhishuai Guo, Yi Xu, Wotao Yin, Rong Jin, Tianbao Yang

Publication date 14 May 2025

Published in Machine Learning (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/S10994-024-06650-8

zbMATH Keywords

adaptive optimizationbilevel problemsmin-max problems

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05)

Cites work

• A Single Timescale Stochastic Approximation Method for Nested Stochastic Optimization
• Accelerated gradient methods for nonconvex nonlinear and stochastic programming
• Adaptive primal-dual stochastic gradient method for expectation-constrained convex stochastic programs
• Adaptive subgradient methods for online learning and stochastic optimization
• Alternating Proximal-Gradient Steps for (Stochastic) Nonconvex-Concave Minimax Problems
• scientific article; zbMATH DE number 7255141 (Why is no real title available?)
• Learning Theory
• Robust Stochastic Approximation Approach to Stochastic Programming
• Solving variational inequalities with stochastic mirror-prox algorithm
• Stochastic compositional gradient descent: algorithms for minimizing compositions of expected-value functions
• Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming
• Stochastic model-based minimization of weakly convex functions
• Weakly-convex-concave min-max optimization: provable algorithms and applications in machine learning

Cited in

(2)

• A unified theoretical framework for the last-iterate convergence of stochastic adaptive optimization
• Faster adaptive momentum-based federated methods for distributed composition optimization

This page was built for publication: Unified convergence analysis for adaptive optimization with moving average estimator

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6984743)