Decentralized stochastic sharpness-aware minimization algorithm

DOI10.1016/J.NEUNET.2024.106325MaRDI QIDQ6558458zbMATH OpenFDO

Authors Simiao Chen, Xiaoge Deng, Dong-po Xu, Tao Sun, Dongsheng Li

Publication date 19 June 2024

Published in Neural Networks (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/J.NEUNET.2024.106325

zbMATH Keywords

distributed optimizationgeneralization improvementsharpness-aware minimization (SAM)stochastic gradient methods

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Artificial neural networks and deep learning (68T07) Distributed algorithms (68W15) Approximation methods and heuristics in mathematical programming (90C59)

Recommendations

• Distributed optimization for degenerate loss functions arising from over-parameterization
• Distributed multi-task classification: a decentralized online learning approach
• Adaptive pruning-based Newton's method for distributed learning
• Understanding a Class of Decentralized and Federated Optimization Algorithms: A Multirate Feedback Control Perspective

This page was built for publication: Decentralized stochastic sharpness-aware minimization algorithm

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6558458)