The effective noise of stochastic gradient descent
From MaRDI portal
Publication:5043083
DOI10.1088/1742-5468/AC841DOpenAlexW4293168170MaRDI QIDQ5043083FDOQ5043083
Authors: Francesca Mignacco, Pierfrancesco Urbani 
Publication date: 20 October 2022
Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2112.10852
Recommendations
- Stochastic gradient descent with noise of machine learning type. I: Discrete time analysis
- On the diffusion approximation of nonconvex stochastic gradient descent
- Stochastic gradient descent with noise of machine learning type. II: Continuous time analysis
- Stochastic gradient descent: where optimization meets machine learning
- Phase diagram of stochastic gradient descent in high-dimensional two-layer neural networks
Cites Work
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- Robustness and regularization of support vector machines
- Title not available (Why is that?)
- Theory of Simple Glasses
- Title not available (Why is that?)
- The effective temperature
- A mean field view of the landscape of two-layer neural networks
- On the diffusion approximation of nonconvex stochastic gradient descent
- The inverse variance-flatness relation in stochastic gradient descent is critical for finding flat minima
- Out-of-equilibrium dynamical mean-field equations for the perceptron model
Cited In (5)
- On weak ergodicity breaking in mean-field spin glasses
- Dynamical mean field theory for models of confluent tissues and beyond
- Statistical physics of learning in high-dimensional chaotic systems
- Self-consistent dynamical field theory of kernel evolution in wide neural networks
- Stochastic gradient descent with noise of machine learning type. II: Continuous time analysis
This page was built for publication: The effective noise of stochastic gradient descent
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5043083)
