Archetypal landscapes for deep neural networks

DOI10.1073/pnas.1919995117zbMath1485.68238OpenAlexW3080243925WikidataQ98725450 ScholiaQ98725450MaRDI QIDQ5073145

Alpha Albert Lee, D. J. Wales, Philipp C. Verpoort

Publication date: 5 May 2022

Published in: Proceedings of the National Academy of Sciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1073/pnas.1919995117

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07)

Cites Work

• Flat Minima
• A mean field view of the landscape of two-layer neural networks
• A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
• A Family of Variable-Metric Methods Derived by Variational Means
• A new approach to variable metric algorithms
• The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations
• Conditioning of Quasi-Newton Methods for Function Minimization
• Comparing dynamics: deep neural networks versus glassy systems
• Entropy-SGD: biasing gradient descent into wide valleys
• Unnamed Item
• Unnamed Item