Archetypal landscapes for deep neural networks

DOI10.1073/PNAS.1919995117zbMATH Open1485.68238OpenAlexW3080243925WikidataQ98725450 ScholiaQ98725450MaRDI QIDQ5073145FDOQ5073145

Authors: Philipp C. Verpoort, Alpha Albert Lee, D. J. Wales 

Publication date: 5 May 2022

Published in: Proceedings of the National Academy of Sciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1073/pnas.1919995117

Recommendations

• Optimization Landscape of Neural Networks
• A mean field view of the landscape of two-layer neural networks
• Shaping the learning landscape in neural networks around wide flat minima
• Comparing dynamics: deep neural networks versus glassy systems
• Global minima of overparameterized neural networks

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07)

Cites Work

• A Family of Variable-Metric Methods Derived by Variational Means
• A new approach to variable metric algorithms
• Conditioning of Quasi-Newton Methods for Function Minimization
• The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations
• Cascading classifiers
• A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
• A mean field view of the landscape of two-layer neural networks
• Entropy-SGD: biasing gradient descent into wide valleys
• Flat Minima
• Comparing dynamics: deep neural networks versus glassy systems
• Title not available (Why is that?)

Cited In (11)

• Comparing dynamics: deep neural networks versus glassy systems
• Black holes and the loss landscape in machine learning
• Spurious valleys in one-hidden-layer neural network optimization landscapes
• Shaping the learning landscape in neural networks around wide flat minima
• Community detection-based deep neural network architectures: a fully automated framework based on Likert-scale data
• Optimization Landscape of Neural Networks
• Landscape and training regimes in deep learning
• Revisiting Landscape Analysis in Deep Neural Networks: Eliminating Decreasing Paths to Infinity
• Towards interpreting deep neural networks via layer behavior understanding
• Dissecting a small artificial neural network
• Barcodes as summary of loss function topology

This page was built for publication: Archetypal landscapes for deep neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5073145)