Exact solutions of a deep linear network

DOI10.1088/1742-5468/AD01B3MaRDI QIDQ6611441zbMATH OpenFDO

Authors Liu Ziyin, Botao Li, Xiangming Meng

Publication date 26 September 2024

Published in Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1088/1742-5468/AD01B3

zbMATH Keywords

analysis of algorithmsdeep learningenergy landscapeslearning theory

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Recommendations

• Optimization Landscape of Neural Networks
• The global optimization geometry of shallow linear neural networks
• Non-attracting regions of local minima in deep and wide neural networks
• Mean Field Analysis of Deep Neural Networks
• Effect of depth and width on local minima in deep learning

Cites work

• scientific article; zbMATH DE number 6378127 (Why is no real title available?)
• Spurious valleys in one-hidden-layer neural network optimization landscapes
• Surprises in high-dimensional ridgeless least squares interpolation

Cited in

(6)

• On symmetry and initialization for neural networks
• Activation function design for deep networks: linearity and effective initialisation
• Singular value perturbation and deep network optimization
• Deep Linear Networks for Matrix Completion—an Infinite Depth Limit
• Exact learning dynamics of deep linear networks with prior knowledge
• How can deep neural networks fail even with global optima?

This page was built for publication: Exact solutions of a deep linear network

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6611441)