Data-dependence of plateau phenomenon in learning with neural network—statistical mechanical analysis *

DOI10.1088/1742-5468/ABC62FMaRDI QIDQ5857461zbMATH OpenOpenAlexFDO

Authors Yuki Yoshida, Masato Okada

Publication date 1 April 2021

Published in Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2001.03371

zbMATH Keywords

machine learningnonlinear dynamicsonline dynamics

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Recommendations

• Statistical mechanics of training in neural networks
• Phase transitions and learning in neural networks
• Statistical mechanics of EKF learning in neural networks
• Statistical Mechanics of Neural Networks
• Non-deterministic learning dynamics in large neural networks due to structural data bias
• Statistical mechanical analysis of learning dynamics of two-layer perceptron with multiple output units
• On the statistical mechanics of probabilistic models of neural networks
• Statistical mechanics for neural networks with continuous-time dynamics

Cites work

• Dynamics of Learning Near Singularities in Layered Networks
• On-line backpropagation in two-layered neural networks
• Statistical mechanical analysis of learning dynamics of two-layer perceptron with multiple output units

This page was built for publication: Data-dependence of plateau phenomenon in learning with neural network—statistical mechanical analysis ^*

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5857461)