Dynamics of Learning Near Singularities in Layered Networks
From MaRDI portal
Publication:5453542
DOI10.1162/NECO.2007.12-06-414zbMATH Open1138.68048OpenAlexW2125911849WikidataQ51899593 ScholiaQ51899593MaRDI QIDQ5453542FDOQ5453542
Authors: Haikun Wei, Jun Zhang, Florent Cousseau, Tomoko Ozeki, Shun-Ichi Amari 
Publication date: 2 April 2008
Published in: Neural Computation (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1162/neco.2007.12-06-414
Recommendations
- Singularities Affect Dynamics of Learning in Neuromanifolds
- scientific article; zbMATH DE number 2226650
- Theoretical analysis of learning dynamics near the opposite singularities in multilayer perceptrons
- Dynamics of learning near singularities in radial basis function networks
- Numerical analysis near singularities in RBF networks
Cites Work
- Algebraic analysis for nonidentifiable learning machines
- On the concept of attractor
- Transient dynamics of on-line learning in two-layered neural networks
- Learning by on-line gradient descent
- Difficulty of Singularity in Population Coding
- A Theory of Adaptive Pattern Classifiers
- Testing in locally conic models, and application to mixture models
- Neural theory of association and concept-formation
- Likelihood ratio of unidentifiable models and multilayer neural networks
- On the Problem in Model Selection of Neural Network Regression in Overrealizable Scenario
- On-line learning of a mixture-of-experts neural network
- Learning Coefficients of Layered Models When the True Distribution Mismatches the Singularities
- On-line backpropagation in two-layered neural networks
- Online learning dynamics of multilayer perceptrons with unidentifiable parameters
Cited In (19)
- How to modify a neural network gradually without changing its input-output functionality
- Theoretical analysis of learning dynamics near the opposite singularities in multilayer perceptrons
- Natural gradient learning algorithms for RBF networks
- Data-dependence of plateau phenomenon in learning with neural network—statistical mechanical analysis *
- Numerical analysis near singularities in RBF networks
- Learning dynamics of a single polar variable complex-valued neuron
- Title not available (Why is that?)
- High-dimensional dynamics of generalization error in neural networks
- Plateau phenomenon in gradient descent training of RELU networks: explanation, quantification, and avoidance
- Statistical mechanical analysis of learning dynamics of two-layer perceptron with multiple output units
- Dynamics of learning near singularities in radial basis function networks
- Levenberg-Marquardt algorithm for Mackey-Glass chaotic time series prediction
- Singularities Affect Dynamics of Learning in Neuromanifolds
- Algebraic representations for faster predictions in convolutional neural networks
- Center manifold analysis of plateau phenomena caused by degeneration of three-layer perceptron
- Dynamics of learning in MLP: natural gradient and singularity revisited
- Title not available (Why is that?)
- Noise-induced degeneration in online learning
- Title not available (Why is that?)
This page was built for publication: Dynamics of Learning Near Singularities in Layered Networks
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5453542)
