Dynamics of Learning Near Singularities in Layered Networks

Recommendations

Singularities Affect Dynamics of Learning in Neuromanifolds
scientific article; zbMATH DE number 2226650
Theoretical analysis of learning dynamics near the opposite singularities in multilayer perceptrons
Dynamics of learning near singularities in radial basis function networks
Numerical analysis near singularities in RBF networks

Cites work

A Theory of Adaptive Pattern Classifiers
Algebraic analysis for nonidentifiable learning machines
Difficulty of Singularity in Population Coding
Learning by on-line gradient descent
Learning Coefficients of Layered Models When the True Distribution Mismatches the Singularities
Likelihood ratio of unidentifiable models and multilayer neural networks
Neural theory of association and concept-formation
On the concept of attractor
On the Problem in Model Selection of Neural Network Regression in Overrealizable Scenario
On-line backpropagation in two-layered neural networks
On-line learning of a mixture-of-experts neural network
Online learning dynamics of multilayer perceptrons with unidentifiable parameters
Testing in locally conic models, and application to mixture models
Transient dynamics of on-line learning in two-layered neural networks

Cited in

(22)

Dynamics of learning near singularities in radial basis function networks
High-dimensional dynamics of generalization error in neural networks
Noise-induced degeneration in online learning
Levenberg-Marquardt algorithm for Mackey-Glass chaotic time series prediction
scientific article; zbMATH DE number 1728675 (Why is no real title available?)
Theoretical analysis of learning dynamics near the opposite singularities in multilayer perceptrons
How to modify a neural network gradually without changing its input-output functionality
Numerical analysis near singularities in RBF networks
Statistical mechanical analysis of learning dynamics of two-layer perceptron with multiple output units
Center manifold analysis of plateau phenomena caused by degeneration of three-layer perceptron
Dynamics of learning in MLP: natural gradient and singularity revisited
Plateau phenomenon in gradient descent training of RELU networks: explanation, quantification, and avoidance
Non-attracting regions of local minima in deep and wide neural networks
Natural gradient learning algorithms for RBF networks
Learning dynamics of a single polar variable complex-valued neuron
Singularities Affect Dynamics of Learning in Neuromanifolds
scientific article; zbMATH DE number 2226650 (Why is no real title available?)
Data-dependence of plateau phenomenon in learning with neural network—statistical mechanical analysis ^*
Algebraic representations for faster predictions in convolutional neural networks
Learning time-scales in two-layers neural networks
Stochastic collapse: how gradient noise attracts SGD dynamics towards simpler subnetworks
A geometric modeling of Occam's razor in deep learning

This page was built for publication: Dynamics of Learning Near Singularities in Layered Networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5453542)