Learning Curves for Stochastic Gradient Descent in Linear Feedforward Networks

DOI10.1162/089976605774320539MaRDI QIDQ3370749zbMATH OpenOpenAlexDBLPWikidataFDO

Authors Justin Werfel, Xiaohui Xie, H. Sebastian Seung

Publication date 8 February 2006

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1162/089976605774320539

zbMATH Keywords

Gradient-following learning methods

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Optimal node perturbation in linear perceptrons with uncertain eligibility trace
• Advanced Lectures on Machine Learning
• Publication:3198870
• The convergence of stochastic gradient algorithms applied to learning in neural networks
• Two Frameworks for Improving Gradient-Based Learning Algorithms

Cited in

(15)

• Optimal node perturbation in linear perceptrons with uncertain eligibility trace
• Learning flexible sensori-motor mappings in a complex network
• Adaptive optimal control without weight transport
• scientific article; zbMATH DE number 2186223 (Why is no real title available?)
• Sensitivity Derivatives for Flexible Sensorimotor Learning
• Learning Spike-Based Population Codes by Reward and Population Feedback
• Asymptotic behaviour in learning from stochastic examples: one-step RSB calculation of the learning curve
• scientific article; zbMATH DE number 7306907 (Why is no real title available?)
• Learning curves for LMS and regular Gaussian processes
• Two Frameworks for Improving Gradient-Based Learning Algorithms
• An approximation of the error backpropagation algorithm in a predictive coding network with local Hebbian synaptic plasticity
• Node perturbation learning without noiseless baseline
• A differential Hebbian framework for biologically-plausible motor control
• Stochastic perturbation of subgradient algorithm for nonconvex deep neural networks
• The exponential learning equation as a function of successful trials results in sigmoid performance

This page was built for publication: Learning Curves for Stochastic Gradient Descent in Linear Feedforward Networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3370749)