Analysis of gradient descent learning algorithms for multilayer feedforward neural networks

DOI10.1109/31.85630MaRDI QIDQ3986963zbMATH OpenOpenAlexWikidataFDO

Authors Heng Guo, Saul B. Gelfand

Publication date 28 June 1992

Published in IEEE Transactions on Circuits and Systems (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1109/31.85630

zbMATH Keywords

multilayer feedforward neural networksgradient-type learning algorithms

Mathematics Subject Classification ID

Control/observation systems governed by ordinary differential equations (93C15)

Recommendations

• Learning Algorithms of Multilayer Neural Networks.
• On-line backpropagation in two-layered neural networks
• The convergence of stochastic gradient algorithms applied to learning in neural networks
• A multilayer neural network. I: Stability of its learning process
• A multilayer neural network. II: Stability of its learning processes

Cited in

(31)

• Two-dimensional learning strategy for multilayer feedforward neural network
• Ill-Conditioning in Neural Network Training Problems
• Backpropagation and stochastic gradient descent method
• scientific article; zbMATH DE number 1565804 (Why is no real title available?)
• Prediction of soil temperature by using artificial neural networks algorithms.
• Lyapunov stability analysis of gradient descent-learning algorithm in network training
• A multilayer neural network. I: Stability of its learning process
• A multilayer neural network. II: Stability of its learning processes
• Stochastic dynamics and learning rules in layered neural networks.
• On the overfly algorithm in deep learning of neural networks
• scientific article; zbMATH DE number 6178473 (Why is no real title available?)
• Qualitative behavior of differential equations associated with artificial neural networks
• Backpropagation
• The use of random weights for the training of multilayer networks of neurons with Heaviside characteristics
• scientific article; zbMATH DE number 759420 (Why is no real title available?)
• scientific article; zbMATH DE number 4074522 (Why is no real title available?)
• Artificial Intelligence and Soft Computing - ICAISC 2004
• scientific article; zbMATH DE number 1191258 (Why is no real title available?)
• AI 2005: Advances in Artificial Intelligence
• scientific article; zbMATH DE number 4174339 (Why is no real title available?)
• The convergence of stochastic gradient algorithms applied to learning in neural networks
• scientific article; zbMATH DE number 4102508 (Why is no real title available?)
• scientific article; zbMATH DE number 2065718 (Why is no real title available?)
• MLP in Layer-Wise Form with Applications to Weight Decay
• A fractional gradient descent algorithm robust to the initial weights of multilayer perceptron
• Sufficient Conditions for Error Backflow Convergence in Dynamical Recurrent Neural Networks
• Dynamics of temporary minima in a feed-forward neural network
• The brain-state-in-a-box neural model is a gradient descent algorithm
• Some Asymptotic Results for Learning in Single Hidden-Layer Feedforward Network Models
• Stability analysis of a three-term backpropagation algorithm
• Comparison of four gradient-learning algorithms for neural network Wiener models

This page was built for publication: Analysis of gradient descent learning algorithms for multilayer feedforward neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3986963)