Convergence of gradient method for a fully recurrent neural network

DOI10.1007/S00500-009-0398-0MaRDI QIDQ2380334zbMATH OpenOpenAlexFDO

Authors Wei Wu, Dong-po Xu, Zhengxue Li

Publication date 26 March 2010

Published in Soft Computing (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s00500-009-0398-0

zbMATH Keywords

convergencemonotonicityfully recurrent neural networkgradient descent learning algorithm

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Convergence of gradient method for Eelman networks
• Convergence analysis of online gradient method for BP neural networks
• Convergence of an online gradient method for feedforward neural networks with stochastic inputs.
• Deterministic convergence of an online gradient method for neural networks
• scientific article; zbMATH DE number 2202150

Cites work

• scientific article; zbMATH DE number 3381785 (Why is no real title available?)
• Sufficient Conditions for Error Backflow Convergence in Dynamical Recurrent Neural Networks

Cited in

(18)

• Convergence analysis for gradient flows in the training of artificial neural networks with ReLU activation
• Application of neural networks to inverse elastic scattering problems with near-field measurements
• scientific article; zbMATH DE number 6154737 (Why is no real title available?)
• On-line Gauss-Newton-based learning for fully recurrent neural networks
• Discrete time-variant nonlinear optimization and system solving via integral-type error function and twice ZND formula with noises suppressed
• A neural network method for the inverse scattering problem of impenetrable cavities
• A neural network scheme for recovering scattering obstacles with limited phaseless far-field data
• Convergence of gradient method for Eelman networks
• scientific article; zbMATH DE number 5524483 (Why is no real title available?)
• Convergence analysis of three classes of Split-complex gradient algorithms for complex-valued recurrent neural networks
• scientific article; zbMATH DE number 5733477 (Why is no real title available?)
• scientific article; zbMATH DE number 2156307 (Why is no real title available?)
• A recalling-enhanced recurrent neural network: conjugate gradient learning algorithm and its convergence analysis
• Sufficient Conditions for Error Backflow Convergence in Dynamical Recurrent Neural Networks
• The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
• Convergence analysis of the weighted state space search algorithm for recurrent neural networks
• Prescribed convergence analysis of recurrent neural networks with parameter variations
• A conjugate gradient learning algorithm for recurrent neural networks

This page was built for publication: Convergence of gradient method for a fully recurrent neural network

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2380334)