scientific article; zbMATH DE number 1569109

MaRDI QIDQ4762633zbMATH OpenFDO

Authors Magnus Rattray, David Saad

Publication date 22 February 2001

zbMATH Keywords

multi-layer neural networkson-line learning algorithmsstatistical mechanics

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Matrix momentum for practical natural gradient learning
• Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent
• Theoretical approaches to on-line learning in smooth multilayer nets
• Stochastic dynamics of learning with momentum in neural networks
• The natural gradient learning algorithm for neural networks

Cited in

(6)

• Second-order stagewise backpropagation for Hessian-matrix analyses and investigation of negative curvature
• Learning the smoothness of noisy curves with application to online curve estimation
• Theoretical approaches to on-line learning in smooth multilayer nets
• Fast curvature matrix-vector products
• Matrix momentum for practical natural gradient learning
• Matrix-update for accelerated on-line learning in multilayer neural networks

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4762633)