Parametrisation independence of the natural gradient in overparametrised systems

DOI10.1007/978-3-030-80209-7_78OpenAlexW3181803158MaRDI QIDQ2117935FDOQ2117935

Authors: Jesse van Oostrum, Nihat Ay 

Publication date: 22 March 2022

Full work available at URL: https://doi.org/10.1007/978-3-030-80209-7_78

zbMATH Keywords

deep learninginformation geometryRiemannian metricnatural gradient

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Artificial neural networks and deep learning (68T07)

Cites Work

• Algebraic Geometry and Statistical Learning Theory
• Riemannian metrics for neural networks I: feedforward networks
• Title not available (Why is that?)
• On the locality of the natural gradient for learning in deep Bayesian networks

Cited In (1)

• Invariance properties of the natural gradient in overparametrised systems

This page was built for publication: Parametrisation independence of the natural gradient in overparametrised systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2117935)