Asymptotics of representation learning in finite Bayesian neural networks*

DOI10.1088/1742-5468/AC98A6OpenAlexW3172130470MaRDI QIDQ5055422FDOQ5055422

Authors: Jacob A. Zavatone-Veth, Abdulkadir Canatar, Benjamin S. Ruben, Cengiz Pehlevan 

Publication date: 13 December 2022

Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2106.00651

Recommendations

• Wide neural networks of any depth evolve as linear models under gradient descent ^*
• Unified field theoretical approach to deep and recurrent neuronal networks
• Learning sparse features can lead to overfitting in neural networks
• Infinite-width limit of deep linear neural networks

zbMATH Keywords

machine learning

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Cites Work

• Deep learning
• Title not available (Why is that?)
• Bayesian learning for neural networks
• The Evaluation of the Collision Matrix
• The Principles of Deep Learning Theory

Cited In (1)

• Bayesian Representation of Stochastic Processes under Learning: de Finetti Revisited

Uses Software

• PyTorch

This page was built for publication: Asymptotics of representation learning in finite Bayesian neural networks*

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5055422)