Wide neural networks of any depth evolve as linear models under gradient descent *
From MaRDI portal
Publication:5857449
DOI10.1088/1742-5468/abc62bMaRDI QIDQ5857449
Roman Novak, Jeffrey Pennington, Lechao Xiao, Jae Hoon Lee, Samuel S. Schoenholz, Yasaman Bahri, Jascha Sohl-Dickstein
Publication date: 1 April 2021
Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1902.06720
82-XX: Statistical mechanics, structure of matter
Uses Software