Products of many large random matrices and gradients in deep neural networks
From MaRDI portal
Publication:2181980
DOI10.1007/s00220-019-03624-zzbMath1446.60007arXiv1812.05994OpenAlexW2905541363WikidataQ112153943 ScholiaQ112153943MaRDI QIDQ2181980
Publication date: 20 May 2020
Published in: Communications in Mathematical Physics (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1812.05994
Central limit and other weak theorems (60F05) Random matrices (probabilistic aspects) (60B20) Learning and adaptive systems in artificial intelligence (68T05) Neural networks for/in biological studies, artificial life and related topics (92B20)
Related Items (18)
Deep learning: a statistical viewpoint ⋮ Schwinger–Dyson and loop equations for a product of square Ginibre random matrices ⋮ Harmonic analysis on graphs via Bratteli diagrams and path-space measures ⋮ Gaussian fluctuations for products of random matrices ⋮ Lyapunov exponent, universality and phase transition for products of random matrices ⋮ Deep Linear Networks for Matrix Completion—an Infinite Depth Limit ⋮ Extremal singular values of random matrix products and Brownian motion on \(\text{\textsf{GL}} (N, \mathbb{C})\) ⋮ Lyapunov exponents for truncated unitary and Ginibre matrices ⋮ Generalized Lyapunov exponents and aspects of the theory of deep learning ⋮ Weighted neural tangent kernel: a generalized and improved network-induced kernel ⋮ Random neural networks in the infinite width limit as Gaussian processes ⋮ Universality for cokernels of random matrix products ⋮ Asymptotic freeness of layerwise Jacobians caused by invariance of multilayer perceptron: the Haar orthogonal case ⋮ Non-asymptotic results for singular values of Gaussian matrix products ⋮ Eigenvalue distribution of some nonlinear models of random matrices ⋮ Hard edge statistics of products of Pólya ensembles and shifted GUE's ⋮ A note on the Pennington-Worah distribution ⋮ Multilevel Fine-Tuning: Closing Generalization Gaps in Approximation of Solution Maps under a Limited Budget for Training Data
Cites Work
- Unnamed Item
- Unnamed Item
- Lyapunov exponents for products of complex Gaussian random matrices
- Products of independent non-Hermitian random matrices
- On the largest Lyapunov exponent for products of Gaussian matrices
- Free probability and random matrices
- Some open problems in random matrix theory and the theory of integrable systems. II
- Spectral radii of large non-Hermitian random matrices
- Asymptotic products of independent Gaussian random matrices with correlated entries
- Black holes and random matrices
- Lyapunov exponents of free operators
- Maximal Lyapunov exponents for random matrix products
- The circular law for random matrices
- The distribution of Lyapunov exponents: Exact results for random matrices
- On the rate of convergence in the central limit theorem for martingales with discrete and continuous time
- The triangle law for Lyapunov exponents of large random matrices
- Products of random matrices in statistical physics
- Random polymers on the complete graph
- Universal distribution of Lyapunov exponents for products of Ginibre matrices
- Lyapunov exponents for products of rectangular real, complex and quaternionic Ginibre matrices
- Asymptotics of finite system Lyapunov exponents for some random matrix ensembles
- Recent Exact and Asymptotic Results for Products of Independent Random Matrices
- Products of Random Matrices
- Nonlinear random matrix theory for deep learning
- Random Matrix Theory and Wireless Communications
This page was built for publication: Products of many large random matrices and gradients in deep neural networks
