Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks
type: Item
instance of: scholarly article
title: Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks
author: Zhichao Wang
author: Yizhe Zhu
published in: The Annals of Applied Probability
publication date: 2024-08-21T00:00:00Z
Mathematics Subject Classification ID: 68T07
Mathematics Subject Classification ID: 62J07
Mathematics Subject Classification ID: 60B20
zbMATH DE Number: 7899436
zbMATH Keywords: neural networks
zbMATH Keywords: neural tangent kernel
zbMATH Keywords: random feature regression
zbMATH Keywords: random matrix theory
MaRDI profile type: MaRDI publication profile
cites work: A note on the Hanson-Wright inequality for random vectors with dependencies
cites work: Partial transposition of random states and non-centered semicircular distributions
cites work: Alice and Bob Meet Banach
cites work: On the Equivalence between Kernel Quadrature Rules and Random Feature Expansions
cites work: Spectral analysis of large dimensional random matrices
cites work: Convergence to the semicircle law
cites work: The limiting spectral distribution of the product of the Wigner matrix and a nonnegative definite matrix
cites work: Strong convergence of ESD for the generalized sample covariance matrices when \(p/n \rightarrow 0\)
cites work: An Inverse Matrix Adjustment Arising in Discriminant Analysis
cites work: Deep learning: a statistical viewpoint
cites work: Eigenvalue distribution of some nonlinear models of random matrices
cites work: Q4907706
cites work: CLT for linear spectral statistics of normalized sample covariance matrices with the dimension much larger than the sample size
cites work: Convergence of the largest eigenvalue of normalized sample covariance matrices when \(p\) and \(n\) both tend to infinity with their ratio converging to zero
cites work: Asymptotic freeness of layerwise Jacobians caused by invariance of multilayer perceptron: the Haar orthogonal case
cites work: The PPT square conjecture holds generically for some classes of independent states
cites work: Spiked singular values and vectors under extreme aspect ratios
cites work: Large-dimensional random matrix theory and its applications in deep learning and wireless communications
cites work: A Bound on Tail Probabilities for Quadratic Forms in Independent Random Variables
cites work: Universality Laws for High-Dimensional Learning With Random Features
cites work: Q3580453
cites work: Q3996929
cites work: Testing the sphericity of a covariance matrix when the dimension is much larger than the sample size
cites work: Just interpolate: kernel ``ridgeless'' regression can generalize
cites work: A random matrix approach to neural networks
cites work: Learning curves of generic features maps for realistic datasets with a teacher-student model*
cites work: Generalization error of random feature and kernel methods: hypercontractivity and kernel matrix concentration
cites work: The Generalization Error of Random Features Regression: Precise Asymptotics and the Double Descent Curve
cites work: The interpolation phase transition in neural networks: memorization and generalization under lazy training
cites work: Lectures on the Combinatorics of Free Probability
cites work: A note on the Pennington-Worah distribution
cites work: Asymptotic normality for eigenvalue statistics of a general sample covariance matrix when \(p/n \to \infty\) and applications
cites work: Hanson-Wright inequality and sub-Gaussian concentration
cites work: The smallest eigenvalue of a large dimensional Wishart matrix
cites work: User-friendly tail bounds for sums of random matrices
cites work: High-Dimensional Probability
cites work: Q3811203
cites work: Limiting spectral distribution of renormalized separable sample covariance matrices when \(p/n\to 0\)
cites work: Limiting spectral distribution of normalized sample covariance matrices with \(p/n\to 0\)
DOI: 10.1214/23-AAP2010
description: scientific article; zbMATH DE number 7899436