The eigenvalues and eigenvectors of finite, low rank perturbations of large random matrices

DOI10.1016/J.AIM.2011.02.007zbMATH Open1226.15023arXiv0910.2120OpenAlexW2099551908MaRDI QIDQ531808FDOQ531808

Authors: Florent Benaych-Georges, Raj Rao Nadakuditi 

Publication date: 20 April 2011

Published in: Advances in Mathematics (Search for Journal in Brave)

Abstract: We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of the perturbed matrix for additive and multiplicative perturbation models. The limiting non-random value is shown to depend explicitly on the limiting eigenvalue distribution of the unperturbed random matrix and the assumed perturbation model via integral transforms that correspond to very well known objects in free probability theory that linearize non-commutative free additive and multiplicative convolution. Furthermore, we uncover a phase transition phenomenon whereby the large matrix limit of the extreme eigenvalues of the perturbed matrix differs from that of the original matrix if and only if the eigenvalues of the perturbing matrix are above a certain critical threshold. Square root decay of the eigenvalue density at the edge is sufficient to ensure that this threshold is finite. This critical threshold is intimately related to the same aforementioned integral transforms and our proof techniques bring this connection and the origin of the phase transition into focus. Consequently, our results extend the class of `spiked' random matrix models about which such predictions (called the BBP phase transition) can be made well beyond the Wigner, Wishart and Jacobi random ensembles found in the literature. We examine the impact of this eigenvalue phase transition on the associated eigenvectors and observe an analogous phase transition in the eigenvectors. Various extensions of our results to the problem of non-extreme eigenvalues are discussed.

Full work available at URL: https://arxiv.org/abs/0910.2120

Recommendations

• Mesoscopic perturbations of large random matrices
• The singular values and vectors of low rank perturbations of large rectangular random matrices
• Limits of spiked random matrices. II
• Large deviations for the largest eigenvalues and eigenvectors of spiked Gaussian random matrices
• Limits of spiked random matrices. I

zbMATH Keywords

phase transitionprincipal components analysiseigenvalue distributionrandom matricesfree probabilityrandom perturbationsymmetric matrixHaar measurerandom eigenvaluesrandom eigenvectorssample covariance matricesinformational limit

Mathematics Subject Classification ID

Factor analysis and principal components; correspondence analysis (62H25) Eigenvalues, singular values, and eigenvectors (15A18) Random matrices (algebraic aspects) (15B52) Random matrices (probabilistic aspects) (60B20) Phase transitions (general) in equilibrium statistical mechanics (82B26) Free probability and free operator algebras (46L54)

Cites Work

• The polynomial method for random matrices
• Matrix Analysis
• Eigenvalues of large sample covariance matrices of spiked population models
• Title not available (Why is that?)
• Asymptotics of sample eigenstructure for a large dimensional spiked covariance model
• Finite sample approximation results for principal component analysis: A matrix perturbation approach
• The singular values and vectors of low rank perturbations of large rectangular random matrices
• Analysis of the limiting spectral distribution of large dimensional random matrices
• The concentration of measure phenomenon
• Title not available (Why is that?)
• Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
• An introduction to random matrices
• Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices
• Free Random Variables
• Uniform asymptotics for polynomials orthogonal with respect to varying exponential weights and applications to universality questions in random matrix theory
• Rank-one modification of the symmetric eigenproblem
• Generic behavior of the density of states in random matrix theory and equilibrium problems in the presence of real analytic external fields
• Title not available (Why is that?)
• A Fourier view on the \(R\)-transform and related asymptotics of spherical integrals
• The largest eigenvalues of finite rank deformation of large Wigner matrices: Convergence and nonuniversality of the fluctuations
• Large deviations of the extreme eigenvalues of random deformations of matrices
• The largest eigenvalue of rank one deformation of large Wigner matrices
• Eigenvalue separation in some random matrix models
• The largest eigenvalue of small rank perturbations of Hermitian random matrices
• Integration with respect to the Haar measure on unitary, orthogonal and symplectic group
• On the distribution of the roots of certain symmetric matrices
• Product of random projections, Jacobi ensembles and universality problems arising from free probability
• Rectangular random matrices, related convolution
• Restricted rank modification of the symmetric eigenvalue problem: Theoretical considerations
• Character expansion method for the first order asymptotics of a matrix integral
• On a surprising relation between the Marchenko-Pastur law, rectangular and square free convolutions
• Infinitely divisible distributions for rectangular free convolution: classification and matricial interpretation
• Refined perturbation bounds for eigenvalues of Hermitian and non-Hermitian matrices
• On the eigenvectors of large dimensional sample covariance matrices
• Some limit theorems on the eigenvectors of large dimensional sample covariance matrices

Cited In (only showing first 100 items - show all)

• A note on the CLT of the LSS for sample covariance matrix from a spiked population model
• Principal components in linear mixed models with general bulk
• Asymptotic mutual information for the balanced binary stochastic block model
• Large complex correlated Wishart matrices: fluctuations and asymptotic independence at the edges
• Statistical limits of spiked tensor models
• Limits of spiked random matrices. I
• Phase transition in the spiked random tensor with Rademacher prior
• A note on the prediction error of principal component regression in high dimensions
• Eigenvectors and eigenvalues in a random subspace of a tensor product
• Spectral statistics of sparse Erdős-Rényi graph Laplacians
• Strong convergence of the empirical distribution of eigenvalues of sample covariance matrices with a perturbation matrix
• Spectral measures of spiked random matrices
• Covariance estimation for distributions with \({2+\varepsilon}\) moments
• Fundamental limits of symmetric low-rank matrix estimation
• High-dimensional dynamics of generalization error in neural networks
• On the eigenvalues of specially low-rank perturbed matrices
• Entrywise eigenvector analysis of random matrices with low expected rank
• Local stability of the free additive convolution
• Outliers in the single ring theorem
• Additive/multiplicative free subordination property and limiting eigenvectors of spiked additive deformations of Wigner matrices and spiked sample covariance matrices
• Outliers in the spectrum of iid matrices with bounded rank perturbations
• The outliers of a deformed Wigner matrix
• Batch latency analysis and phase transitions for a tandem of queues with exponentially distributed service times
• Robust spiked random matrices and a robust G-MUSIC estimator
• Eigenvalue distributions of variance components estimators in high-dimensional random effects models
• The two-to-infinity norm and singular subspace geometry with applications to high-dimensional statistics
• Limiting distribution of the sample canonical correlation coefficients of high-dimensional random vectors
• Kernel spectral clustering of large dimensional data
• On the principal components of sample covariance matrices
• Canonical correlation coefficients of high-dimensional Gaussian vectors: finite rank case
• The largest eigenvalue of small rank perturbations of Hermitian random matrices
• Random matrix theory in statistics: a review
• Spectra of nearly Hermitian random matrices
• Eigenvectors of random matrices: A survey
• A survey on the eigenvalues local behavior of large complex correlated Wishart matrices
• Limits of spiked random matrices. II
• Eigenvector delocalization for non‐Hermitian random matrices and applications
• Large deviations for the largest eigenvalues and eigenvectors of spiked Gaussian random matrices
• Eigenvectors and controllability of non-Hermitian random matrices and directed graphs
• On finite rank deformations of Wigner matrices. II: Delocalized perturbations
• Large deviations of the extreme eigenvalues of random deformations of matrices
• On finite rank deformations of Wigner matrices
• Detection, reconstruction, and characterization algorithms from noisy data in multistatic wave imaging
• On bilinear forms based on the resolvent of large random matrices
• Low rank perturbations of large elliptic random matrices
• Singular vector distribution of sample covariance matrices
• Singular vectors under random perturbation
• Random perturbation of low rank matrices: improving classical bounds
• Subordination for the sum of two random matrices
• Empirical spectral distribution of a matrix under perturbation
• Optimal shrinkage of eigenvalues in the spiked covariance model
• Spectral statistics of Erdős-Rényi graphs. I: Local semicircle law
• The largest eigenvalue of real symmetric, Hermitian and Hermitian self-dual random matrix models with rank one external source. I
• The singular values and vectors of low rank perturbations of large rectangular random matrices
• Separation of the largest eigenvalues in eigenanalysis of genotype data from discrete subpopulations
• Outlier eigenvalues for deformed i.i.d. random matrices
• The isotropic semicircle law and deformation of Wigner matrices
• Detection thresholds in very sparse matrix completion
• Dynamics of a rank-one perturbation of a Hermitian matrix
• On singular values of large dimensional lag-\(\tau\) sample auto-correlation matrices
• Estimation of low-rank matrices via approximate message passing
• \(e\)PCA: high dimensional exponential family PCA
• Large bidiagonal matrices and random perturbations
• Cleaning large correlation matrices: tools from random matrix theory
• Circular law for noncentral random matrices
• Target detection and characterization from electromagnetic induction data
• An Eigenvalue Ratio Approach to Inferring Population Structure from Whole Genome Sequencing Data
• Optimality and sub-optimality of PCA. I: Spiked random matrix models
• On sample eigenvalues in a generalized spiked population model
• On the spectrum of random anti-symmetric and tournament matrices
• Order Determination for Spiked Type Models
• Tracy-Widom law for the extreme eigenvalues of large signal-plus-noise matrices
• CLT for spiked eigenvalues of a sample covariance matrix from high-dimensional Gaussian mean mixtures
• Notes on computational hardness of hypothesis testing: predictions using the low-degree likelihood ratio
• Right large deviation principle for the top eigenvalue of the sum or product of invariant random matrices
• Free probability of type B and asymptotics of finite-rank perturbations of random matrices
• Fundamental limits of detection in the spiked Wigner model
• Subexponential-time algorithms for sparse PCA
• A Unifying Tutorial on Approximate Message Passing
• Relative perturbation bounds with applications to empirical covariance operators
• Finite-rank perturbations of random band matrices via infinitesimal free probability
• Rank 1 perturbations in random matrix theory — A review of exact results
• Approximate message passing algorithms for rotationally invariant matrices
• First eigenvalue/eigenvector in sparse random symmetric matrices: influences of degree fluctuation
• Non-commutative probability insights into the double-scaling limit SYK model with constant perturbations: moments, cumulants and \(q\)-independence
• Eigenvalues of stochastic blockmodel graphs and random graphs with low-rank edge probability matrices
• Spiked sample covariance matrices with possibly multiple bulk components
• Free energy subadditivity for symmetric random Hamiltonians
• Freeness of type B and conditional freeness for random matrices
• Estimating latent asset-pricing factors
• Fundamental limits of weak recovery with applications to phase retrieval
• Spectrum of Markov generators on sparse random graphs
• Spiked multiplicative random matrices and principal components
• The statistics of spectral shifts due to finite rank perturbations
• Eigenvalues outside the bulk of inhomogeneous Erdős-Rényi random graphs
• Asymptotics of eigenstructure of sample correlation matrices for high-dimensional spiked models
• Near-optimal bounds for generalized orthogonal Procrustes problem via generalized power method
• Limiting Eigenvectors of Outliers for Spiked Information-Plus-Noise Type Matrices
• Entrywise limit theorems for eigenvectors of signal-plus-noise matrix models with weak signals
• Long random matrices and tensor unfolding

Uses Software

• RMTool

This page was built for publication: The eigenvalues and eigenvectors of finite, low rank perturbations of large random matrices

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q531808)