PCA consistency in high dimension, low sample size context

DOI10.1214/09-AOS709zbMath1191.62108arXiv0911.3827OpenAlexW2078957532MaRDI QIDQ1043724

Sungkyu Jung, James Stephen Marron

Publication date: 9 December 2009

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/0911.3827

zbMATH Keywords

principal component analysissample covariance matrixnonstandard asymptoticshigh dimensionspiked population model\(\rho \)-mixingconsistency and strong inconsistencylow sample size data

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Factor analysis and principal components; correspondence analysis (62H25) Eigenvalues, singular values, and eigenvectors (15A18) Asymptotic distribution of eigenvalues, asymptotic theory of eigenfunctions for ordinary differential operators (34L20)

Related Items (86)

Distance-based outlier detection for high dimension, low sample size data ⋮ Reconstruction of a high-dimensional low-rank matrix ⋮ Significance analysis of high-dimensional, low-sample size partially labeled data ⋮ Poisson reduced-rank models with sparse loadings ⋮ Some clustering-based exact distribution-free \(k\)-sample tests applicable to high dimension, low sample size data ⋮ Adjusting systematic bias in high dimensional principal component scores ⋮ Overview of object oriented data analysis ⋮ A classifier under the strongly spiked eigenvalue model in high-dimension, low-sample-size context ⋮ Sparse principal component analysis and iterative thresholding ⋮ High dimensional asymptotics for the naive Hotelling T² statistic in pattern recognition ⋮ On two-sample mean tests under spiked covariances ⋮ Continuum directions for supervised dimension reduction ⋮ On the optimality of sliced inverse regression in high dimensions ⋮ Statistical inference for high-dimension, low-sample-size data ⋮ Some high-dimensional one-sample tests based on functions of interpoint distances ⋮ A High-Dimensional Two-Sample Test for Non-Gaussian Data under a Strongly Spiked Eigenvalue Model ⋮ Joint CLT for top eigenvalues of sample covariance matrices of separable high dimensional long memory processes ⋮ Asymptotic distributions of some test criteria for the mean vector with fewer observations than the dimension ⋮ Correlation tests for high-dimensional data using extended cross-data-matrix methodology ⋮ PCA consistency for the power spiked model in high-dimensional settings ⋮ A nonparametric two-sample test applicable to high dimensional data ⋮ Asymptotics of hierarchical clustering for growing dimension ⋮ A high dimensional dissimilarity measure ⋮ Sequential testing for structural stability in approximate factor models ⋮ PCA and eigen-inference for a spiked covariance model with largest eigenvalues of same asymptotic order ⋮ High-dimensional testing for proportional covariance matrices ⋮ Partial least squares for functional joint models with applications to the Alzheimer's disease neuroimaging initiative study ⋮ Estimation of functionals of sparse covariance matrices ⋮ Convergence and prediction of principal component scores in high-dimensional settings ⋮ Projection pursuit via white noise matrices ⋮ On the border of extreme and mild spiked models in the HDLSS framework ⋮ Efficient estimation of approximate factor models via penalized maximum likelihood ⋮ Distribution-free high-dimensional two-sample tests based on discriminating hyperplanes ⋮ Asymptotic properties of the first principal component and equality tests of covariance matrices in high-dimension, low-sample-size context ⋮ Limiting laws for divergent spiked eigenvalues and largest nonspiked eigenvalue of sample covariance matrices ⋮ A CLT for the LSS of large-dimensional sample covariance matrices with diverging spikes ⋮ On the eigenstructure of covariance matrices with divergent spikes ⋮ Boundary behavior in high dimension, low sample size asymptotics of PCA ⋮ Kernel naive Bayes discrimination for high‐dimensional pattern recognition ⋮ Unnamed Item ⋮ Pattern recognition based on canonical correlations in a high dimension low sample size context ⋮ An algorithm for deciding the number of clusters and validation using simulated data with application to exploring crop population structure ⋮ Sparse PCA: optimal rates and adaptive estimation ⋮ Simple and reliable estimators of coefficients of interest in a model with high-dimensional confounding effects ⋮ A test of sphericity for high-dimensional data and its application for detection of divergently spiked noise ⋮ A survey of high dimension low sample size asymptotics ⋮ Consistent High-Dimensional Bayesian Variable Selection via Penalized Credible Regions ⋮ The limits of the sample spiked eigenvalues for a high-dimensional generalized Fisher matrix and its applications ⋮ Testing for subsphericity when \(n\) and \(p\) are of different asymptotic order ⋮ Binary discrimination methods for high-dimensional data with a geometric representation ⋮ Distance-based and RKHS-based dependence metrics in high dimension ⋮ Asymptotics for empirical eigenvalue processes in high-dimensional linear factor models ⋮ Unbounded largest eigenvalue of large sample covariance matrices: asymptotics, fluctuations and applications ⋮ Two-Step Hypothesis Testing When the Number of Variables Exceeds the Sample Size ⋮ Using observed confidence levels to perform principal component analyses ⋮ High dimension low sample size asymptotics of robust PCA ⋮ Large Covariance Estimation by Thresholding Principal Orthogonal Complements ⋮ Sparse Principal Component Analysis in Hilbert Space ⋮ Subspace rotations for high-dimensional outlier detection ⋮ Effective PCA for high-dimension, low-sample-size data with singular value decomposition of cross data matrix ⋮ Integrative sparse principal component analysis ⋮ Distributed estimation of principal eigenspaces ⋮ Projected principal component analysis in factor models ⋮ On asymptotic normality of cross data matrix-based PCA in high dimension low sample size ⋮ A distance-based, misclassification rate adjusted classifier for multiclass, high-dimensional data ⋮ Sparse Sliced Inverse Regression Via Lasso ⋮ Clustering by principal component analysis with Gaussian kernel in high-dimension, low-sample-size settings ⋮ On high dimensional two-sample tests based on nearest neighbors ⋮ On some graph-based two-sample tests for high dimension, low sample size data ⋮ Testing and estimating change-points in the covariance matrix of a high-dimensional time series ⋮ Penalized Orthogonal Iteration for Sparse Estimation of Generalized Eigenvalue Problem ⋮ Effective PCA for high-dimension, low-sample-size data with noise reduction via geometric representations ⋮ Equality tests of high-dimensional covariance matrices under the strongly spiked eigenvalue model ⋮ Two-Stage Procedures for High-Dimensional Data ⋮ A guide for sparse PCA: model comparison and applications ⋮ Double data piling leads to perfect classification ⋮ Location-invariant tests of homogeneity of large-dimensional covariance matrices ⋮ Nonsparse Learning with Latent Variables ⋮ Consistency of the objective general index in high-dimensional settings ⋮ More about asymptotic properties of some binary classification methods for high dimensional data ⋮ Inference on high-dimensional mean vectors under the strongly spiked eigenvalue model ⋮ Asymptotic independence of spiked eigenvalues and linear spectral statistics for large sample covariance matrices ⋮ An \({\ell_p}\) theory of PCA and spectral clustering ⋮ Optimal estimation and rank detection for sparse spiked covariance matrices ⋮ On some transformations of high dimension, low sample size data for nearest neighbor classification ⋮ ``Virus hunting using radial distance weighted discrimination

Cites Work

• Unnamed Item
• Unnamed Item
• Basic properties of strong mixing conditions. A survey and some open questions
• On Wielandt's inequality and its application to the asymptotic distribution of the eigenvalues of a random symmetric matrix
• Perturbation theory for linear operators.
• On the distribution of the largest eigenvalue in principal components analysis
• Eigenvalues of large sample covariance matrices of spiked population models
• Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices
• Statistical Significance of Clustering for High-Dimension, Low–Sample Size Data
• On Strong Mixing Conditions for Stationary Gaussian Processes
• Geometric Representation of High Dimension, Low Sample Size Data
• The high-dimension, low-sample-size geometric representation holds under mild conditions
• The distribution of a statistic used for testing sphericity of normal distributions
• Linear Statistical Inference and its Applications

This page was built for publication: PCA consistency in high dimension, low sample size context