On estimation of the noise variance in high dimensional probabilistic principal component analysis
From MaRDI portal
(Redirected from Publication:5378155)
Abstract: In this paper, we develop new statistical theory for probabilistic principal component analysis models in high dimensions. The focus is the estimation of the noise variance, which is an important and unresolved issue when the number of variables is large in comparison with the sample size. We first unveil the reasons of a widely observed downward bias of the maximum likelihood estimator of the variance when the data dimension is high. We then propose a bias-corrected estimator using random matrix theory and establish its asymptotic normality. The superiority of the new (bias-corrected) estimator over existing alternatives is first checked by Monte-Carlo experiments with various combinations of (dimension and sample size). In order to demonstrate further potential benefits from the results of the paper to general probability PCA analysis, we provide evidence of net improvements in two popular procedures (Ulfarsson and Solo, 2008; Bai and Ng, 2002) for determining the number of principal components when the respective variance estimator proposed by these authors is replaced by the bias-corrected estimator. The new estimator is also used to derive new asymptotics for the related goodness-of-fit statistic under the high-dimensional scheme.
Recommendations
- Variance variation criterion and consistency in estimating the number of significant signals of high-dimensional PCA
- On consistency and sparsity for principal components analysis in high dimensions
- Bayesian estimation of the number of principal components
- Effective PCA for high-dimension, low-sample-size data with noise reduction via geometric representations
Cited in
(24)- A supplement on CLT for LSS under a large dimensional generalized spiked covariance model
- On two-sample mean tests under spiked covariances
- Bayesian variable selection for globally sparse probabilistic PCA
- Applications on linear spectral statistics of high-dimensional sample covariance matrix with divergent spectrum
- A high-dimensional test on linear hypothesis of means under a low-dimensional factor model
- Variance variation criterion and consistency in estimating the number of significant signals of high-dimensional PCA
- Sparse equisigned PCA: algorithms and performance bounds in the noisy rank-1 setting
- Hypothesis tests for principal component analysis when variables are standardized
- High dimensional matrix estimation with unknown variance of the noise
- High-dimensional linear discriminant analysis classifier for spiked covariance model
- Adjusting systematic bias in high dimensional principal component scores
- Order Determination for Spiked Type Models
- Improved shrinkage prediction under a spiked covariance structure
- A cure for variance inflation in high dimensional kernel principal component analysis
- Wald Statistics in high-dimensional PCA
- Exploring dimension learning via a penalized probabilistic principal component analysis
- A Universal Test on Spikes in a High-Dimensional Generalized Spiked Model and Its Applications
- Order determination for spiked-type models with a divergent number of spikes
- Testing General Linear Hypotheses Under a High-Dimensional Multivariate Regression Model with Spiked Noise Covariance
- Detecting spectral breaks in spiked covariance models
- Randomized empirical likelihood test for ultra-high dimensional means under general covariances
- Inference on testing the number of spikes in a high-dimensional generalized spiked Fisher matrix
- Noise variance estimation in a large-dimensional approximate factor model and its application
- A simultaneous test of mean vector and covariance matrix in high-dimensional settings
This page was built for publication: On estimation of the noise variance in high dimensional probabilistic principal component analysis
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5378155)
