Covariance regularization by thresholding
From MaRDI portal
Publication:1000302
DOI10.1214/08-AOS600zbMATH Open1196.62062arXiv0901.3079OpenAlexW3099609308MaRDI QIDQ1000302FDOQ1000302
Authors: Elizaveta Levina, P. J. Bickel 
Publication date: 6 February 2009
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: This paper considers regularizing a covariance matrix of variables estimated from observations, by hard thresholding. We show that the thresholded estimate is consistent in the operator norm as long as the true covariance matrix is sparse in a suitable sense, the variables are Gaussian or sub-Gaussian, and , and obtain explicit rates. The results are uniform over families of covariance matrices which satisfy a fairly natural notion of sparsity. We discuss an intuitive resampling scheme for threshold selection and prove a general cross-validation result that justifies this approach. We also compare thresholding to other covariance estimators in simulations and on an example from climate data.
Full work available at URL: https://arxiv.org/abs/0901.3079
Recommendations
covariance estimationregularizationsparsitythresholdinglarge \(p\) small \(n\)climate datahigh dimension low sample size
Asymptotic properties of parametric estimators (62F12) Bootstrap, jackknife and other resampling methods (62F40) Estimation in multivariate analysis (62H12) Applications of statistics to environmental and related topics (62P12)
Cites Work
- Weak convergence and empirical processes. With applications to statistics
- Ideal spatial adaptation by wavelet shrinkage
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- High dimensional covariance matrix estimation using a factor model
- Sparsistency and rates of convergence in large covariance matrix estimation
- A well-conditioned estimator for large-dimensional covariance matrices
- Sparse inverse covariance estimation with the graphical lasso
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- On the distribution of the largest eigenvalue in principal components analysis
- Sparse permutation invariant covariance estimation
- Network exploration via the adaptive LASSO and SCAD penalties
- Regularized estimation of large covariance matrices
- Adapting to unknown sparsity by controlling the false discovery rate
- Empirical Bayes selection of wavelet thresholds
- Title not available (Why is that?)
- Model selection and estimation in the Gaussian graphical model
- Asymptotics of sample eigenstructure for a large dimensional spiked covariance model
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- A Direct Formulation for Sparse PCA Using Semidefinite Programming
- Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment
- Sparse estimation of large covariance matrices via a nested Lasso penalty
- First-Order Methods for Sparse Covariance Selection
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- The concentration of measure phenomenon
- Nonparametric estimation of large covariance matrices of longitudinal data
- Title not available (Why is that?)
- Estimation of a covariance matrix under Stein's loss
- Empirical Bayes estimation of the multivariate normal covariance matrix
- Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
- Covariance matrix selection and estimation via penalised normal likelihood
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- Some theory for generalized boosting algorithms
Cited In (only showing first 100 items - show all)
- Adjusting for high-dimensional covariates in sparse precision matrix estimation by \(\ell_1\)-penalization
- Minimax optimal estimation of general bandable covariance matrices
- Informative estimation and selection of correlation structure for longitudinal data
- Structural shrinkage of nonparametric spectral estimators for multivariate time series
- Regression on manifolds: estimation of the exterior derivative
- Shrinkage tuning parameter selection in precision matrices estimation
- Source localization with MEG data: a beamforming approach based on covariance thresholding
- Block-diagonal precision matrix regularization for ultra-high dimensional data
- Large covariance estimation for compositional data via composition-adjusted thresholding
- Statistical and computational limits for sparse matrix detection
- Discussion: Latent variable graphical model selection via convex optimization
- A Bayesian information criterion for portfolio selection
- High dimensional covariance matrix estimation by penalizing the matrix-logarithm transformed likelihood
- A multiple testing approach to the regularisation of large sample correlation matrices
- More powerful tests for sparse high-dimensional covariances matrices
- Matrix positivity preservers in fixed dimension. I
- Nonparametric eigenvalue-regularized precision or covariance matrix estimator
- Bootstrapping factor models with cross sectional dependence
- Covariance structure regularization via Frobenius-norm discrepancy
- Retaining positive definiteness in thresholded matrices
- High-dimensional covariance matrix estimation in approximate factor models
- Optimal estimation and rank detection for sparse spiked covariance matrices
- Complete characterization of Hadamard powers preserving Loewner positivity, monotonicity, and convexity
- High-dimensional covariance estimation
- Implied basket correlation dynamics
- Robust inference of risks of large portfolios
- Testing super-diagonal structure in high dimensional covariance matrices
- Thresholding least-squares inference in high-dimensional regression models
- Distributed parameter and state estimation in petroleum reservoirs
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- Posterior convergence rates for estimating large precision matrices using graphical models
- Fast and adaptive sparse precision matrix estimation in high dimensions
- Positive-definite thresholding estimators of covariance matrices with zeros
- Tyler's and Maronna's M-estimators: non-asymptotic concentration results
- Sparse covariance matrix estimation in high-dimensional deconvolution
- Non-asymptotic rate for high-dimensional covariance estimation with non-independent missing observations
- Group-wise semiparametric modeling: a SCSE approach
- Linear shrinkage estimation of large covariance matrices using factor models
- Minimax bounds for sparse PCA with noisy high-dimensional data
- The impact of jumps and leverage in forecasting covolatility
- Estimation of covariance matrix via the sparse Cholesky factor with lasso
- A penalized empirical likelihood method in high dimensions
- Asymptotic performance of PCA for high-dimensional heteroscedastic data
- Optimal sparse eigenspace and low-rank density matrix estimation for quantum systems
- Multilevel ensemble Kalman filtering
- A regularized profile likelihood approach to covariance matrix estimation
- Sparse covariance thresholding for high-dimensional variable selection
- Sparse and low-rank covariance matrix estimation
- Consistency of restricted maximum likelihood estimators of principal components
- Projection tests for high-dimensional spiked covariance matrices
- A direct approach for sparse quadratic discriminant analysis
- A dimension reduction based approach for estimation and variable selection in partially linear single-index models with high-dimensional covariates
- Test for high dimensional covariance matrices
- Optimal estimation of a large-dimensional covariance matrix under Stein's loss
- Generalized principal component analysis for moderately non-stationary vector time series
- Sparse PCA-based on high-dimensional Itô processes with measurement errors
- Design-free estimation of variance matrices
- On nonparametric feature filters in electromagnetic imaging
- Limiting spectral distribution of large-dimensional sample covariance matrices generated by VARMA
- Fast convergence rates in estimating large volatility matrices using high-frequency financial data
- Partial estimation of covariance matrices
- Vast volatility matrix estimation for high-frequency financial data
- Nonstationary covariance modeling for incomplete data: Monte Carlo EM approach
- Detection of correlations
- Minimax optimal estimation of high-dimensional sparse covariance matrices with missing data
- Penalized least squares estimation with weakly dependent data
- A shrinkage principle for heavy-tailed data: high-dimensional robust low-rank matrix recovery
- Empirical likelihood test for the equality of several high-dimensional covariance matrices
- Estimation of linear functional of large spectral density matrix and application to Whittle's approach
- Cholesky-based model averaging for covariance matrix estimation
- A self-calibrated direct approach to precision matrix estimation and linear discriminant analysis in high dimensions
- Ensemble sparse estimation of covariance structure for exploring genetic disease data
- Convergence of covariance and spectral density estimates for high-dimensional locally stationary processes
- Autoregressive frequency detection using regularized least squares
- Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients
- Sparse estimation of high-dimensional correlation matrices
- Estimation of a sparse and spiked covariance matrix
- Low-rank diffusion matrix estimation for high-dimensional time-changed Lévy processes
- Gaussian and bootstrap approximations for high-dimensional U-statistics and their applications
- Large volatility matrix estimation with factor-based diffusion model for high-frequency financial data
- High-dimensional robust precision matrix estimation: cellwise corruption under \(\epsilon \)-contamination
- A testing based approach to the discovery of differentially correlated variable sets
- Estimating large correlation matrices for international migration
- Estimating large covariance matrix with network topology for high-dimensional biomedical data
- Consistency of large dimensional sample covariance matrix under weak dependence
- Efficient Bayesian regularization for graphical model selection
- Title not available (Why is that?)
- High-dimensional influence measure
- An efficient algorithm for sparse inverse covariance matrix estimation based on dual formulation
- Embracing the blessing of dimensionality in factor models
- On variable ordination of Cholesky‐based estimation for a sparse covariance matrix
- Sparse minimum discrepancy approach to sufficient dimension reduction with simultaneous variable selection in ultrahigh dimension
- An efficient ADMM algorithm for high dimensional precision matrix estimation via penalized quadratic loss
- The spectral norm of random inner-product kernel matrices
- A CLT for regularized sample covariance matrices
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- SURE-tuned tapering estimation of large covariance matrices
- Spectral analysis of high-dimensional time series
- Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data
- Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
Uses Software
This page was built for publication: Covariance regularization by thresholding
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1000302)
