Covariance regularization by thresholding
From MaRDI portal
Publication:1000302
DOI10.1214/08-AOS600zbMATH Open1196.62062arXiv0901.3079OpenAlexW3099609308MaRDI QIDQ1000302FDOQ1000302
Authors: Elizaveta Levina, P. J. Bickel 
Publication date: 6 February 2009
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: This paper considers regularizing a covariance matrix of variables estimated from observations, by hard thresholding. We show that the thresholded estimate is consistent in the operator norm as long as the true covariance matrix is sparse in a suitable sense, the variables are Gaussian or sub-Gaussian, and , and obtain explicit rates. The results are uniform over families of covariance matrices which satisfy a fairly natural notion of sparsity. We discuss an intuitive resampling scheme for threshold selection and prove a general cross-validation result that justifies this approach. We also compare thresholding to other covariance estimators in simulations and on an example from climate data.
Full work available at URL: https://arxiv.org/abs/0901.3079
Recommendations
covariance estimationregularizationsparsitythresholdinglarge \(p\) small \(n\)climate datahigh dimension low sample size
Asymptotic properties of parametric estimators (62F12) Bootstrap, jackknife and other resampling methods (62F40) Estimation in multivariate analysis (62H12) Applications of statistics to environmental and related topics (62P12)
Cites Work
- Weak convergence and empirical processes. With applications to statistics
- Ideal spatial adaptation by wavelet shrinkage
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- High dimensional covariance matrix estimation using a factor model
- Sparsistency and rates of convergence in large covariance matrix estimation
- A well-conditioned estimator for large-dimensional covariance matrices
- Sparse inverse covariance estimation with the graphical lasso
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- On the distribution of the largest eigenvalue in principal components analysis
- Sparse permutation invariant covariance estimation
- Network exploration via the adaptive LASSO and SCAD penalties
- Regularized estimation of large covariance matrices
- Adapting to unknown sparsity by controlling the false discovery rate
- Empirical Bayes selection of wavelet thresholds
- Title not available (Why is that?)
- Model selection and estimation in the Gaussian graphical model
- Asymptotics of sample eigenstructure for a large dimensional spiked covariance model
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- A Direct Formulation for Sparse PCA Using Semidefinite Programming
- Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment
- Sparse estimation of large covariance matrices via a nested Lasso penalty
- First-Order Methods for Sparse Covariance Selection
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- The concentration of measure phenomenon
- Nonparametric estimation of large covariance matrices of longitudinal data
- Title not available (Why is that?)
- Estimation of a covariance matrix under Stein's loss
- Empirical Bayes estimation of the multivariate normal covariance matrix
- Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
- Covariance matrix selection and estimation via penalised normal likelihood
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- Some theory for generalized boosting algorithms
Cited In (only showing first 100 items - show all)
- Spatially dependent multiple testing under model misspecification, with application to detection of anthropogenic influence on extreme climate events
- High-dimensional correlation matrix estimation for general continuous data with Bagging technique
- Statistical inference for high-dimension, low-sample-size data
- New challenges in covariance estimation: multiple structures and coarse quantization
- Covariance estimation under one-bit quantization
- Double-slicing assisted sufficient dimension reduction for high-dimensional censored data
- Estimation of time-varying covariance matrices for large datasets
- Efficient estimation of conditional covariance matrices for dimension reduction
- Ill-posed estimation in high-dimensional models with instrumental variables
- Bayesian sparse covariance decomposition with a graphical structure
- Model-free forward screening via cumulative divergence
- An efficient numerical method for condition number constrained covariance matrix approximation
- Pre-averaging estimate of high dimensional integrated covariance matrix with noisy and asynchronous high-frequency data
- High-dimensional sufficient dimension reduction through principal projections
- Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications
- On cumulative slicing estimation for high dimensional data
- Fitting Laplacian regularized stratified Gaussian models
- Estimation of a multiplicative correlation structure in the large dimensional case
- Graph informed sliced inverse regression
- A generative approach to modeling data with quantitative and qualitative responses
- Joint non-parametric estimation of mean and auto-covariances for Gaussian processes
- High-dimensional mean estimation via \(\ell_1\) penalized normal likelihood
- High dimensional classification for spatially dependent data with application to neuroimaging
- Minimax estimation of large precision matrices with bandable Cholesky factor
- On an additive semigraphoid model for statistical networks with application to pathway analysis
- An \(\ell_{\infty}\) eigenvector perturbation bound and its application
- Title not available (Why is that?)
- Estimating the number of sources in magnetoencephalography using spiked population eigenvalues
- Robust covariance estimation for distributed principal component analysis
- Estimating large precision matrices via modified Cholesky decomposition
- A factor-GARCH model for high dimensional volatilities
- Subspace estimation from unbalanced and incomplete data matrices: \({\ell_{2,\infty}}\) statistical guarantees
- Multivariate variable selection by means of null-beamforming
- Spatial disease mapping using directed acyclic graph auto-regressive (DAGAR) models
- Sparsity concepts and estimation procedures for high-dimensional vector autoregressive models
- Inference on covariance-mean regression
- Unified discrete-time factor stochastic volatility and continuous-time Itô models for combining inference based on low-frequency and high-frequency
- A numerical method for solving linear systems in the preconditioned Crank-Nicolson algorithm
- Robust sparse covariance estimation by thresholding Tyler's M-estimator
- Positive-definite modification of a covariance matrix by minimizing the matrix \(\ell_{\infty}\) norm with applications to portfolio optimization
- Ultrahigh dimensional precision matrix estimation via refitted cross validation
- Optimal sparse linear prediction for block-missing multi-modality data without imputation
- Bayesian analysis of spherically parameterized dynamic multivariate stochastic volatility models
- Structural inference in sparse high-dimensional vector autoregressions
- Consistency of the objective general index in high-dimensional settings
- Design-free estimation of integrated covariance matrices for high-frequency data
- Nonparametric variable screening for multivariate additive models
- The beta-mixture shrinkage prior for sparse covariances with near-minimax posterior convergence rate
- Large sample correlation matrices: a comparison theorem and its applications
- Multivariate tests of independence and their application in correlation analysis between financial markets
- Point process convergence for the off-diagonal entries of sample covariance matrices
- User-friendly covariance estimation for heavy-tailed distributions
- Adjusting for high-dimensional covariates in sparse precision matrix estimation by \(\ell_1\)-penalization
- Minimax optimal estimation of general bandable covariance matrices
- Informative estimation and selection of correlation structure for longitudinal data
- Structural shrinkage of nonparametric spectral estimators for multivariate time series
- Regression on manifolds: estimation of the exterior derivative
- Shrinkage tuning parameter selection in precision matrices estimation
- Source localization with MEG data: a beamforming approach based on covariance thresholding
- Block-diagonal precision matrix regularization for ultra-high dimensional data
- Large covariance estimation for compositional data via composition-adjusted thresholding
- Statistical and computational limits for sparse matrix detection
- Discussion: Latent variable graphical model selection via convex optimization
- A Bayesian information criterion for portfolio selection
- High dimensional covariance matrix estimation by penalizing the matrix-logarithm transformed likelihood
- A multiple testing approach to the regularisation of large sample correlation matrices
- More powerful tests for sparse high-dimensional covariances matrices
- Matrix positivity preservers in fixed dimension. I
- Nonparametric eigenvalue-regularized precision or covariance matrix estimator
- Bootstrapping factor models with cross sectional dependence
- Covariance structure regularization via Frobenius-norm discrepancy
- Retaining positive definiteness in thresholded matrices
- High-dimensional covariance matrix estimation in approximate factor models
- Optimal estimation and rank detection for sparse spiked covariance matrices
- Complete characterization of Hadamard powers preserving Loewner positivity, monotonicity, and convexity
- High-dimensional covariance estimation
- Implied basket correlation dynamics
- Robust inference of risks of large portfolios
- Testing super-diagonal structure in high dimensional covariance matrices
- Thresholding least-squares inference in high-dimensional regression models
- Distributed parameter and state estimation in petroleum reservoirs
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- Posterior convergence rates for estimating large precision matrices using graphical models
- Fast and adaptive sparse precision matrix estimation in high dimensions
- Positive-definite thresholding estimators of covariance matrices with zeros
- Tyler's and Maronna's M-estimators: non-asymptotic concentration results
- Sparse covariance matrix estimation in high-dimensional deconvolution
- Non-asymptotic rate for high-dimensional covariance estimation with non-independent missing observations
- Group-wise semiparametric modeling: a SCSE approach
- Linear shrinkage estimation of large covariance matrices using factor models
- Minimax bounds for sparse PCA with noisy high-dimensional data
- The impact of jumps and leverage in forecasting covolatility
- Estimation of covariance matrix via the sparse Cholesky factor with lasso
- A penalized empirical likelihood method in high dimensions
- Asymptotic performance of PCA for high-dimensional heteroscedastic data
- Optimal sparse eigenspace and low-rank density matrix estimation for quantum systems
- Multilevel ensemble Kalman filtering
- A regularized profile likelihood approach to covariance matrix estimation
- Sparse covariance thresholding for high-dimensional variable selection
- Sparse and low-rank covariance matrix estimation
Uses Software
This page was built for publication: Covariance regularization by thresholding
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1000302)
