Covariance regularization by thresholding
From MaRDI portal
Publication:1000302
DOI10.1214/08-AOS600zbMATH Open1196.62062arXiv0901.3079OpenAlexW3099609308MaRDI QIDQ1000302FDOQ1000302
Authors: Elizaveta Levina, P. J. Bickel 
Publication date: 6 February 2009
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: This paper considers regularizing a covariance matrix of variables estimated from observations, by hard thresholding. We show that the thresholded estimate is consistent in the operator norm as long as the true covariance matrix is sparse in a suitable sense, the variables are Gaussian or sub-Gaussian, and , and obtain explicit rates. The results are uniform over families of covariance matrices which satisfy a fairly natural notion of sparsity. We discuss an intuitive resampling scheme for threshold selection and prove a general cross-validation result that justifies this approach. We also compare thresholding to other covariance estimators in simulations and on an example from climate data.
Full work available at URL: https://arxiv.org/abs/0901.3079
Recommendations
covariance estimationregularizationsparsitythresholdinglarge \(p\) small \(n\)climate datahigh dimension low sample size
Asymptotic properties of parametric estimators (62F12) Bootstrap, jackknife and other resampling methods (62F40) Estimation in multivariate analysis (62H12) Applications of statistics to environmental and related topics (62P12)
Cites Work
- Weak convergence and empirical processes. With applications to statistics
- Ideal spatial adaptation by wavelet shrinkage
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- High dimensional covariance matrix estimation using a factor model
- Sparsistency and rates of convergence in large covariance matrix estimation
- A well-conditioned estimator for large-dimensional covariance matrices
- Sparse inverse covariance estimation with the graphical lasso
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- On the distribution of the largest eigenvalue in principal components analysis
- Sparse permutation invariant covariance estimation
- Network exploration via the adaptive LASSO and SCAD penalties
- Regularized estimation of large covariance matrices
- Adapting to unknown sparsity by controlling the false discovery rate
- Empirical Bayes selection of wavelet thresholds
- Title not available (Why is that?)
- Model selection and estimation in the Gaussian graphical model
- Asymptotics of sample eigenstructure for a large dimensional spiked covariance model
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- A Direct Formulation for Sparse PCA Using Semidefinite Programming
- Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment
- Sparse estimation of large covariance matrices via a nested Lasso penalty
- First-Order Methods for Sparse Covariance Selection
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- The concentration of measure phenomenon
- Nonparametric estimation of large covariance matrices of longitudinal data
- Title not available (Why is that?)
- Estimation of a covariance matrix under Stein's loss
- Empirical Bayes estimation of the multivariate normal covariance matrix
- Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
- Covariance matrix selection and estimation via penalised normal likelihood
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- Some theory for generalized boosting algorithms
Cited In (only showing first 100 items - show all)
- On consistency and sparsity for sliced inverse regression in high dimensions
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Model-based clustering of high-dimensional data: a review
- Sparse estimation of conditional graphical models with application to gene networks
- Covariance estimation: the GLM and regularization perspectives
- UPS delivers optimal phase diagram in high-dimensional variable selection
- Optimal rates of convergence for covariance matrix estimation
- PCA consistency for the power spiked model in high-dimensional settings
- Group symmetry and covariance regularization
- High dimensional sparse covariance estimation via directed acyclic graphs
- Sparse permutation invariant covariance estimation
- Bootstrap based inference for sparse high-dimensional time series models
- Scaling it up: stochastic search structure learning in graphical models
- Sharp minimax tests for large covariance matrices and adaptation
- Determination of vector error correction models in high dimensions
- Covariance-regularized regression and classification for high dimensional problems
- On principal graphical models with application to gene network
- Discussion: Latent variable graphical model selection via convex optimization
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- Adaptive thresholding for sparse covariance matrix estimation
- Functions preserving positive definiteness for sparse matrices
- Generalized thresholding of large covariance matrices
- Efficient estimation of approximate factor models via penalized maximum likelihood
- The finite sample properties of sparse M-estimators with pseudo-observations
- Rejoinder: Latent variable graphical model selection via convex optimization
- High-dimensional change-point estimation: combining filtering with convex optimization
- Test for bandedness of high-dimensional covariance matrices and bandwidth estimation
- Regularized estimation of large covariance matrices
- High dimensional minimum variance portfolio estimation under statistical factor models
- Discussion: Latent variable graphical model selection via convex optimization
- Detecting positive correlations in a multivariate sample
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Covariance and precision matrix estimation for high-dimensional time series
- Sparse PCA: optimal rates and adaptive estimation
- Asymptotic theory for maximum deviations of sample covariance matrix estimates
- Positive-definite \(\ell_1\)-penalized estimation of large covariance matrices
- Random matrix theory in statistics: a review
- Optimal sparse volatility matrix estimation for high-dimensional Itô processes with measurement errors
- Adaptive covariance matrix estimation through block thresholding
- Weak signals in high-dimensional regression: detection, estimation and prediction
- Optimal rates of convergence for estimating Toeplitz covariance matrices
- A note on moment inequality for quadratic forms
- A guided random walk through some high dimensional problems
- Bayesian discriminant analysis using a high dimensional predictor
- Banded regularization of autocovariance matrices in application to parameter estimation and forecasting of time series
- On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
- Estimation of autocovariance matrices for high dimensional linear processes
- Title not available (Why is that?)
- Regularized estimation in sparse high-dimensional time series models
- Substitution principle for CLT of linear spectral statistics of high-dimensional sample covariance matrices with applications to hypothesis testing
- Projection-based high-dimensional sign test
- Large covariance estimation through elliptical factor models
- Title not available (Why is that?)
- Confidence intervals for high-dimensional inverse covariance estimation
- Non-asymptotic error controlled sparse high dimensional precision matrix estimation
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Honest confidence regions and optimality in high-dimensional precision matrix estimation
- Vector diffusion maps and the connection Laplacian
- Principal component analysis for second-order stationary vector time series
- Two sample tests for high-dimensional covariance matrices
- Fixed support positive-definite modification of covariance matrix estimators via linear shrinkage
- Large Covariance Estimation by Thresholding Principal Orthogonal Complements
- Latent variable graphical model selection via convex optimization
- Sparse Matrix Graphical Models
- Sparse linear discriminant analysis by thresholding for high dimensional data
- Estimating sufficient reductions of the predictors in abundant high-dimensional regressions
- Geometric median and robust estimation in Banach spaces
- A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
- Projected principal component analysis in factor models
- High-dimensionality effects in the Markowitz problem and other quadratic programs with linear constraints: risk underestimation
- Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas
- Rates of convergence in conditional covariance matrix with nonparametric entries estimation
- Statistical challenges of high-dimensional data
- High-dimensional covariance matrix estimation with missing observations
- Estimation of (near) low-rank matrices with noise and high-dimensional scaling
- Estimating sparse precision matrix: optimal rates of convergence and adaptive estimation
- Asymptotic theory for large volatility matrix estimation based on high-frequency financial data
- Optimal detection of sparse principal components in high dimension
- Constrained Factor Models for High-Dimensional Matrix-Variate Time Series
- Covariance matrix estimation for stationary time series
- Sparsistency and rates of convergence in large covariance matrix estimation
- Regularization in statistics
- Optimal rates of convergence for sparse covariance matrix estimation
- Graph-guided banding of the covariance matrix
- Bayesian inference via projections
- Spatially dependent multiple testing under model misspecification, with application to detection of anthropogenic influence on extreme climate events
- High-dimensional correlation matrix estimation for general continuous data with Bagging technique
- Statistical inference for high-dimension, low-sample-size data
- New challenges in covariance estimation: multiple structures and coarse quantization
- Covariance estimation under one-bit quantization
- Double-slicing assisted sufficient dimension reduction for high-dimensional censored data
- Estimation of time-varying covariance matrices for large datasets
- Efficient estimation of conditional covariance matrices for dimension reduction
- Ill-posed estimation in high-dimensional models with instrumental variables
- Bayesian sparse covariance decomposition with a graphical structure
- Model-free forward screening via cumulative divergence
- An efficient numerical method for condition number constrained covariance matrix approximation
- Pre-averaging estimate of high dimensional integrated covariance matrix with noisy and asynchronous high-frequency data
- High-dimensional sufficient dimension reduction through principal projections
- Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications
Uses Software
This page was built for publication: Covariance regularization by thresholding
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1000302)
