Covariance regularization by thresholding
From MaRDI portal
Abstract: This paper considers regularizing a covariance matrix of variables estimated from observations, by hard thresholding. We show that the thresholded estimate is consistent in the operator norm as long as the true covariance matrix is sparse in a suitable sense, the variables are Gaussian or sub-Gaussian, and , and obtain explicit rates. The results are uniform over families of covariance matrices which satisfy a fairly natural notion of sparsity. We discuss an intuitive resampling scheme for threshold selection and prove a general cross-validation result that justifies this approach. We also compare thresholding to other covariance estimators in simulations and on an example from climate data.
Recommendations
Cites work
- scientific article; zbMATH DE number 4213315 (Why is no real title available?)
- scientific article; zbMATH DE number 51763 (Why is no real title available?)
- A Direct Formulation for Sparse PCA Using Semidefinite Programming
- A well-conditioned estimator for large-dimensional covariance matrices
- Adapting to unknown sparsity by controlling the false discovery rate
- Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment
- Asymptotics of sample eigenstructure for a large dimensional spiked covariance model
- Covariance matrix selection and estimation via penalised normal likelihood
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- Empirical Bayes estimation of the multivariate normal covariance matrix
- Empirical Bayes selection of wavelet thresholds
- Estimation of a covariance matrix under Stein's loss
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- First-Order Methods for Sparse Covariance Selection
- High dimensional covariance matrix estimation using a factor model
- Ideal spatial adaptation by wavelet shrinkage
- Model selection and estimation in the Gaussian graphical model
- Network exploration via the adaptive LASSO and SCAD penalties
- Nonparametric estimation of large covariance matrices of longitudinal data
- On the distribution of the largest eigenvalue in principal components analysis
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Regularized estimation of large covariance matrices
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- Some theory for generalized boosting algorithms
- Sparse estimation of large covariance matrices via a nested Lasso penalty
- Sparse inverse covariance estimation with the graphical lasso
- Sparse permutation invariant covariance estimation
- Sparsistency and rates of convergence in large covariance matrix estimation
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- The concentration of measure phenomenon
- Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Weak convergence and empirical processes. With applications to statistics
Cited in
(only showing first 100 items - show all)- On an additive semigraphoid model for statistical networks with application to pathway analysis
- Estimating the number of sources in magnetoencephalography using spiked population eigenvalues
- Efficient estimation of conditional covariance matrices for dimension reduction
- A generative approach to modeling data with quantitative and qualitative responses
- Joint non-parametric estimation of mean and auto-covariances for Gaussian processes
- Subspace estimation from unbalanced and incomplete data matrices: \({\ell_{2,\infty}}\) statistical guarantees
- Model-free forward screening via cumulative divergence
- Ultrahigh dimensional precision matrix estimation via refitted cross validation
- Multivariate variable selection by means of null-beamforming
- Structural inference in sparse high-dimensional vector autoregressions
- Robust covariance estimation for distributed principal component analysis
- Sparsity concepts and estimation procedures for high-dimensional vector autoregressive models
- An \(\ell_{\infty}\) eigenvector perturbation bound and its application
- Estimation of time-varying covariance matrices for large datasets
- User-friendly covariance estimation for heavy-tailed distributions
- Spatially dependent multiple testing under model misspecification, with application to detection of anthropogenic influence on extreme climate events
- Spatial disease mapping using directed acyclic graph auto-regressive (DAGAR) models
- A numerical method for solving linear systems in the preconditioned Crank-Nicolson algorithm
- Robust sparse covariance estimation by thresholding Tyler's M-estimator
- Estimating large precision matrices via modified Cholesky decomposition
- Multivariate tests of independence and their application in correlation analysis between financial markets
- Graph informed sliced inverse regression
- Ill-posed estimation in high-dimensional models with instrumental variables
- Consistency of the objective general index in high-dimensional settings
- Design-free estimation of integrated covariance matrices for high-frequency data
- Nonparametric variable screening for multivariate additive models
- The beta-mixture shrinkage prior for sparse covariances with near-minimax posterior convergence rate
- Large sample correlation matrices: a comparison theorem and its applications
- High-dimensional sufficient dimension reduction through principal projections
- Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications
- Bayesian analysis of spherically parameterized dynamic multivariate stochastic volatility models
- High-dimensional mean estimation via \(\ell_1\) penalized normal likelihood
- A factor-GARCH model for high dimensional volatilities
- On cumulative slicing estimation for high dimensional data
- scientific article; zbMATH DE number 7376767 (Why is no real title available?)
- Fitting Laplacian regularized stratified Gaussian models
- Optimal sparse linear prediction for block-missing multi-modality data without imputation
- Inference on covariance-mean regression
- High dimensional classification for spatially dependent data with application to neuroimaging
- An efficient numerical method for condition number constrained covariance matrix approximation
- High-dimensional correlation matrix estimation for general continuous data with Bagging technique
- Minimax estimation of large precision matrices with bandable Cholesky factor
- Unified discrete-time factor stochastic volatility and continuous-time Itô models for combining inference based on low-frequency and high-frequency
- Statistical inference for high-dimension, low-sample-size data
- New challenges in covariance estimation: multiple structures and coarse quantization
- Point process convergence for the off-diagonal entries of sample covariance matrices
- Positive-definite modification of a covariance matrix by minimizing the matrix \(\ell_{\infty}\) norm with applications to portfolio optimization
- Covariance estimation under one-bit quantization
- Double-slicing assisted sufficient dimension reduction for high-dimensional censored data
- Estimation of a multiplicative correlation structure in the large dimensional case
- Pre-averaging estimate of high dimensional integrated covariance matrix with noisy and asynchronous high-frequency data
- Bayesian sparse covariance decomposition with a graphical structure
- Geometric median and robust estimation in Banach spaces
- Sparse estimation of conditional graphical models with application to gene networks
- Asymptotic theory for large volatility matrix estimation based on high-frequency financial data
- Statistical challenges of high-dimensional data
- Covariance estimation: the GLM and regularization perspectives
- A guided random walk through some high dimensional problems
- Estimation of autocovariance matrices for high dimensional linear processes
- UPS delivers optimal phase diagram in high-dimensional variable selection
- Group symmetry and covariance regularization
- High dimensional sparse covariance estimation via directed acyclic graphs
- Sparse permutation invariant covariance estimation
- A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
- Projected principal component analysis in factor models
- Scaling it up: stochastic search structure learning in graphical models
- Generalized thresholding of large covariance matrices
- Covariance and precision matrix estimation for high-dimensional time series
- Sparse PCA: optimal rates and adaptive estimation
- On consistency and sparsity for sliced inverse regression in high dimensions
- High-dimensionality effects in the Markowitz problem and other quadratic programs with linear constraints: risk underestimation
- Adaptive covariance matrix estimation through block thresholding
- Asymptotic theory for maximum deviations of sample covariance matrix estimates
- Sparsistency and rates of convergence in large covariance matrix estimation
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Honest confidence regions and optimality in high-dimensional precision matrix estimation
- Test for bandedness of high-dimensional covariance matrices and bandwidth estimation
- Bayesian discriminant analysis using a high dimensional predictor
- Regularization for high-dimensional covariance matrix
- Large covariance estimation by thresholding principal orthogonal complements. With discussion and authors' reply
- High-dimensional covariance matrix estimation with missing observations
- Large covariance estimation through elliptical factor models
- Banded regularization of autocovariance matrices in application to parameter estimation and forecasting of time series
- Weak signals in high-dimensional regression: detection, estimation and prediction
- Positive-definite \(\ell_1\)-penalized estimation of large covariance matrices
- Optimal rates of convergence for estimating Toeplitz covariance matrices
- Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas
- Detecting positive correlations in a multivariate sample
- scientific article; zbMATH DE number 7370562 (Why is no real title available?)
- Vector diffusion maps and the connection Laplacian
- Fixed support positive-definite modification of covariance matrix estimators via linear shrinkage
- Determination of vector error correction models in high dimensions
- Sharp minimax tests for large covariance matrices and adaptation
- Covariance-regularized regression and classification for high dimensional problems
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Bayesian inference via projections
- Principal component analysis for second-order stationary vector time series
- Optimal detection of sparse principal components in high dimension
- Latent variable graphical model selection via convex optimization
- Efficient estimation of approximate factor models via penalized maximum likelihood
This page was built for publication: Covariance regularization by thresholding
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1000302)
