Adaptive thresholding for sparse covariance matrix estimation
From MaRDI portal
Publication:3095185
DOI10.1198/JASA.2011.TM10560zbMATH Open1232.62086arXiv1102.2237OpenAlexW1981638497MaRDI QIDQ3095185FDOQ3095185
Authors: Weidong Liu, T. Tony Cai 
Publication date: 28 October 2011
Published in: Journal of the American Statistical Association (Search for Journal in Brave)
Abstract: In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both theoretically and numerically. It is shown that the estimators adaptively achieve the optimal rate of convergence over a large class of sparse covariance matrices under the spectral norm. In contrast, the commonly used universal thresholding estimators are shown to be sub-optimal over the same parameter spaces. Support recovery is also discussed. The adaptive thresholding estimators are easy to implement. Numerical performance of the estimators is studied using both simulated and real data. Simulation results show that the adaptive thresholding estimators uniformly outperform the universal thresholding estimators. The method is also illustrated in an analysis on a dataset from a small round blue-cell tumors microarray experiment. A supplement to this paper which contains additional technical proofs is available online.
Full work available at URL: https://arxiv.org/abs/1102.2237
Recommendations
Cited In (only showing first 100 items - show all)
- A shrinkage principle for heavy-tailed data: high-dimensional robust low-rank matrix recovery
- Generalized thresholding estimators for high-dimensional location parameters
- A regularization-based adaptive test for high-dimensional GLMs
- Empirical likelihood test for the equality of several high-dimensional covariance matrices
- Hypothesis Testing of Matrix Graph Model with Application to Brain Connectivity Analysis
- Block-diagonal precision matrix regularization for ultra-high dimensional data
- Data science, big data and statistics
- Large covariance estimation for compositional data via composition-adjusted thresholding
- High-dimensional sparse MANOVA
- Bootstrap based inference for sparse high-dimensional time series models
- Scaling it up: stochastic search structure learning in graphical models
- Generalized thresholding of large covariance matrices
- Large volatility matrix estimation with factor-based diffusion model for high-frequency financial data
- An adaptive test for the mean vector in large-\(p\)-small-\(n\) problems
- Adaptive thresholding for large volatility matrix estimation based on high-frequency financial data
- Efficient Bayesian regularization for graphical model selection
- Maximum pairwise Bayes factors for covariance structure testing
- Regularization for high-dimensional covariance matrix
- An efficient algorithm for sparse inverse covariance matrix estimation based on dual formulation
- High dimensional minimum variance portfolio estimation under statistical factor models
- A multiple testing approach to the regularisation of large sample correlation matrices
- Testing independence with high-dimensional correlated samples
- Bootstrapping factor models with cross sectional dependence
- Covariance structure regularization via Frobenius-norm discrepancy
- High-dimensional covariance matrix estimation in approximate factor models
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Optimal estimation and rank detection for sparse spiked covariance matrices
- Asymptotic theory for maximum deviations of sample covariance matrix estimates
- The spectral norm of random inner-product kernel matrices
- Positive-definite \(\ell_1\)-penalized estimation of large covariance matrices
- Posterior convergence rates for estimating large precision matrices using graphical models
- Random matrix theory in statistics: a review
- Fast and adaptive sparse precision matrix estimation in high dimensions
- Positive-definite thresholding estimators of covariance matrices with zeros
- Refining genetically inferred relationships using treelet covariance smoothing
- Exact and asymptotic tests on a factor model in low and large dimensions with applications
- Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data
- Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Sparse covariance matrix estimation in high-dimensional deconvolution
- Forecasting co-volatilities via factor models with asymmetry and long memory in realized covariance
- Adaptive covariance matrix estimation through block thresholding
- Optimal rates of convergence for estimating Toeplitz covariance matrices
- On the systematic and idiosyncratic volatility with large panel high-frequency data
- Linear shrinkage estimation of large covariance matrices using factor models
- Minimax bounds for sparse PCA with noisy high-dimensional data
- On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
- High dimensional covariance matrix estimation using multi-factor models from incomplete information
- Optimal sparse eigenspace and low-rank density matrix estimation for quantum systems
- Estimation of autocovariance matrices for high dimensional linear processes
- Substitution principle for CLT of linear spectral statistics of high-dimensional sample covariance matrices with applications to hypothesis testing
- Projection tests for high-dimensional spiked covariance matrices
- High dimensional mean-variance optimization through factor analysis
- Distributed inference for linear support vector machine
- Large covariance estimation through elliptical factor models
- Statistical inference on the significance of rows and columns for matrix-valued data in an additive model
- Non-asymptotic error controlled sparse high dimensional precision matrix estimation
- Sign-based test for mean vector in high-dimensional and sparse settings
- Gaussian graphical model estimation with false discovery rate control
- A dimension reduction based approach for estimation and variable selection in partially linear single-index models with high-dimensional covariates
- Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings
- High dimensional change point inference: recent developments and extensions
- Sparse PCA-based on high-dimensional Itô processes with measurement errors
- Fixed support positive-definite modification of covariance matrix estimators via linear shrinkage
- Large Covariance Estimation by Thresholding Principal Orthogonal Complements
- Testing regression coefficients in high-dimensional and sparse settings
- High-dimensional covariance matrix estimation with missing observations
- Estimating sparse precision matrix: optimal rates of convergence and adaptive estimation
- Adaptive First-Order Methods for General Sparse Inverse Covariance Selection
- Covariance regularization by thresholding
- A Cholesky-based estimation for large-dimensional covariance matrices
- On the penalized maximum likelihood estimation of high-dimensional approximate factor model
- Factor analysis of correlation matrices when the number of random variables exceeds the sample size
- Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions
- Testing of high dimensional mean vectors via approximate factor model
- Tests for covariance matrix with fixed or divergent dimension
- Optimal rates of convergence for sparse covariance matrix estimation
- Risks of large portfolios
- Local Whittle estimation of high-dimensional long-run variance and precision matrices
- Estimation of high-dimensional dynamic conditional precision matrices with an application to forecast combination
- High-dimensional correlation matrix estimation for general continuous data with Bagging technique
- Estimation of time-varying covariance matrices for large datasets
- A computationally efficient and flexible algorithm for high dimensional mean and covariance matrix change point models
- Knowing factors or factor loadings, or neither? Evaluating estimators of large covariance matrices with noisy and asynchronous data
- Robust covariance estimation for approximate factor models
- An extreme-value approach for testing the equality of large U-statistic based correlation matrices
- Low-rank multi-parametric covariance identification
- Estimation of a sparse and spiked covariance matrix
- Bayesian sparse covariance decomposition with a graphical structure
- Estimating large covariance matrix with network topology for high-dimensional biomedical data
- Semiparametric model for covariance regression analysis
- Title not available (Why is that?)
- Embracing the blessing of dimensionality in factor models
- Max-sum tests for cross-sectional independence of high-dimensional panel data
- Detection of hubs in complex networks by the Laplacian matrix
- Covariance estimation via sparse Kronecker structures
- High-dimensional Markowitz portfolio optimization problem: empirical comparison of covariance matrix estimators
- Pre-averaging estimate of high dimensional integrated covariance matrix with noisy and asynchronous high-frequency data
- Geodesically parameterized covariance estimation
- Robust reduced rank regression in a distributed setting
- Fast nonasymptotic testing and support recovery for large sparse Toeplitz covariance matrices
This page was built for publication: Adaptive thresholding for sparse covariance matrix estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3095185)
