Adaptive thresholding for sparse covariance matrix estimation
From MaRDI portal
Publication:3095185
Abstract: In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both theoretically and numerically. It is shown that the estimators adaptively achieve the optimal rate of convergence over a large class of sparse covariance matrices under the spectral norm. In contrast, the commonly used universal thresholding estimators are shown to be sub-optimal over the same parameter spaces. Support recovery is also discussed. The adaptive thresholding estimators are easy to implement. Numerical performance of the estimators is studied using both simulated and real data. Simulation results show that the adaptive thresholding estimators uniformly outperform the universal thresholding estimators. The method is also illustrated in an analysis on a dataset from a small round blue-cell tumors microarray experiment. A supplement to this paper which contains additional technical proofs is available online.
Recommendations
Cited in
(only showing first 100 items - show all)- Comment: Ridge Regression and Regularization of Large Matrices
- A shrinkage principle for heavy-tailed data: high-dimensional robust low-rank matrix recovery
- Adaptive thresholding estimator for differential association structures in two independent contingency tables
- Empirical likelihood test for the equality of several high-dimensional covariance matrices
- Generalized thresholding estimators for high-dimensional location parameters
- A regularization-based adaptive test for high-dimensional GLMs
- Local Whittle estimation of high-dimensional long-run variance and precision matrices
- High-dimensional correlation matrix estimation for general continuous data with Bagging technique
- Bayesian graph selection consistency under model misspecification
- Hypothesis Testing of Matrix Graph Model with Application to Brain Connectivity Analysis
- Estimation of high-dimensional dynamic conditional precision matrices with an application to forecast combination
- Estimation of time-varying covariance matrices for large datasets
- Data science, big data and statistics
- Adaptive Functional Thresholding for Sparse Covariance Function Estimation in High Dimensions
- Large covariance estimation by thresholding principal orthogonal complements. With discussion and authors' reply
- High-dimensional sparse MANOVA
- Block-diagonal precision matrix regularization for ultra-high dimensional data
- A computationally efficient and flexible algorithm for high dimensional mean and covariance matrix change point models
- Sparse basis covariance matrix estimation for high dimensional compositional data via hard thresholding
- Scaling it up: stochastic search structure learning in graphical models
- Large covariance estimation for compositional data via composition-adjusted thresholding
- Bootstrap based inference for sparse high-dimensional time series models
- Knowing factors or factor loadings, or neither? Evaluating estimators of large covariance matrices with noisy and asynchronous data
- Robust covariance estimation for approximate factor models
- An extreme-value approach for testing the equality of large U-statistic based correlation matrices
- Low-rank multi-parametric covariance identification
- Optimal covariance matrix estimation for high-dimensional noise in high-frequency data
- Realized regression with asynchronous and noisy high frequency and high dimensional data
- Estimation of a sparse and spiked covariance matrix
- Bayesian sparse covariance decomposition with a graphical structure
- Large volatility matrix estimation with factor-based diffusion model for high-frequency financial data
- Estimating large covariance matrix with network topology for high-dimensional biomedical data
- Generalized thresholding of large covariance matrices
- Semiparametric model for covariance regression analysis
- An adaptive test for the mean vector in large-p-small-n problems
- A new robust covariance matrix estimation for high-dimensional microbiome data
- High-dimensional covariance matrix estimation
- Adaptive thresholding for large volatility matrix estimation based on high-frequency financial data
- Learning gradients from nonidentical data
- Regularization for high-dimensional covariance matrix
- Efficient Bayesian regularization for graphical model selection
- Maximum pairwise Bayes factors for covariance structure testing
- An efficient algorithm for sparse inverse covariance matrix estimation based on dual formulation
- scientific article; zbMATH DE number 7415082 (Why is no real title available?)
- Max-sum tests for cross-sectional independence of high-dimensional panel data
- Detection of hubs in complex networks by the Laplacian matrix
- High dimensional minimum variance portfolio estimation under statistical factor models
- Covariance estimation via sparse Kronecker structures
- High-Dimensional Factor Regression for Heterogeneous Subpopulations
- A multiple testing approach to the regularisation of large sample correlation matrices
- Testing independence with high-dimensional correlated samples
- Embracing the blessing of dimensionality in factor models
- Bootstrapping factor models with cross sectional dependence
- Covariance structure regularization via Frobenius-norm discrepancy
- High-dimensional covariance matrix estimation in approximate factor models
- Detecting the large entries of a sparse covariance matrix in sub-quadratic time
- High-dimensional Markowitz portfolio optimization problem: empirical comparison of covariance matrix estimators
- Pre-averaging estimate of high dimensional integrated covariance matrix with noisy and asynchronous high-frequency data
- The five trolls under the bridge: principal component analysis with asynchronous and noisy high frequency data
- Activation discovery with FDR control: application to fMRI data
- Geodesically parameterized covariance estimation
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Optimal estimation and rank detection for sparse spiked covariance matrices
- Robust reduced rank regression in a distributed setting
- On high-dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization
- Statistical quality control using image intelligence: A sparse learning approach
- Covariance selection by thresholding the sample correlation matrix
- Asymptotic theory for maximum deviations of sample covariance matrix estimates
- The spectral norm of random inner-product kernel matrices
- A unified precision matrix estimation framework via sparse column-wise inverse operator under weak sparsity
- Estimation and inference in semiparametric quantile factor models
- Fast nonasymptotic testing and support recovery for large sparse Toeplitz covariance matrices
- scientific article; zbMATH DE number 7370601 (Why is no real title available?)
- High-dimensional mean estimation via \(\ell_1\) penalized normal likelihood
- Posterior convergence rates for estimating large precision matrices using graphical models
- A Compound Decision Approach to Covariance Matrix Estimation
- Minimax estimation of large precision matrices with bandable Cholesky factor
- Positive-definite \(\ell_1\)-penalized estimation of large covariance matrices
- Random matrix theory in statistics: a review
- A new semiparametric estimation approach for large dynamic covariance matrices with multiple conditioning variables
- Exact and asymptotic tests on a factor model in low and large dimensions with applications
- Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data
- Fast and adaptive sparse precision matrix estimation in high dimensions
- Refining genetically inferred relationships using treelet covariance smoothing
- Positive-definite thresholding estimators of covariance matrices with zeros
- scientific article; zbMATH DE number 7376767 (Why is no real title available?)
- Estimation and optimal structure selection of high-dimensional Toeplitz covariance matrix
- Robust high-dimensional factor models with applications to statistical machine learning
- Using principal component analysis to estimate a high dimensional factor model with high-frequency data
- Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Sparse covariance matrix estimation in high-dimensional deconvolution
- Cross-Validated Loss-based Covariance Matrix Estimator Selection in High Dimensions
- A LINEAR-PROGRAMMING PORTFOLIO OPTIMIZER TO MEAN–VARIANCE OPTIMIZATION
- Semi-parametric inference for large-scale data with temporally dependent noise
- Forecasting co-volatilities via factor models with asymmetry and long memory in realized covariance
- Adaptive covariance matrix estimation through block thresholding
- Optimal rates of convergence for estimating Toeplitz covariance matrices
- Linear shrinkage estimation of large covariance matrices using factor models
- On the systematic and idiosyncratic volatility with large panel high-frequency data
- TGCnA: temporal gene coexpression network analysis using a low-rank plus sparse framework
This page was built for publication: Adaptive thresholding for sparse covariance matrix estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3095185)
