Operator norm consistent estimation of large-dimensional sparse covariance matrices

DOI10.1214/07-AOS559zbMath1196.62064arXiv0901.3220OpenAlexW3103699839MaRDI QIDQ1000305

Noureddine El Karoui

Publication date: 6 February 2009

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/0901.3220

zbMATH Keywords

random matrix theorycorrelation matricessparsitymultivariate statistical analysishigh-dimensional inferencecovariance matricesadjacency matriceseigenvalues of covariance matrices\(\beta \)-sparsity

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Eigenvalues, singular values, and eigenvectors (15A18)

Related Items (only showing first 100 items - show all)

CORRELATION MATRIX OF EQUI-CORRELATED NORMAL POPULATION: FLUCTUATION OF THE LARGEST EIGENVALUE, SCALING OF THE BULK EIGENVALUES, AND STOCK MARKET ⋮ Optimal cleaning for singular values of cross-covariance matrices ⋮ Covariance Estimation for Matrix-valued Data ⋮ LARGE SYSTEM OF SEEMINGLY UNRELATED REGRESSIONS: A PENALIZED QUASI-MAXIMUM LIKELIHOOD ESTIMATION PERSPECTIVE ⋮ Positive-definite thresholding estimators of covariance matrices with zeros ⋮ A unified precision matrix estimation framework via sparse column-wise inverse operator under weak sparsity ⋮ The Lasso with general Gaussian designs with applications to hypothesis testing ⋮ Semi-parametric inference for large-scale data with temporally dependent noise ⋮ Detection of Multiple Structural Breaks in Large Covariance Matrices ⋮ Trimmed estimators for large dimensional sparse covariance matrices ⋮ Graph connection Laplacian methods can be made robust to noise ⋮ A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers ⋮ Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation ⋮ Double shrinkage estimators for large sparse covariance matrices ⋮ Tuning-parameter selection in regularized estimations of large covariance matrices ⋮ Large Covariance Estimation for Compositional Data Via Composition-Adjusted Thresholding ⋮ Sparse Minimum Discrepancy Approach to Sufficient Dimension Reduction with Simultaneous Variable Selection in Ultrahigh Dimension ⋮ Discussion: Latent variable graphical model selection via convex optimization ⋮ Discussion: Latent variable graphical model selection via convex optimization ⋮ Discussion: Latent variable graphical model selection via convex optimization ⋮ Discussion: Latent variable graphical model selection via convex optimization ⋮ Discussion: Latent variable graphical model selection via convex optimization ⋮ Discussion of: Treelets -- an adaptive multi-scale basis for sparse unordered data ⋮ SURE-tuned tapering estimation of large covariance matrices ⋮ Model-based clustering of high-dimensional data: a review ⋮ Estimating sparse precision matrix: optimal rates of convergence and adaptive estimation ⋮ A self-calibrated direct approach to precision matrix estimation and linear discriminant analysis in high dimensions ⋮ Estimating large correlation matrices for international migration ⋮ Regularization for high-dimensional covariance matrix ⋮ High-dimensional analysis of semidefinite relaxations for sparse principal components ⋮ Quadratic shrinkage for large covariance matrices ⋮ Limiting spectral distribution of large-dimensional sample covariance matrices generated by VARMA ⋮ Thresholding least-squares inference in high-dimensional regression models ⋮ Vast volatility matrix estimation for high-frequency financial data ⋮ The spectrum of kernel random matrices ⋮ Debt dynamics in Europe: a network general equilibrium GVAR approach ⋮ Recent developments in high dimensional covariance estimation and its related issues, a review ⋮ Block-Diagonal Covariance Estimation and Application to the Shapley Effects in Sensitivity Analysis ⋮ Perturbations and projections of Kalman-Bucy semigroups ⋮ Asymptotic performance of PCA for high-dimensional heteroscedastic data ⋮ Inferences in panel data with interactive effects using large covariance matrices ⋮ Detection of units with pervasive effects in large panel data models ⋮ High dimensional minimum variance portfolio estimation under statistical factor models ⋮ Minimax bounds for sparse PCA with noisy high-dimensional data ⋮ Robust sparse covariance estimation by thresholding Tyler's M-estimator ⋮ On information plus noise kernel random matrices ⋮ Optimal detection of sparse principal components in high dimension ⋮ Optimal sparse volatility matrix estimation for high-dimensional Itô processes with measurement errors ⋮ Large covariance estimation through elliptical factor models ⋮ Optimal shrinkage of eigenvalues in the spiked covariance model ⋮ Minimax optimal estimation of general bandable covariance matrices ⋮ Adjusting for high-dimensional covariates in sparse precision matrix estimation by \(\ell_1\)-penalization ⋮ High-dimensional covariance matrix estimation with missing observations ⋮ Convergence of the largest eigenvalue of normalized sample covariance matrices when \(p\) and \(n\) both tend to infinity with their ratio converging to zero ⋮ D-trace estimation of a precision matrix using adaptive lasso penalties ⋮ Sparse covariance matrix estimation in high-dimensional deconvolution ⋮ Estimation of functionals of sparse covariance matrices ⋮ High-dimensionality effects in the Markowitz problem and other quadratic programs with linear constraints: risk underestimation ⋮ Discussion: Latent variable graphical model selection via convex optimization ⋮ Rejoinder: Latent variable graphical model selection via convex optimization ⋮ Adaptive covariance matrix estimation through block thresholding ⋮ Statistical and computational limits for sparse matrix detection ⋮ Estimation of the inverse scatter matrix of an elliptically symmetric distribution ⋮ Nonstationary covariance modeling for incomplete data: Monte Carlo EM approach ⋮ Unnamed Item ⋮ Regression on manifolds: estimation of the exterior derivative ⋮ Detecting the large entries of a sparse covariance matrix in sub-quadratic time ⋮ Sparse permutation invariant covariance estimation ⋮ Adaptive estimation of covariance matrices via Cholesky decomposition ⋮ High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence ⋮ Covariance selection by thresholding the sample correlation matrix ⋮ A simple numerical method based simultaneous stochastic perturbation for estimation of high dimensional matrices ⋮ Optimal rates of convergence for estimating Toeplitz covariance matrices ⋮ Covariance estimation: the GLM and regularization perspectives ⋮ Covariance matrix estimation for stationary time series ⋮ Bayesian graph selection consistency under model misspecification ⋮ New sequence spaces and function spaces on interval \([0, 1\)] ⋮ Minimax estimation of large precision matrices with bandable Cholesky factor ⋮ Posterior convergence rates for estimating large precision matrices using graphical models ⋮ Design-free estimation of variance matrices ⋮ Spectral clustering via sparse graph structure learning with application to proteomic signaling networks in cancer ⋮ Random matrix theory in statistics: a review ⋮ The spectral norm of random inner-product kernel matrices ⋮ A panorama of positivity. II: Fixed dimension ⋮ A multiple testing approach to the regularisation of large sample correlation matrices ⋮ Positive-Definite ℓ₁-Penalized Estimation of Large Covariance Matrices ⋮ Statistical challenges of high-dimensional data ⋮ Regularized Parameter Estimation in High-Dimensional Gaussian Mixture Models ⋮ Gaussian and bootstrap approximations for high-dimensional U-statistics and their applications ⋮ Estimation of Graphical Models through Structured Norm Minimization ⋮ Informative Estimation and Selection of Correlation Structure for Longitudinal Data ⋮ Shrinkage and model selection with correlated variables via weighted fusion ⋮ Weighted covariance matrix estimation ⋮ Estimation of (near) low-rank matrices with noise and high-dimensional scaling ⋮ Bayesian structure learning in graphical models ⋮ Partial estimation of covariance matrices ⋮ NOVELIST estimator of large correlation and covariance matrices and their inverses ⋮ Optimal rates of convergence for covariance matrix estimation ⋮ Posterior contraction in sparse Bayesian factor models for massive covariance matrices ⋮ Latent variable graphical model selection via convex optimization

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A well-conditioned estimator for large-dimensional covariance matrices
• Characteristic vectors of bordered matrices with infinite dimensions
• A CLT for a band matrix model
• Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
• Covariance regularization by thresholding
• Spectrum estimation for large dimensional covariance matrices using random matrix theory
• A limit theorem for the norm of random matrices
• Empirical Bayes estimation of the multivariate normal covariance matrix
• Some limit theorems for the eigenvalues of a sample covariance matrix
• CLT for linear spectral statistics of large-dimensional sample covariance matrices.
• Strong convergence of the empirical distribution of eigenvalues of large dimensional random matrices
• Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
• Regularized estimation of large covariance matrices
• First-Order Methods for Sparse Covariance Selection
• Probability Inequalities for Sums of Bounded Random Variables
• Covariance matrix selection and estimation via penalised normal likelihood
• The Rotation of Eigenvectors by a Perturbation. III

This page was built for publication: Operator norm consistent estimation of large-dimensional sparse covariance matrices