Regularized estimation of large covariance matrices
From MaRDI portal
Publication:2477058
Abstract: This paper considers estimating a covariance matrix of variables from observations by either banding or tapering the sample covariance matrix, or estimating a banded version of the inverse of the covariance. We show that these estimates are consistent in the operator norm as long as , and obtain explicit rates. The results are uniform over some fairly natural well-conditioned families of covariance matrices. We also introduce an analogue of the Gaussian white noise model and show that if the population covariance is embeddable in that model and well-conditioned, then the banded approximations produce consistent estimates of the eigenvalues and associated eigenvectors of the covariance matrix. The results can be extended to smooth versions of banding and to non-Gaussian distributions with sufficiently short tails. A resampling approach is proposed for choosing the banding parameter in practice. This approach is illustrated numerically on both simulated and real data.
Recommendations
Cites work
- A limit theorem for the norm of random matrices
- A well-conditioned estimator for large-dimensional covariance matrices
- Automatic Local Smoothing for Spectral Density Estimation
- Covariance matrix selection and estimation via penalised normal likelihood
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- Estimation with quadratic loss.
- First-Order Methods for Sparse Covariance Selection
- High dimensional covariance matrix estimation using a factor model
- High-dimensional graphs and variable selection with the Lasso
- scientific article; zbMATH DE number 3139051 (Why is no real title available?)
- scientific article; zbMATH DE number 3136275 (Why is no real title available?)
- scientific article; zbMATH DE number 4213315 (Why is no real title available?)
- scientific article; zbMATH DE number 3988038 (Why is no real title available?)
- scientific article; zbMATH DE number 51763 (Why is no real title available?)
- scientific article; zbMATH DE number 477682 (Why is no real title available?)
- scientific article; zbMATH DE number 739533 (Why is no real title available?)
- scientific article; zbMATH DE number 1944329 (Why is no real title available?)
- scientific article; zbMATH DE number 837791 (Why is no real title available?)
- scientific article; zbMATH DE number 3239038 (Why is no real title available?)
- scientific article; zbMATH DE number 3349105 (Why is no real title available?)
- Limit of the smallest eigenvalue of a large dimensional sample covariance matrix
- Nonparametric estimation of large covariance matrices of longitudinal data
- On the distribution of the largest eigenvalue in principal components analysis
- Perturbation des transformations autoadjointes dans l'espace de Hilbert
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- Some theory for generalized boosting algorithms
- The strong limits of random matrix spectra for sample matrices of independent elements
Cited in
(only showing first 100 items - show all)- A CLT for regularized sample covariance matrices
- Covariance regularization by thresholding
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Flexible covariance estimation in graphical Gaussian models
- Regularized parameter estimation of high dimensional distribution
- Consistency of restricted maximum likelihood estimators of principal components
- Shrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss
- Sparsistency and rates of convergence in large covariance matrix estimation
- Concentration of measure and spectra of random matrices: applications to correlation matrices, elliptical distributions and beyond
- Estimating sufficient reductions of the predictors in abundant high-dimensional regressions
- Geometric median and robust estimation in Banach spaces
- Latent variable graphical model selection via convex optimization
- Non-asymptotic error controlled sparse high dimensional precision matrix estimation
- A well-conditioned estimator for large-dimensional covariance matrices
- Nonlinear shrinkage estimation of large-dimensional covariance matrices
- Two sample tests for high-dimensional covariance matrices
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Signal extraction approach for sparse multivariate response regression
- Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients
- Nonparametric Bayesian learning of heterogeneous dynamic transcription factor networks
- Model-based clustering of high-dimensional data: a review
- A joint convex penalty for inverse covariance matrix estimation
- Stable estimation of a covariance matrix guided by nuclear norm penalties
- Estimating large correlation matrices for international migration
- Optimal Bayesian minimax rates for unconstrained large covariance matrices
- High dimensional efficiency with applications to change point tests
- Recent developments in high dimensional covariance estimation and its related issues, a review
- Sparse vector Markov switching autoregressive models. Application to multivariate time series of temperature
- A generalized likelihood ratio test for normal mean when \(p\) is greater than \(n\)
- Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions
- Sparse estimation of high-dimensional correlation matrices
- Perturbations and projections of Kalman-Bucy semigroups
- Joint estimation of multiple Gaussian graphical models across unbalanced classes
- Confidence regions for entries of a large precision matrix
- A nonparametric eigenvalue-regularized integrated covariance matrix estimator for asset return data
- Performance analysis of local ensemble Kalman filter
- Using principal component analysis to estimate a high dimensional factor model with high-frequency data
- Asymptotic power of Rao's score test for independence in high dimensions
- Spectral clustering via sparse graph structure learning with application to proteomic signaling networks in cancer
- Consistency of large dimensional sample covariance matrix under weak dependence
- Bootstrap -- an exploration
- Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
- Knowing factors or factor loadings, or neither? Evaluating estimators of large covariance matrices with noisy and asynchronous data
- A multiple testing approach to the regularisation of large sample correlation matrices
- An extreme-value approach for testing the equality of large U-statistic based correlation matrices
- Accuracy of regularized D-rule for binary classification
- Large volatility matrix estimation with factor-based diffusion model for high-frequency financial data
- Covariance estimation via sparse Kronecker structures
- Gaussian and bootstrap approximations for high-dimensional U-statistics and their applications
- Multivariate Student-\(t\) self-organizing maps
- Factor-adjusted multiple testing of correlations
- Robust covariance and scatter matrix estimation under Huber's contamination model
- Weak convergence of the empirical spectral distribution of high-dimensional band sample covariance matrices
- Discussion: Latent variable graphical model selection via convex optimization
- Rejoinder: Latent variable graphical model selection via convex optimization
- Adaptive covariance matrix estimation through block thresholding
- Group symmetry and covariance regularization
- Estimating networks with jumps
- A dimension reduction based approach for estimation and variable selection in partially linear single-index models with high-dimensional covariates
- Sparse permutation invariant covariance estimation
- High dimensional sparse covariance estimation via directed acyclic graphs
- Nonparametric estimation of covariance functions by model selection
- Adaptive estimation of covariance matrices via Cholesky decomposition
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- Optimal rates of convergence for estimating Toeplitz covariance matrices
- Time varying undirected graphs
- Weighted covariance matrix estimation
- Semiparametric model for covariance regression analysis
- Covariance matrix regularization for banded Toeplitz structure via Frobenius-norm discrepancy
- Bayesian structure learning in graphical models
- Nonparametric estimation of large covariance matrices with conditional sparsity
- Model averaging prediction for time series models with a diverging number of parameters
- Parameter-free robust optimization for the maximum-Sharpe portfolio problem
- Estimation and optimal structure selection of high-dimensional Toeplitz covariance matrix
- Estimation of autocovariance matrices for high dimensional linear processes
- A novel change-point approach for the detection of gas emission sources using remotely contained concentration data
- Functional data clustering by projection into latent generalized hyperbolic subspaces
- Positive-definite modification of a covariance matrix by minimizing the matrix \(\ell_{\infty}\) norm with applications to portfolio optimization
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- Simplicial and minimal-variance distances in multivariate data analysis
- High-dimensional inference for linear model with correlated errors
- Design-free estimation of integrated covariance matrices for high-frequency data
- Regularized factor portfolio for cross-sectional multifactor models
- Large sample correlation matrices: a comparison theorem and its applications
- High-dimensional correlation matrix estimation for general continuous data with Bagging technique
- New challenges in covariance estimation: multiple structures and coarse quantization
- Bootstrapping the operator norm in high dimensions: error estimation for covariance matrices and sketching
- On skewed Gaussian graphical models
- Covariance estimation under one-bit quantization
- A sharp lower-tail bound for Gaussian maxima with application to bootstrap methods in high dimensions
- New hard-thresholding rules based on data splitting in high-dimensional imbalanced classification
- Estimation of conditional mean operator under the bandable covariance structure
- Non-asymptotic properties of spectral decomposition of large Gram-type matrices and applications
- Quadratic shrinkage for large covariance matrices
- Joint non-parametric estimation of mean and auto-covariances for Gaussian processes
- Bayesian joint inference for multiple directed acyclic graphs
- A factor-GARCH model for high dimensional volatilities
- Inference on covariance-mean regression
- A fast iterative algorithm for high-dimensional differential network
This page was built for publication: Regularized estimation of large covariance matrices
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2477058)
