Partial estimation of covariance matrices
From MaRDI portal
Abstract: A classical approach to accurately estimating the covariance matrix Sigma of a p-variate normal distribution is to draw a sample of size n > p and form a sample covariance matrix. However, many modern applications operate with much smaller sample sizes, thus calling for estimation guarantees in the regime n << p. We show that a sample of size n = O(m log^6 p) is sufficient to accurately estimate in operator norm an arbitrary symmetric part of Sigma consisting of m < n entries per row. This follows from a general result on estimating Hadamard products M.Sigma, where M is an arbitrary symmetric matrix.
Recommendations
- How close is the sample covariance matrix to the actual covariance matrix?
- Covariance estimation for distributions with \({2+\varepsilon}\) moments
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Estimating covariance and precision matrices along subspaces
- Estimating the covariance of random matrices
Cites work
- scientific article; zbMATH DE number 49190 (Why is no real title available?)
- scientific article; zbMATH DE number 1254560 (Why is no real title available?)
- scientific article; zbMATH DE number 3244317 (Why is no real title available?)
- A limit theorem for the norm of random matrices
- A new approach to Cholesky-based covariance regularization in high dimensions
- Compressive sensing
- Covariance regularization by thresholding
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- Generalized thresholding of large covariance matrices
- Invertibility of symmetric random matrices
- Limit of the smallest eigenvalue of a large dimensional sample covariance matrix
- On consistency and sparsity for principal components analysis in high dimensions
- On the distribution of the largest eigenvalue in principal components analysis
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Optimal rates of convergence for covariance matrix estimation
- Regularized estimation of large covariance matrices
- The smallest eigenvalue of a large dimensional Wishart matrix
Cited in
(19)- Covariance estimation for distributions with \({2+\varepsilon}\) moments
- Partially pooled covariance matrix estimation in discriminant analysis
- Weak convergence of the empirical spectral distribution of high-dimensional band sample covariance matrices
- An efficiency upper bound for inverse covariance estimation
- Separable expansions for covariance estimation via the partial inner product
- Recent developments in high dimensional covariance estimation and its related issues, a review
- On the maximum-entropy approach to undersized samples
- Perturbations and projections of Kalman-Bucy semigroups
- Estimation of deviation for random covariance matrices
- Large covariance estimation through elliptical factor models
- Robust modifications of U-statistics and applications to covariance estimation problems
- Two kinds of variance/covariance estimates in linear mixed models
- New challenges in covariance estimation: multiple structures and coarse quantization
- How close is the sample covariance matrix to the actual covariance matrix?
- Covariance estimation under one-bit quantization
- From low- to high-dimensional moments without magic
- Estimating covariance and precision matrices along subspaces
- Estimation of functionals of sparse covariance matrices
- Application of matrix partitioning method to covariance matrix
This page was built for publication: Partial estimation of covariance matrices
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q714954)