High-dimensional covariance matrix estimation with missing observations
From MaRDI portal
Abstract: In this paper, we study the problem of high-dimensional approximately low-rank covariance matrix estimation with missing observations. We propose a simple procedure computationally tractable in high-dimension and that does not require imputation of the missing data. We establish non-asymptotic sparsity oracle inequalities for the estimation of the covariance matrix with the Frobenius and spectral norms, valid for any setting of the sample size and the dimension of the observations. We further establish minimax lower bounds showing that our rates are minimax optimal up to a logarithmic factor.
Recommendations
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- Spectral analysis of high-dimensional sample covariance matrices with missing observations
- Minimax optimal estimation of high-dimensional sparse covariance matrices with missing data
- Covariance Matrix Estimation With Non Uniform and Data Dependent Missing Observations
- Non-asymptotic rate for high-dimensional covariance estimation with non-independent missing observations
- High dimensional covariance matrix estimation using multi-factor models from incomplete information
- Mean response estimation with missing response in the presence of high-dimensional covariates
- Robust Estimation of the Mean and Covariance Matrix from Data with Missing Values
- High-dimensional covariance estimation
Cites work
- A constrained \(\ell _{1}\) minimization approach to sparse precision matrix estimation
- Adaptive thresholding for sparse covariance matrix estimation
- Characterization of the subdifferential of some matrix norms
- Covariance regularization by thresholding
- Estimation of high-dimensional low-rank matrices
- Fast approach to the tracy-widom law at the edge of GOE and GUE
- Generalized thresholding of large covariance matrices
- Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization
- High-dimensional graphs and variable selection with the Lasso
- Introduction to nonparametric estimation
- Matrix completion from noisy entries
- Model selection and estimation in the Gaussian graphical model
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- On the distribution of the largest eigenvalue in principal components analysis
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Optimal rates of convergence for covariance matrix estimation
- Optimal selection of reduced rank estimators of high-dimensional matrices
- Rank penalized estimators for high-dimensional matrices
- Recovering Low-Rank Matrices From Few Coefficients in Any Basis
- Simultaneous analysis of Lasso and Dantzig selector
- Sparse nonnegative solution of underdetermined linear equations by linear programming
- Sparse permutation invariant covariance estimation
- Spectral norm of products of random and deterministic matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Strong converse for identification via quantum channels
- Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators
- The Dantzig selector and sparsity oracle inequalities
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Power of Convex Relaxation: Near-Optimal Matrix Completion
- User-friendly tail bounds for sums of random matrices
Cited in
(56)- Improved covariance estimation: optimal robustness and sub-Gaussian guarantees under heavy tails
- Inference for heteroskedastic PCA with missing data
- Spectral analysis of Gram matrices with missing at random observations: convergence, central limit theorems, and applications in statistical inference
- Robust estimation of covariance matrices: adversarial contamination and beyond
- Covariance estimation under missing observations and \(L_4 - L_2\) moment equivalence
- Mean estimation in high dimension
- Geometric median and robust estimation in Banach spaces
- Sub-Gaussian estimators of the mean of a random matrix with heavy-tailed entries
- Heteroskedastic PCA: algorithm, optimality, and applications
- Estimation of high-dimensional partially-observed discrete Markov random fields
- Sensitivity analysis for inference with partially identifiable covariance matrices
- Subspace estimation from unbalanced and incomplete data matrices: \({\ell_{2,\infty}}\) statistical guarantees
- Nonparametric covariance estimation for mixed longitudinal studies, with applications in midlife women's health
- Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method
- An expectation-maximization algorithm for the matrix normal distribution with an application in remote sensing
- SONIC: social network analysis with influencers and communities
- Rejoinder of ``Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Gaussian and robust Kronecker product covariance estimation: existence and uniqueness
- Learning causal structure from mixed data with missing values using Gaussian copula models
- Adaptive test for large covariance matrices with missing observations
- Minimax optimal estimation of high-dimensional sparse covariance matrices with missing data
- High-dimensional estimation of quadratic variation based on penalized realized variance
- User-friendly covariance estimation for heavy-tailed distributions
- Approximating \(L_p\) unit balls via random sampling
- Transposable regularized covariance models with an application to missing data imputation
- New asymptotic results in principal component analysis
- Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas
- Adaptive covariate acquisition for minimizing total cost of classification
- Streaming principal component analysis from incomplete data
- Estimation of the covariance matrix with two-step monotone missing data
- Robust modifications of U-statistics and applications to covariance estimation problems
- Missing values: sparse inverse covariance estimation and an extension to sparse regression
- Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data
- Bootstrapping the operator norm in high dimensions: error estimation for covariance matrices and sketching
- On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
- Optimal sparse linear prediction for block-missing multi-modality data without imputation
- Optimal estimation and rank detection for sparse spiked covariance matrices
- High dimensional covariance matrix estimation using multi-factor models from incomplete information
- Sparse covariance matrix estimation in high-dimensional deconvolution
- Spectral analysis of high-dimensional sample covariance matrices with missing observations
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- scientific article; zbMATH DE number 7625194 (Why is no real title available?)
- Moment bounds for large autocovariance matrices under dependence
- New challenges in covariance estimation: multiple structures and coarse quantization
- Robust covariance estimation under \(L_4\)-\(L_2\) norm equivalence
- Bootstrapping max statistics in high dimensions: near-parametric rates under weak variance decay and application to functional and multinomial data
- Estimation of low-rank covariance function
- Non-asymptotic rate for high-dimensional covariance estimation with non-independent missing observations
- Robust two-sample test of high-dimensional mean vectors under dependence
- Nonconvex Low-Rank Tensor Completion from Noisy Data
- Detecting approximate replicate components of a high-dimensional random vector with latent structure
- Discussion of ``Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- ECA: High-Dimensional Elliptical Component Analysis in Non-Gaussian Distributions
- Rates of Bootstrap Approximation for Eigenvalues in High-Dimensional PCA
- Estimating the Covariance of Fragmented and Other Related Types of Functional Data
- Sparse precision matrix estimation with missing observations
This page was built for publication: High-dimensional covariance matrix estimation with missing observations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q395991)