High-dimensional covariance matrix estimation with missing observations
From MaRDI portal
Abstract: In this paper, we study the problem of high-dimensional approximately low-rank covariance matrix estimation with missing observations. We propose a simple procedure computationally tractable in high-dimension and that does not require imputation of the missing data. We establish non-asymptotic sparsity oracle inequalities for the estimation of the covariance matrix with the Frobenius and spectral norms, valid for any setting of the sample size and the dimension of the observations. We further establish minimax lower bounds showing that our rates are minimax optimal up to a logarithmic factor.
Recommendations
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- Spectral analysis of high-dimensional sample covariance matrices with missing observations
- Minimax optimal estimation of high-dimensional sparse covariance matrices with missing data
- Covariance Matrix Estimation With Non Uniform and Data Dependent Missing Observations
- Non-asymptotic rate for high-dimensional covariance estimation with non-independent missing observations
- High dimensional covariance matrix estimation using multi-factor models from incomplete information
- Mean response estimation with missing response in the presence of high-dimensional covariates
- Robust Estimation of the Mean and Covariance Matrix from Data with Missing Values
- High-dimensional covariance estimation
Cites work
- A constrained \(\ell _{1}\) minimization approach to sparse precision matrix estimation
- Adaptive thresholding for sparse covariance matrix estimation
- Characterization of the subdifferential of some matrix norms
- Covariance regularization by thresholding
- Estimation of high-dimensional low-rank matrices
- Fast approach to the tracy-widom law at the edge of GOE and GUE
- Generalized thresholding of large covariance matrices
- Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization
- High-dimensional graphs and variable selection with the Lasso
- Introduction to nonparametric estimation
- Matrix completion from noisy entries
- Model selection and estimation in the Gaussian graphical model
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- On the distribution of the largest eigenvalue in principal components analysis
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Optimal rates of convergence for covariance matrix estimation
- Optimal selection of reduced rank estimators of high-dimensional matrices
- Rank penalized estimators for high-dimensional matrices
- Recovering Low-Rank Matrices From Few Coefficients in Any Basis
- Simultaneous analysis of Lasso and Dantzig selector
- Sparse nonnegative solution of underdetermined linear equations by linear programming
- Sparse permutation invariant covariance estimation
- Spectral norm of products of random and deterministic matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Strong converse for identification via quantum channels
- Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators
- The Dantzig selector and sparsity oracle inequalities
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Power of Convex Relaxation: Near-Optimal Matrix Completion
- User-friendly tail bounds for sums of random matrices
Cited in
(70)- Geometric median and robust estimation in Banach spaces
- An expectation-maximization algorithm for the matrix normal distribution with an application in remote sensing
- New asymptotic results in principal component analysis
- Robust two-sample test of high-dimensional mean vectors under dependence
- Sub-Gaussian estimators of the mean of a random matrix with heavy-tailed entries
- Approximating \(L_p\) unit balls via random sampling
- Subspace estimation from unbalanced and incomplete data matrices: \({\ell_{2,\infty}}\) statistical guarantees
- Adaptive covariate acquisition for minimizing total cost of classification
- Estimating high-dimensional covariance and precision matrices under general missing dependence
- New challenges in covariance estimation: multiple structures and coarse quantization
- Bootstrapping the operator norm in high dimensions: error estimation for covariance matrices and sketching
- Heteroskedastic PCA: algorithm, optimality, and applications
- Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method
- Bootstrapping max statistics in high dimensions: near-parametric rates under weak variance decay and application to functional and multinomial data
- Robust covariance estimation under \(L_4\)-\(L_2\) norm equivalence
- Sensitivity analysis for inference with partially identifiable covariance matrices
- Robust modifications of U-statistics and applications to covariance estimation problems
- User-friendly covariance estimation for heavy-tailed distributions
- Non-asymptotic rate for high-dimensional covariance estimation with non-independent missing observations
- Learning causal structure from mixed data with missing values using Gaussian copula models
- Optimal estimation and rank detection for sparse spiked covariance matrices
- On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
- Spectral analysis of high-dimensional sample covariance matrices with missing observations
- Sparse covariance matrix estimation in high-dimensional deconvolution
- High dimensional covariance matrix estimation using multi-factor models from incomplete information
- Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas
- SONIC: social network analysis with influencers and communities
- Detecting approximate replicate components of a high-dimensional random vector with latent structure
- Estimation of the covariance matrix with two-step monotone missing data
- Gaussian and robust Kronecker product covariance estimation: existence and uniqueness
- Estimation of low-rank covariance function
- ECA: High-Dimensional Elliptical Component Analysis in Non-Gaussian Distributions
- Estimation of high-dimensional partially-observed discrete Markov random fields
- Nonparametric covariance estimation for mixed longitudinal studies, with applications in midlife women's health
- Minimax optimal estimation of high-dimensional sparse covariance matrices with missing data
- scientific article; zbMATH DE number 7625194 (Why is no real title available?)
- Nonconvex Low-Rank Tensor Completion from Noisy Data
- Optimal sparse linear prediction for block-missing multi-modality data without imputation
- Streaming principal component analysis from incomplete data
- Adaptive test for large covariance matrices with missing observations
- Discussion of ``Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Rejoinder of ``Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Estimating the Covariance of Fragmented and Other Related Types of Functional Data
- Rates of Bootstrap Approximation for Eigenvalues in High-Dimensional PCA
- Sparse precision matrix estimation with missing observations
- High-dimensional estimation of quadratic variation based on penalized realized variance
- Mean estimation in high dimension
- Inference for heteroskedastic PCA with missing data
- Robust estimation of covariance matrices: adversarial contamination and beyond
- Covariance estimation under missing observations and L₄ - L₂ moment equivalence
- Spectral analysis of Gram matrices with missing at random observations: convergence, central limit theorems, and applications in statistical inference
- Improved covariance estimation: optimal robustness and sub-Gaussian guarantees under heavy tails
- Covariance estimation with direction dependence accuracy
- Covariance estimation: optimal dimension-free guarantees for adversarial corruption and heavy tails
- Optimal estimation for a family of sparse covariance matrices with missing data
- On the estimation of Gaussian moment tensors
- Concentration and consistency of sample covariance matrix functionals in sub-Gaussian models
- Covariance operator estimation via adaptive thresholding
- Improved rates of bootstrap approximation for the operator norm: a coordinate-free approach
- Optimal estimation of high-dimensional sparse covariance matrices with missing data
- A parameter-free two-bit covariance estimator with improved operator norm error rate
- A semidefinite relaxation for sums of heterogeneous quadratic forms on the Stiefel manifold
- Deflated HeteroPCA: overcoming the curse of ill-conditioning in heteroskedastic PCA
- Sharper dimension-free bounds on the Frobenius distance between sample covariance and its expectation
- Estimation beyond missing (completely) at random
- Deviation bounds for the norm of a random vector under exponential moment conditions with applications
- Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data
- Moment bounds for large autocovariance matrices under dependence
- Missing values: sparse inverse covariance estimation and an extension to sparse regression
- Transposable regularized covariance models with an application to missing data imputation
This page was built for publication: High-dimensional covariance matrix estimation with missing observations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q395991)
