An orthogonally equivariant estimator of the covariance matrix in high dimensions and for small sample sizes
From MaRDI portal
Publication:830703
Abstract: We introduce an estimation method of covariance matrices in a high-dimensional setting, i.e., when the dimension of the matrix, , is larger than the sample size . Specifically, we propose an orthogonally equivariant estimator. The eigenvectors of such estimator are the same as those of the sample covariance matrix. The eigenvalue estimates are obtained from an adjusted profile likelihood function derived by approximating the integral of the density function of the sample covariance matrix over its eigenvectors, which is a challenging problem in its own right. Exact solutions to the approximate likelihood equations are obtained and employed to construct estimates that involve a tuning parameter. Bootstrap and cross-validation based algorithms are proposed to choose this tuning parameter under various loss functions. Finally, comparisons with two well-known orthogonally equivariant estimators of the covariance matrix are given, which are based on Monte-Carlo risk estimates for simulated data and misclassification errors in real data analyses. In addition, Monte-Carlo risk estimates are also provided to compare our estimates of eigenvalues to those of a consistent estimator of population eigenvalues.
Recommendations
- A regularized profile likelihood approach to covariance matrix estimation
- High dimensional covariance matrix estimation by penalizing the matrix-logarithm transformed likelihood
- Estimation of a high-dimensional covariance matrix with the Stein loss
- A Cholesky-based estimation for large-dimensional covariance matrices
- Improved Estimation of Eigenvalues and Eigenvectors of Covariance Matrices Using Their Sample Estimates
Cites work
- scientific article; zbMATH DE number 3954071 (Why is no real title available?)
- scientific article; zbMATH DE number 3655180 (Why is no real title available?)
- scientific article; zbMATH DE number 1860211 (Why is no real title available?)
- A regularized profile likelihood approach to covariance matrix estimation
- An orthogonally invariant minimax estimator of the covariance matrix of a multivariate normal population
- Analytical nonlinear shrinkage of large-dimensional covariance matrices
- Condition-Number-Regularized Covariance Estimation
- Eigenvalue Estimation of Parameterized Covariance Matrices of Large Dimensional Data
- Estimation of a covariance matrix under Stein's loss
- Estimation of a high-dimensional covariance matrix with the Stein loss
- Improved Estimation of Eigenvalues and Eigenvectors of Covariance Matrices Using Their Sample Estimates
- Lectures on the theory of estimation of many parameters
- Numerical implementation of the QuEST function
- On Certain Characteristics of the Distribution of the Latent Roots of a Symmetric Random Matrix Under General Conditions
- On a formula for the distribution of the maximum likelihood estimator
- On singular Wishart and singular multivariate beta distributions
- Optimal estimation of a large-dimensional covariance matrix under Stein's loss
- Regularized estimation of large covariance matrices
- SURE-tuned tapering estimation of large covariance matrices
- Shrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss
- Sparse estimation of a covariance matrix
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Spectrum estimation: a unified framework for covariance matrix estimation and PCA in large dimensions
- WKB-Expansion of the HarishChandra-Itzykson-Zuber Integral for Arbitrary
- Wishart and pseudo-Wishart distributions and some applications to shape theory
This page was built for publication: An orthogonally equivariant estimator of the covariance matrix in high dimensions and for small sample sizes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q830703)
