Law of log determinant of sample covariance matrix and optimal estimation of differential entropy for high-dimensional Gaussian distributions
From MaRDI portal
Publication:2348449
Abstract: Differential entropy and log determinant of the covariance matrix of a multivariate Gaussian distribution have many applications in coding, communications, signal processing and statistical inference. In this paper we consider in the high dimensional setting optimal estimation of the differential entropy and the log-determinant of the covariance matrix. We first establish a central limit theorem for the log determinant of the sample covariance matrix in the high dimensional setting where the dimension can grow with the sample size . An estimator of the differential entropy and the log determinant is then considered. Optimal rate of convergence is obtained. It is shown that in the case the estimator is asymptotically sharp minimax. The ultra-high dimensional setting where is also discussed.
Recommendations
- A law of the iterated logarithm for the sample covariance matrix
- The logarithmic law of sample covariance matrices near singularity
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- Large-sample asymptotic approximations for the sampling and posterior distributions of differential entropy for multivariate normal distributions
- The law of large numbers for the maximum of almost Gaussian log-correlated fields coming from random matrices
- scientific article; zbMATH DE number 4169881
- Estimation of the entropy of a multivariate normal distribution
- scientific article; zbMATH DE number 2046378
- Cross Entropy Approximation of Structured Gaussian Covariance Matrices
Cites work
- A central limit theorem for the determinant of a Wigner matrix
- Entropy expressions and their estimators for multivariate distributions
- Estimation of the entropy of a multivariate normal distribution
- Geodesic Entropic Graphs for Dimension and Entropy Estimation in Manifold Learning
- scientific article; zbMATH DE number 3886886 (Why is no real title available?)
- scientific article; zbMATH DE number 5547558 (Why is no real title available?)
- scientific article; zbMATH DE number 1092005 (Why is no real title available?)
- scientific article; zbMATH DE number 1964693 (Why is no real title available?)
- scientific article; zbMATH DE number 3245540 (Why is no real title available?)
- scientific article; zbMATH DE number 3359487 (Why is no real title available?)
- scientific article; zbMATH DE number 4182510 (Why is no real title available?)
- Information inequality bounds on the minimax risk (with an application to nonparametric regression)
- On random ±1 matrices: Singularity and determinant
- Optimal rates of convergence for covariance matrix estimation
- Optimal rates of convergence for sparse covariance matrix estimation
- Parametric Bayesian estimation of differential entropy and relative entropy
- Random p-content of a p-parallelotope in Euclidean n-space
- Random matrices: law of the determinant
- Some limit theorems for the eigenvalues of a sample covariance matrix
- The Central Limit Theorem for Random Determinants
- The Distribution of the Determinant of a Complex Wishart Distributed Matrix
- The distribution of volume reductions induced by isotropic random projections
- Уточнение центральной предельной теоремы для случайных детерминантов
Cited in
(21)- Optimal Bayesian minimax rates for unconstrained large covariance matrices
- Test for equality of standardized generalized variance with different dimensions under high-dimensional settings
- Gaussian fluctuations of the determinant of Wigner matrices
- A general method for lower bounds on fluctuations of random variables
- Asymptotic behavior for log-determinants of several non-Hermitian random matrices
- Asymptotically efficient estimation of smooth functionals of covariance operators
- Exponential growth of random determinants beyond invariance
- Bernstein-von Mises theorems for functionals of the covariance matrix
- Estimating large precision matrices via modified Cholesky decomposition
- scientific article; zbMATH DE number 7626743 (Why is no real title available?)
- Visualizing Tests for Equality of Covariance Matrices
- Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Computationally Efficient Learning of Gaussian Linear Structural Equation Models with Equal Error Variances
- Phase transition in noisy high-dimensional random geometric graphs
- Generalized spherical principal component analysis
- Linear spectral statistics of sequential sample covariance matrices
- A comparison of methods for estimating the determinant of high-dimensional covariance matrix
- Moderate deviation principle for the determinant of sample correlation matrix
- Quadratic discriminant analysis in distributed frameworks
- Surprising geometrical properties of high-dimension low-sample size data with devastating consequences for data analysis
- A convex optimization approach to high-dimensional sparse quadratic discriminant analysis
This page was built for publication: Law of log determinant of sample covariance matrix and optimal estimation of differential entropy for high-dimensional Gaussian distributions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2348449)
