Statistical estimation of the Shannon entropy
From MaRDI portal
Publication:1734902
Abstract: The behavior of the Kozachenko - Leonenko estimates for the (differential) Shannon entropy is studied when the number of i.i.d. vector-valued observations tends to infinity. The asymptotic unbiasedness and L^2-consistency of the estimates are established. The conditions employed involve the analogues of the Hardy - Littlewood maximal function. It is shown that the results are valid in particular for the entropy estimation of any nondegenerate Gaussian vector.
Recommendations
- Statistical estimation of conditional Shannon entropy
- Bayesian estimation of shannon entropy
- A new estimator for Shannon entropy
- Estimation of Entropy and Mutual Information
- scientific article; zbMATH DE number 123403
- scientific article; zbMATH DE number 5649057
- Estimation of the Shannon's entropy of several shifted exponential populations
- scientific article; zbMATH DE number 3913431
- Shannon's entropy in exponential families: statistical applications
Cites work
- A class of Rényi information estimators for multidimensional densities
- A computationally efficient estimator for mutual information
- A Mathematical Theory of Communication
- Asymptotic moments of near–neighbour distance distributions
- Efficient estimation of integral functionals of a density
- Ensemble Estimators for Multivariate Entropy Estimation
- Entropy-based inhomogeneity detection in fiber materials
- Entropy: the Markov ordering approach
- Foundations of Modern Probability
- scientific article; zbMATH DE number 1354815 (Why is no real title available?)
- scientific article; zbMATH DE number 1092005 (Why is no real title available?)
- scientific article; zbMATH DE number 825585 (Why is no real title available?)
- Mutual information equals copula entropy
- On the Kozachenko-Leonenko entropy estimator
- Probability-1
- Real analysis. Theory of measure and integration
- Sample estimate of the entropy of a random vector
- The different paths to entropy
Cited in
(20)- Estimation of the Shannon's entropy of several shifted exponential populations
- The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond
- Keyfitz entropy: investigating some mathematical properties and its application for estimating survival function in life table
- Entropy-based test for generalised Gaussian distributions
- Detecting anomalies in fibre systems using 3-dimensional image data
- Statistical estimation of mutual information for mixed model
- Measures of statistical dispersion based on Shannon and Fisher information concepts
- An asymptotic lower bound for the entropy of discrete populations with application to the estimation of entropy for approximately uniform populations
- On the convergence of Shannon differential entropy, and its connections with density and entropy estimation
- scientific article; zbMATH DE number 2058888 (Why is no real title available?)
- Statistical estimation of the entropy of discrete random variables with a large number of outcomes
- Statistical estimation of conditional Shannon entropy
- A Medida de Informação de Shannon: Entropia
- On the Kozachenko-Leonenko entropy estimator
- scientific article; zbMATH DE number 7149440 (Why is no real title available?)
- Nonparametric estimation of quantile-based entropy function
- Entropy-based burn-in time analysis and ranking for (A)MCMC algorithms in high dimension
- Notes about statistical estimation of Shannon entropy
- Statistical estimates of information characteristics
- Distribution of Shannon statistic from normal sample
This page was built for publication: Statistical estimation of the Shannon entropy
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1734902)
