K-nearest neighbor based consistent entropy estimation for hyperspherical distributions

DOI10.3390/E13030650MaRDI QIDQ657553zbMATH OpenOpenAlexWikidataFDO

Authors Shengqiao Li, Robert Mnatsakanov, Michael E. Andrew

Publication date 9 January 2012

Published in Entropy (Search for Journal in Brave)

Full work available at URL https://doi.org/10.3390/e13030650

zbMATH Keywords

directional dataKullback-Leibler divergencecross entropydifferential entropyhyperspherical distributionk-nearest neighbor

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Asymptotic properties of parametric estimators (62F12) Directional data; spatial statistics (62H11) Estimation in multivariate analysis (62H12)

Recommendations

• k_n-nearest neighbor estimators of entropy
• Efficient multivariate entropy estimation via \(k\)-nearest neighbour distances
• Geometric k-nearest neighbor estimation of entropy and mutual information
• Estimation of multivariate Shannon entropy using moments
• Estimation of entropies and divergences via nearest neighbors

Cites work

• An extension of the von mises distribution
• Best asymptotic normality of the kernel density entropy estimator for smooth densities
• Correction: A class of Rényi information estimators for multidimensional densities
• Divergence Estimation for Multidimensional Densities Via $k$-Nearest-Neighbor Distances
• Estimation of multivariate Shannon entropy using moments
• Multivariate k-nearest neighbor density estimates
• Nearest neighbor estimates of entropy for multivariate circular distributions
• The generalized von Mises distribution
• k_n-nearest neighbor estimators of entropy

Cited in

(8)

• Efficient multivariate entropy estimation via \(k\)-nearest neighbour distances
• Directional statistics approach based on instantaneous rotational parameters of tri-axial trajectories for footstep detection
• Estimation of multivariate Shannon entropy using moments
• A novel nonparametric distance estimator for densities with error bounds
• k_n-nearest neighbor estimators of entropy
• Nearest neighbor estimates of entropy for multivariate circular distributions
• The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond
• Sample-Spacings-Based Density and Entropy Estimators for Spherically Invariant Multidimensional Data

This page was built for publication: \(K\)-nearest neighbor based consistent entropy estimation for hyperspherical distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657553)