On the Estimation of Differential Entropy From Data Located on Embedded Manifolds

DOI10.1109/TIT.2007.899533zbMATH Open1326.94029MaRDI QIDQ3549103FDOQ3549103

Authors: Mattias Nilsson, W. Bastiaan Kleijn 

Publication date: 21 December 2008

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Recommendations

• Geodesic Entropic Graphs for Dimension and Entropy Estimation in Manifold Learning
• Information theory and the embedding problem for Riemannian manifolds
• scientific article; zbMATH DE number 124792
• Metric entropy, \(n\)-widths, and sampling of functions on manifolds
• On the estimation of entropy for non-negative data
• Information geometry and statistical manifold.
• Entropy-based closure for probabilistic learning on manifolds
• Estimation of entropies and divergences via nearest neighbors
• Information geometric complexity of entropic motion on curved statistical manifolds under different metrizations of probability spaces
• Estimation of entropy and other functionals of a multivariate density

Mathematics Subject Classification ID

Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Measures of information, entropy (94A17)

Cited In (12)

• Fast kernel entropy estimation and optimization
• Entropy estimation via uniformization
• Some properties of Rényi entropy and Rényi entropy rate
• Histogram-based embedding for learning on statistical manifolds
• Efficient estimation of the PDF and the CDF of the exponentiated Gumbel distribution
• Estimation of average differential entropy for a stationary ergodic space-time random field on a bounded area
• Parametric Bayesian estimation of differential entropy and relative entropy
• Geodesic Entropic Graphs for Dimension and Entropy Estimation in Manifold Learning
• Determining Intrinsic Dimension and Entropy of High-Dimensional Shape Spaces
• Particle-kernel estimation of the filter density in state-space models
• Limit theory for point processes in manifolds
• Fast Parallel Estimation of High Dimensional Information Theoretical Quantities with Low Dimensional Random Projection Ensembles

This page was built for publication: On the Estimation of Differential Entropy From Data Located on Embedded Manifolds

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3549103)