Coincidences and estimation of entropies of random variables with large cardinalities

DOI10.3390/e13122013zbMath1300.62024arXivphysics/0207009OpenAlexW2008551287MaRDI QIDQ400965

Ilya Nemenman

Publication date: 26 August 2014

Published in: Entropy (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/physics/0207009

zbMATH Keywords

model selectioncoincidencesbias-variance tradeoffentropy estimation

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Bayesian inference (62F15) Statistical aspects of information-theoretic topics (62B10)

Related Items (4)

Estimating functions of distributions defined over spaces of unknown size ⋮ Non-parametric estimation of mutual information through the entropy of the linkage ⋮ Molecular and functional aspects of bacterial chemotaxis ⋮ Bias adjustment for a nonparametric entropy estimator

Cites Work

• Unnamed Item
• Estimating the dimension of a model
• Convergence properties of functional estimates for discrete distributions
• Estimating Entropy Rates with Bayesian Confidence Intervals
• Statistical Inference, Occam's Razor, and Statistical Mechanics on the Space of Probability Distributions
• Information-theoretic asymptotics of Bayes methods
• Limit results on pattern entropy
• Entropy estimation of symbol sequences
• Estimation of Entropy and Mutual Information
• The Complexity of Approximating the Entropy
• Fluctuation-Dissipation Theorem and Models of Learning

This page was built for publication: Coincidences and estimation of entropies of random variables with large cardinalities