Parametric Bayesian estimation of differential entropy and relative entropy (Q653366)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Parametric Bayesian estimation of differential entropy and relative entropy |
scientific article |
Statements
Parametric Bayesian estimation of differential entropy and relative entropy (English)
0 references
9 January 2012
0 references
Summary: Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform, Gaussian, Wishart, and inverse Wishart distributions. Additionally, formulas are given for a log gamma Bregman divergence and the differential entropy and relative entropy for the Wishart and inverse Wishart. The results, as always with Bayesian estimates, depend on the accuracy of the prior parameters, but example simulations show that the performance can be substantially improved compared to maximum likelihood or state-of-the-art nonparametric estimators.
0 references
Kullback-Leibler
0 references
relative entropy
0 references
differential entropy
0 references
Pareto
0 references
Wishart
0 references
0 references
0 references