Intrinsic Entropies of Log-Concave Distributions

DOI10.1109/TIT.2017.2757502MaRDI QIDQ4566620zbMATH OpenFDO

Authors Varun Jog, Venkat Anantharam

Publication date 27 June 2018

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1702.01203

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Abstract: The entropy of a random variable is well-known to equal the exponential growth rate of the volumes of its typical sets. In this paper, we show that for any log-concave random variable $X$, the sequence of the $lfloornhetafloo{r}^{extth}$ intrinsic volumes of the typical sets of $X$ in dimensions $ngeq1$ grows exponentially with a well-defined rate. We denote this rate by $h_X(heta)$, and call it the $het{a}^{extth}$ intrinsic entropy of $X$. We show that $h_X(heta)$ is a continuous function of $heta$ over the range $[0,1]$, thereby providing a smooth interpolation between the values 0 and $h(X)$ at the endpoints 0 and 1, respectively.

Cited in

(2)

• Concentration of the information in data with log-concave distributions
• Log-concavity and the maximum entropy property of the Poisson distribution

This page was built for publication: Intrinsic Entropies of Log-Concave Distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4566620)