Weighted approach to general entropy function

DOI10.1093/IMAMCI/DNT044MaRDI QIDQ5264368zbMATH OpenOpenAlexFDO

Authors Marek Śmieja

Publication date 27 July 2015

Published in IMA Journal of Mathematical Control and Information (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1305.3040

zbMATH Keywords

codingdata compressionentropymixture of measuresweighted entropy

Mathematics Subject Classification ID

Entropy and other invariants (28D20) Entropy and other invariants, isomorphism, classification in ergodic theory (37A35) Measures of information, entropy (94A17)

Abstract: The definition of weighted entropy allows for easy calculation of the entropy of the mixture of measures. In this paper we investigate the problem of equivalent definition of the general entropy function in weighted form. We show that under reasonable condition, which is satisfied by the well-known Shannon, R'enyi and Tsallis entropies, every entropy function can be defined equivalently in the weighted way. As a corollary, we show how use the weighted form to compute Tsallis entropy of the mixture of measures.

Recommendations

• Weighted entropy: basic inequalities
• Weighted entropy and its use in computer science and beyond
• Weighted entropies
• Basic inequalities for weighted entropies
• scientific article; zbMATH DE number 600105

Cited in

(8)

• Weighted entropy and its use in computer science and beyond
• Weighted entropy function as an extension of the Kolmogorov-Sinai entropy
• Entropy approximation in lossy source coding problem
• scientific article; zbMATH DE number 465381 (Why is no real title available?)
• scientific article; zbMATH DE number 600105 (Why is no real title available?)
• scientific article; zbMATH DE number 2113099 (Why is no real title available?)
• On weighted generalized entropy
• A view on weighted exponential entropy and examining some of its features

This page was built for publication: Weighted approach to general entropy function

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5264368)