Partition-Symmetrical Entropy Functions

DOI10.1109/TIT.2016.2600580MaRDI QIDQ2976549zbMATH OpenOpenAlexFDO

Authors

Publication date 28 April 2017

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1407.7405

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Abstract: Let $calN=1,cdots,n$. The entropy function $$ of a set of $n$ discrete random variables $X_i:iincalN$ is a $2^n$-dimensional vector whose entries are $$, the (joint) entropies of the subsets of the set of $n$ random variables with $H(X_{e}mptyset)=0$ by convention. The set of all entropy functions for $n$ discrete random variables, denoted by $Gamm{a}_n^{\ast }$, is called the entropy function region for $n$. Characterization of $Gamm{a}_n^{\ast }$ and its closure $overlineGamm{a}_n^{\ast }$ are well-known open problems in information theory. They are important not only because they play key roles in information theory problems but also they are related to other subjects in mathematics and physics. In this paper, we consider emph{partition-symmetrical entropy functions}. Let $p=cal{N}_1,cdots,cal{N}_t$ be a $t$-partition of $calN$. An entropy function $$ is called $p$-symmetrical if for all $calA,calBsubsetcalN$, $$ whenever $|calAcap{calN}_i|=|calBcap{calN}_i|$, $i=1,cdots,t$. The set of all the $p$-symmetrical entropy functions, denoted by $Ps{i}_p^{\ast }$, is called $p$-symmetrical entropy function region. We prove that $overlinePs{i}_p^{\ast }$, the closure of $Ps{i}_p^{\ast }$, is completely characterized by Shannon-type information inequalities if and only if $p$ is the $1$-partition or a $2$-partition with one of its blocks being a singleton. The characterization of the partition-symmetrical entropy functions can be useful for solving some information theory and related problems where symmetry exists in the structure of the problems. Keywords: entropy, entropy function, information inequality, polymatroid.

Recommendations

• Equivalence of partition functions leads to classification of entropies and means
• An axiomatization of partition entropy
• Entropy, transverse entropy and partitions of unity
• Characterizations of symmetric distributions based on Rényi entropy
• Entropy functions for symmetric systems of conservation laws
• Entropy for random partitions and its applications
• Symmetry studies and decompositions of entropy
• Entropy functions and functional equations
• scientific article; zbMATH DE number 1857668

This page was built for publication: Partition-Symmetrical Entropy Functions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2976549)