On a connection between information and group lattices
Summary: We review a particular connection between information theory and group theory. We formalize the notions of information elements and information lattices, first proposed by Shannon. Exploiting this formalization, we expose a comprehensive parallelism between information lattices and subgroup lattices. Qualitatively, isomorphisms between information lattices and subgroup lattices are demonstrated. Quantitatively, a decisive approximation relation between the entropy structures of information lattices and the log-index structures of the corresponding subgroup lattices, first discovered by Chan and Yeung, is highlighted. This approximation, addressing both joint and common entropies, extends the work of Chan and Yeung on joint entropy. A consequence of this approximation result is that any continuous law holds in general for the entropies of information elements if and only if the same law holds in general for the log-indices of subgroups. As an application, by constructing subgroup counterexamples, we find surprisingly that common information, unlike joint information, obeys neither the submodularity nor the supermodularity law. We emphasize that the notion of information elements is conceptually significant-formalizing it helps to reveal the deep connection between information theory and group theory. The parallelism established in this paper admits an appealing group-action explanation and provides useful insights into the intrinsic structure among information elements from a group-theoretic perspective.
- A Mathematical Theory of Communication
- Common randomness and secret key generation with a helper
- Common randomness in information theory and cryptography. I. Secret sharing
- Common randomness in information theory and cryptography. II. CR capacity
- Entropy and convergence on compact groups
- Every finite lattice can be embedded in a finite partition lattice
- scientific article; zbMATH DE number 2131215 (Why is no real title available?)
- scientific article; zbMATH DE number 3497786 (Why is no real title available?)
- scientific article; zbMATH DE number 3532322 (Why is no real title available?)
- Inequalities for Shannon entropy and Kolmogorov complexity
- Information-theoretic inequalities on unimodular Lie groups
- Maximum entropy on compact groups
- Multiple access channels with arbitrarily correlated sources
- Necessary and Sufficient Statistics for the Family of Shifts of Probability Distributions on Continuous BiCompact Groups
- On a new non-Shannon type information inequality
- On a relation between information inequalities and group theory
- On Capacity of Line Networks
- On characterization of entropy function via information inequalities
- On Sequences of Pairs of Dependent Random Variables
- On the capacity of information networks
- Piecewise linear conditional information inequality
- Polymatroidal dependence structure of a set of random variables
- Recent progresses in characterising information inequalities
- Stochastic calculus for finance. I: The binomial asset pricing model.
- Stochastic models, information theory, and Lie groups. Volume I: Classical results and geometric methods
- Supermodularity and subadditivity properties of the entropy on the majorization lattice
- The lattice theory of information
- The Shannon information of filtrations and the additional logarithmic utility of insiders
- Universal Compression of Memoryless Sources Over Unknown Alphabets
- Upper semi-lattice of binary strings with the relation ``\(x\) is simple conditional to \(y\)
- On group-characterizability of homomorphic secret sharing schemes
- scientific article; zbMATH DE number 4067249 (Why is no real title available?)
- On a relation between information inequalities and group theory
- Orbit Computation for Atomically Generated Subgroups of Isometries of $\mathbb{Z}^n$
- Information-theoretic inequalities on unimodular Lie groups
- Computational mechanics of input-output processes: structured transformations and the \(\epsilon\)-transducer
This page was built for publication: On a connection between information and group lattices
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657554)
