Counting distinctions: on the conceptual foundations of Shannon's information theory
From MaRDI portal
(Redirected from Publication:1036041)
Abstract: Categorical logic has shown that modern logic is essentially the logic of subsets (or "subobjects"). Partitions are dual to subsets so there is a dual logic of partitions where a "distinction" [an ordered pair of distinct elements (u,u') from the universe U ] is dual to an "element". An element being in a subset is analogous to a partition p on U making a distinction, i.e., if u and u' were in different blocks of p. Subset logic leads to finite probability theory by taking the (Laplacian) probability as the normalized size of each subset-event of a finite universe. The analogous step in the logic of partitions is to assign to a partition the number of distinctions made by a partition normalized by the total number of ordered pairs |UxU| from the finite universe. That yields a notion of "logical entropy" for partitions and a "logical information theory." The logical theory directly counts the (normalized) number of distinctions in a partition while Shannon's theory gives the average number of binary partitions needed to make those same distinctions. Thus the logical theory is seen as providing a conceptual underpinning for Shannon's theory based on the logical notion of "distinctions." (forthcoming in Synthese)
Recommendations
- scientific article; zbMATH DE number 61024
- On the Discontinuity of the Shannon Information Measures
- A GENERALIZATION OF SHANNON'S INFORMATION THEORY
- A new outlook on Shannon's information measures
- scientific article; zbMATH DE number 3168173
- scientific article; zbMATH DE number 1983989
- New Foundations for Information Theory
- Shannon entropy: axiomatic characterization and application
Cites work
- A Mathematical Theory of Communication
- Diversity and dissimilarity coefficients: A unified approach
- Diversity as a Concept and its Measurement
- scientific article; zbMATH DE number 3123490 (Why is no real title available?)
- scientific article; zbMATH DE number 1381973 (Why is no real title available?)
- scientific article; zbMATH DE number 48436 (Why is no real title available?)
- scientific article; zbMATH DE number 107482 (Why is no real title available?)
- scientific article; zbMATH DE number 1913781 (Why is no real title available?)
- scientific article; zbMATH DE number 913001 (Why is no real title available?)
- scientific article; zbMATH DE number 937365 (Why is no real title available?)
- scientific article; zbMATH DE number 3284914 (Why is no real title available?)
- scientific article; zbMATH DE number 3050845 (Why is no real title available?)
- Measurement of Diversity
- On an axiomatic derivation of Gini diversity, with applications
- On the theory of random search
- Possible generalization of Boltzmann-Gibbs statistics.
- Towards a unifying approach to diversity measures: bridging the gap between the Shannon entropy and Rao's quadratic index
Cited in
(9)- Quantum mechanics over sets: a pedagogical model with non-commutative finite probability theory as its quantum probability calculus
- Logical entropy of dynamical systems
- Follow the math! : the mathematics of quantum mechanics as the mathematics of set partitions linearized to (Hilbert) vector spaces
- The logic of partitions: introduction to the dual of the logic of subsets
- Four ways from universal to particular: how Chomsky's principles-and-parameters model is not selectionist
- New Foundations for Information Theory
- An introduction to logical entropy and its relation to Shannon entropy
- Logical entropy and aggregation of fuzzy orthopartitions
- A new logical measure for quantum information
This page was built for publication: Counting distinctions: on the conceptual foundations of Shannon's information theory
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1036041)
