Axiomatic characterizations of information measures
From MaRDI portal
Summary: Axiomatic characterizations of Shannon entropy, Kullback I-divergence, and some generalized information measures are surveyed. Three directions are treated: (A) Characterization of functions of probability distributions suitable as information measures. (B) Characterization of set functions on the subsets of \(\{1;\dots,N\}\) representable by joint entropies of components of an \(N\)-dimensional random vector. (C) Axiomatic characterization of MaxEnt and related inference rules. The paper concludes with a brief discussion of the relevance of the axiomatic approach for information theory.
Recommendations
Cited in
(93)- On axiomatic characterization of information improvement due to N revisions
- Information and statistics. I
- Informativity in the category of linear measurement systems
- Boltzmann-Gibbs entropy: Axiomatic characterization and application
- On local Tsallis entropy of relative dynamical systems
- A generalization of the Havrda-Charvat and Tsallis entropy and its axiomatic characterization
- Adaptive decision making via entropy minimization
- Copula theory and probabilistic sensitivity analysis: is there a connection?
- Tsallis entropy of partitions in quantum logics
- Generalized Shannon-Khinchin axioms and uniqueness theorem for pseudo-additive entropies
- A unified characterization of generalized information and certainty measures
- On quantum conditional entropies defined in terms of the \(F\)-divergences
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
- Aggregating incoherent agents who disagree
- Conjugate predictive distributions and generalized entropies
- Representing preorders with injective monotones
- Variety of evidence and the elimination of hypotheses
- Axiomatic characterization of the \(\chi^2\) dissimilarity measure
- A triple uniqueness of the maximum entropy approach
- Unidirectional random growth with resetting
- On the weighted Gini-Simpson index: estimating feasible weights using the optimal point and discussing a link with possibility theory
- Equitability, interval estimation, and statistical power
- Measuring diversity in heterogeneous information networks
- Probability as a measure of information added
- Tsallis entropy and generalized Shannon additivity
- Law invariant risk measures and information divergences
- Inflation as an information bottleneck: a strategy for identifying universality classes and making robust predictions
- An axiomatization of information flow measures
- Updating a progic
- Highly symmetric POVMs and their informational power
- Processing distortion models: a comparative study
- Rules of proof for maximal entropy inference
- Determining maximal entropy functions for objective Bayesian inductive logic
- Objective Bayesianism and the maximum entropy principle
- Axioms of information entropy and applications in decision analysis
- Informations in models of evolutionary dynamics
- Convexity inequalities for estimating generalized conditional entropies from below
- A foundational approach to generalising the maximum entropy inference process to the multi-agent context
- scientific article; zbMATH DE number 4016761 (Why is no real title available?)
- The general form of -family of quantum relative entropies
- Inequalities for Tsallis relative entropy and generalized skew information
- Coherence quantifiers from the viewpoint of their decreases in the measurement process
- CHARACTERIZING CLASSES OF STRUCTURED OBJECTS BY MEANS OF INFORMATION INEQUALITIES
- Dependence assessment based on generalized relative complexity: application to sampling network design
- Entropy and cross entropy: characterizations and applications
- An axiomatic approach to measuring of information of sign-based image representations
- scientific article; zbMATH DE number 3917425 (Why is no real title available?)
- scientific article; zbMATH DE number 3952646 (Why is no real title available?)
- Bounds of the Pinsker and Fannes types on the Tsallis relative entropy
- scientific article; zbMATH DE number 3672180 (Why is no real title available?)
- A characterization of entropy in terms of information loss
- scientific article; zbMATH DE number 92271 (Why is no real title available?)
- A variational framework for exemplar-based image inpainting
- scientific article; zbMATH DE number 1247732 (Why is no real title available?)
- scientific article; zbMATH DE number 1122234 (Why is no real title available?)
- Rényi entropy of the totally asymmetric exclusion process
- A short characterization of relative entropy
- Quantum conditional relative entropy and quasi-factorization of the relative entropy
- scientific article; zbMATH DE number 3797668 (Why is no real title available?)
- Characterizing entropy in statistical physics and in quantum information theory
- On some characterizations of the Shannon entropy using extreme symmetry and block symmetry
- scientific article; zbMATH DE number 889635 (Why is no real title available?)
- Lectures on Entropy. I: Information-Theoretic Notions
- A Medida de Informação de Shannon: Entropia
- Prediction in Riemannian metrics derived from divergence functions
- Additive scoring rules for discrete sample spaces
- Lagrangian uncertainty quantification and information inequalities for stochastic flows
- Further results on generalized conditional entropies
- An axiomatic characterization of a two-parameter extended relative entropy
- The value of information for populations in varying environments
- An information-theoretic characterization of partitioned property spaces
- Generalized conditional entropy -- determinicity of a process and Rokhlin's formula
- scientific article; zbMATH DE number 4185538 (Why is no real title available?)
- Moderating probability distributions for unrepresented uncertainty: Application to sentiment analysis via deep learning
- Multi-class and Cluster Evaluation Measures Based on Rényi and Tsallis Entropies and Mutual Information
- Path-Based Divergence Rates and Lagrangian Uncertainty in Stochastic Flows
- Logical perspectives on the foundations of probability
- Measures of conflict, basic axioms and their application to the clusterization of a body of evidence
- Continuity and additivity properties of information decompositions
- Categorical magnitude and entropy
- Some general properties of unified entropies
- On an extension of Krivovichev's complexity measures
- Permutation group entropy: a new route to complexity for real-valued processes
- Asymptotic Rényi entropies of random walks on groups
- New perspectives on multilocus ancestry informativeness
- Majorization and randomness measures
- Three types of internal conflict and its measurement in Dempster-Shafer theory
- Foundation and identification of multi-attribute Shannon entropy
- Discovering maximum entropy knowledge
- The space of positive transition measures on a Markov chain
- Asymptotic behavior of the maximum entropy routing in computer networks
- An entropy-based weighted concept lattice for merging multi-source geo-ontologies
- Probabilism, entropies and strictly proper scoring rules
This page was built for publication: Axiomatic characterizations of information measures
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q845363)
