On a unification of divergences by means of information amounts
The paper is based on the idea that any \textit{dissimilarity measure} between two \textit{probability distributions} depends either on the difference or on the quotient of the density functions associated with these distributions. Then, on the basis of this key idea, the concept of \textit{discriminating amount} associated with the \textit{divergence} of probability distributions is presented, and several types of discriminating amounts are distinguished: Renyi's one and a unifying family. Jeffrey's invariant of the Renyi discriminating amount is considered to symmetrize it. This symmetrical measure is later employed to obtain some distances to present the notion of \textit{Renyi's infinitesimal discriminating amount}. A similar study is developed for the unified discriminating amount. Local properties on the statistical parameter space, as well as connections between the introduced and the reviewed measures are examined.
- On Information Divergence Measures and a Unified Typicality
- On informational divergences for general statistical theories
- On asymptotic properties of information-theoretic divergences
- scientific article; zbMATH DE number 66838
- scientific article; zbMATH DE number 889635
- scientific article; zbMATH DE number 3163280
- scientific article; zbMATH DE number 2218582
- On Unified (R,S)-Information Measures
- scientific article; zbMATH DE number 2201890
- A Unifying Variational Perspective on Some Fundamental Information Theoretic Inequalities
- Entropy differential metric, distance and divergence measures in probability spaces: A unified approach
- scientific article; zbMATH DE number 4145111 (Why is no real title available?)
- scientific article; zbMATH DE number 3284914 (Why is no real title available?)
- On Information and Sufficiency
- On the relation between the statistical divergence and geodesic distance
This page was built for publication: On a unification of divergences by means of information amounts
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1373696)