Extropy: complementary dual of entropy
From MaRDI portal
Abstract: This article provides a completion to theories of information based on entropy, resolving a longstanding question in its axiomatization as proposed by Shannon and pursued by Jaynes. We show that Shannon's entropy function has a complementary dual function which we call "extropy." The entropy and the extropy of a binary distribution are identical. However, the measure bifurcates into a pair of distinct measures for any quantity that is not merely an event indicator. As with entropy, the maximum extropy distribution is also the uniform distribution, and both measures are invariant with respect to permutations of their mass functions. However, they behave quite differently in their assessments of the refinement of a distribution, the axiom which concerned Shannon and Jaynes. Their duality is specified via the relationship among the entropies and extropies of course and fine partitions. We also analyze the extropy function for densities, showing that relative extropy constitutes a dual to the Kullback-Leibler divergence, widely recognized as the continuous entropy measure. These results are unified within the general structure of Bregman divergences. In this context they identify half the metric as the extropic dual to the entropic directed distance. We describe a statistical application to the scoring of sequential forecast distributions which provoked the discovery.
Recommendations
Cites work
- scientific article; zbMATH DE number 3143969 (Why is no real title available?)
- scientific article; zbMATH DE number 107482 (Why is no real title available?)
- scientific article; zbMATH DE number 1382772 (Why is no real title available?)
- scientific article; zbMATH DE number 965590 (Why is no real title available?)
- A Mathematical Theory of Communication
- Admissible probability measurement procedures
- Bregman Voronoi diagrams
- Changes in utility as information
- Clustering with Bregman divergences.
- Coherent conditional previsions and proper scoring rules
- Correction of incoherent conditional probability assessments
- Elicitation of Personal Probabilities and Expectations
- Expected information as ecpected utility
- Functional Bregman Divergence and Bayesian Estimation of Distributions
- On Bregman Distances and Divergences of Probability Measures
- Probabilistic Coherence and Proper Scoring Rules
- Probability Theory
- Strictly Proper Scoring Rules, Prediction, and Estimation
- The Bethe Permanent of a Nonnegative Matrix
Cited in
(94)- On the uniform-in-bandwidth consistency of the general conditional \(U\)-statistics based on the copula representation
- On extropy properties of ranked set sampling
- Testing symmetry based on the extropy of record values
- Estimation of entropy and extropy based on right censored data: a Bayesian non-parametric approach
- Some useful results related to various measures of extropy and their interrelationship
- On cumulative residual (past) extropy of extreme order statistics
- Development of an efficient bounded distribution with application to practical data
- On general weighted cumulative residual extropy and general weighted negative cumulative extropy
- On general weighted extropy of ranked set sampling
- Extropy: Characterizations and dynamic versions
- Extropy information of maximum and minimum ranked set sampling with unequal samples
- On weighted extropies
- Non-parametric estimation of cumulative (residual) extropy
- Characterization of exponential distribution using extropy based on lower \(k\)-records and its application in testing exponentiality
- Tighter monogamy relations of the \(S^t\) and \(T^t_q\)-entropy entanglement measures based on dual entropy
- Recursive and non-recursive kernel estimation of negative cumulative residual extropy under \(\alpha\)-mixing dependence condition
- Nonparametric estimation of past extropy under \(\alpha\)-mixing dependence condition
- On Tsallis extropy with an application to pattern recognition
- On interval weighted cumulative residual and past extropies
- On reconsidering entropies and divergences and their cumulative counterparts: Csiszár's, DPD's and Fisher's type cumulative and survival measures
- Testing exponentiality based on the extropy of record values
- A study on weighted dynamic survival and failure extropies
- Tsallis eXtropy
- On weighted cumulative residual extropy: characterization, estimation and testing
- Information generating function of \(k\)-record values and its applications
- On dynamic weighted extropy
- General results on bivariate extended Weibull Morgenstern family and concomitants of its generalized order statistics
- Non-parametric estimation of the extropy and the entropy measures based on progressive type-II censored data with testing uniformity
- Nonparametric log kernel estimator of extropy function
- Some reliability properties of extropy for residual and past lifetime random variables
- SOME MEASURES INFORMATION FOR GENERALIZED AND q-GENERALIZED EXTREME VALUES AND ITS PROPERTIES
- Renyi extropy
- Weighted extropies and past extropy of order statistics and k-record values
- On cumulative residual extropy of coherent and mixed systems
- Past extropy of \(k\)-records
- Further results involving residual and past extropy with their applications
- Shapley and superShapley aggregation emerging from consensus dynamics in the multicriteria Choquet framework
- Kernel estimation of extropy function under length-biased sampling
- Extropy based on records for random variables representing residual life
- Some properties of weighted survival extropy and its extended measures
- Probabilities of conditionals and previsions of iterated conditionals
- On negative cumulative extropy with applications
- Cumulative residual extropy of minimum ranked set sampling with unequal samples
- Residual extropy of \(k\)-record values
- Extropy based inaccuracy measure in order statistics
- On the estimation of varextropy
- Testing uniformity based on negative cumulative extropy
- Weighted negative cumulative extropy with application in testing uniformity
- On weighted extropy of ranked set sampling and its comparison with simple random sampling counterpart
- Extropy and statistical features of dual generalized order statistics' concomitants arising from the sarmanov family
- Residual inaccuracy extropy and its properties
- Modified cumulative extropies of doubly truncated random variables
- Information measures in records and their concomitants arising from Sarmanov family of bivariate distributions
- Information measures and concomitants of \(k\)-record values based on Sarmanov family of bivariate distributions
- On extropy of past lifetime distribution
- Failure extropy, dynamic failure extropy and their weighted versions
- Kernel and CDF-based estimation of extropy and entropy from progressively type-II censoring with application for goodness of fit problems
- General weighted cumulative residual (past) extropy of minimum (maximum) ranked set sampling with unequal samples
- Extropy estimators with applications in testing uniformity
- Bayesian estimation of extropy and goodness of fit tests
- The extropy of order statistics and record values
- Interval extropy and weighted interval extropy
- On weighted version of dynamic cumulative residual inaccuracy measure based on extropy
- Some results of extropy-based measure of divergence for record statistics
- Reliability and expectation bounds based on Hardy’s inequality
- Probabilistic squares and hexagons of opposition under coherence
- scientific article; zbMATH DE number 7690408 (Why is no real title available?)
- An ordered approach on cumulative extropy measures for information analysis
- Symmetry being tested through simultaneous application of upper and lower k-records in extropy
- Extropy of order statistics applied to testing symmetry
- The unified extropy and its versions in classical and Dempster-Shafer theories
- Compressive sensing using extropy measures of ranked set sampling
- On partial monotonic behaviour of past entropy and convolution of extropy
- Stochastic comparisons, differential entropy and varentropy for distributions induced by probability density functions
- On dynamic survival extropy
- ON EXTROPY PROPERTIES AND DISCRIMINATION INFORMATION OF DIFFERENT STRATIFIED SAMPLING SCHEMES
- On the estimation of extropy
- Jensen-Fisher information and Jensen-Shannon entropy measures based on complementary discrete distributions with an application to Conway's game of life
- Estimation of density functionals via cross-validation
- Nonparametric estimators for varextropy under \(\alpha\)-mixing condition with appliction in exponential AR(1) model
- Belief eXtropy: Measure uncertainty from negation
- On cumulative residual extropy
- A study on some properties of dynamic survival extropy and its relation to economic measures
- BOUNDS ON EXTROPY WITH VARIATIONAL DISTANCE CONSTRAINT
- ON EXTROPY PROPERTIES OF MIXED SYSTEMS
- On generalized knowledge measure and generalized accuracy measure with applications to MADM and pattern recognition
- On dynamic cumulative past inaccuracy measure based on extropy
- Integral transformation of a copula function
- Information generating function of record values
- On the maximum extropy negation of a probability distribution
- Extropy properties of ranked set sample when ranking is not perfect
- Fisher information in order statistics and their concomitants for Cambanis bivariate distribution
- The residual extropy of order statistics
- Non-parametric tests for serial dependence in time series based on asymptotic implementations of ordinal-pattern statistics
This page was built for publication: Extropy: complementary dual of entropy
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q254407)
