Extropy: complementary dual of entropy
From MaRDI portal
Abstract: This article provides a completion to theories of information based on entropy, resolving a longstanding question in its axiomatization as proposed by Shannon and pursued by Jaynes. We show that Shannon's entropy function has a complementary dual function which we call "extropy." The entropy and the extropy of a binary distribution are identical. However, the measure bifurcates into a pair of distinct measures for any quantity that is not merely an event indicator. As with entropy, the maximum extropy distribution is also the uniform distribution, and both measures are invariant with respect to permutations of their mass functions. However, they behave quite differently in their assessments of the refinement of a distribution, the axiom which concerned Shannon and Jaynes. Their duality is specified via the relationship among the entropies and extropies of course and fine partitions. We also analyze the extropy function for densities, showing that relative extropy constitutes a dual to the Kullback-Leibler divergence, widely recognized as the continuous entropy measure. These results are unified within the general structure of Bregman divergences. In this context they identify half the metric as the extropic dual to the entropic directed distance. We describe a statistical application to the scoring of sequential forecast distributions which provoked the discovery.
Recommendations
Cites work
- A Mathematical Theory of Communication
- Admissible probability measurement procedures
- Bregman Voronoi diagrams
- Changes in utility as information
- Clustering with Bregman divergences.
- Coherent conditional previsions and proper scoring rules
- Correction of incoherent conditional probability assessments
- Elicitation of Personal Probabilities and Expectations
- Expected information as ecpected utility
- Functional Bregman Divergence and Bayesian Estimation of Distributions
- scientific article; zbMATH DE number 3143969 (Why is no real title available?)
- scientific article; zbMATH DE number 107482 (Why is no real title available?)
- scientific article; zbMATH DE number 1382772 (Why is no real title available?)
- scientific article; zbMATH DE number 965590 (Why is no real title available?)
- On Bregman Distances and Divergences of Probability Measures
- Probabilistic Coherence and Proper Scoring Rules
- Probability Theory
- Strictly Proper Scoring Rules, Prediction, and Estimation
- The Bethe Permanent of a Nonnegative Matrix
Cited in
(only showing first 100 items - show all)- Residual extropy of \(k\)-record values
- On dynamic weighted extropy
- Shapley and superShapley aggregation emerging from consensus dynamics in the multicriteria Choquet framework
- Cumulative residual extropy of minimum ranked set sampling with unequal samples
- On extropy of past lifetime distribution
- Failure extropy, dynamic failure extropy and their weighted versions
- Kernel and CDF-based estimation of extropy and entropy from progressively type-II censoring with application for goodness of fit problems
- Kernel estimation of extropy function under length-biased sampling
- A study on some properties of dynamic survival extropy and its relation to economic measures
- Information generating function of record values
- Estimation of entropy and extropy based on right censored data: a Bayesian non-parametric approach
- Some useful results related to various measures of extropy and their interrelationship
- Non-parametric estimation of cumulative (residual) extropy
- Some reliability properties of extropy for residual and past lifetime random variables
- Probabilities of conditionals and previsions of iterated conditionals
- On generalized knowledge measure and generalized accuracy measure with applications to MADM and pattern recognition
- Past extropy of \(k\)-records
- Characterization of exponential distribution using extropy based on lower \(k\)-records and its application in testing exponentiality
- On Tsallis extropy with an application to pattern recognition
- Probabilistic squares and hexagons of opposition under coherence
- Information measures in records and their concomitants arising from Sarmanov family of bivariate distributions
- Information measures and concomitants of \(k\)-record values based on Sarmanov family of bivariate distributions
- Compressive sensing using extropy measures of ranked set sampling
- On partial monotonic behaviour of past entropy and convolution of extropy
- Non-parametric estimation of the extropy and the entropy measures based on progressive type-II censored data with testing uniformity
- Symmetry being tested through simultaneous application of upper and lower k-records in extropy
- The extropy of order statistics and record values
- On extropy properties of ranked set sampling
- On the estimation of extropy
- Extropy estimators with applications in testing uniformity
- Testing symmetry based on the extropy of record values
- On the uniform-in-bandwidth consistency of the general conditional \(U\)-statistics based on the copula representation
- On interval weighted cumulative residual and past extropies
- ON EXTROPY PROPERTIES AND DISCRIMINATION INFORMATION OF DIFFERENT STRATIFIED SAMPLING SCHEMES
- BOUNDS ON EXTROPY WITH VARIATIONAL DISTANCE CONSTRAINT
- ON EXTROPY PROPERTIES OF MIXED SYSTEMS
- On cumulative residual extropy
- Extropy information of maximum and minimum ranked set sampling with unequal samples
- On dynamic survival extropy
- Testing exponentiality based on the extropy of record values
- On weighted cumulative residual extropy: characterization, estimation and testing
- On negative cumulative extropy with applications
- Weighted extropies and past extropy of order statistics and k-record values
- On weighted extropies
- Bayesian estimation of extropy and goodness of fit tests
- Extropy of order statistics applied to testing symmetry
- A study on weighted dynamic survival and failure extropies
- Tsallis eXtropy
- SOME MEASURES INFORMATION FOR GENERALIZED AND q-GENERALIZED EXTREME VALUES AND ITS PROPERTIES
- Recursive and non-recursive kernel estimation of negative cumulative residual extropy under -mixing dependence condition
- Interval extropy and weighted interval extropy
- Information generating function of k-record values and its applications
- Nonparametric estimation of past extropy under -mixing dependence condition
- Some properties of weighted survival extropy and its extended measures
- Nonparametric log kernel estimator of extropy function
- On weighted extropy of ranked set sampling and its comparison with simple random sampling counterpart
- On general weighted cumulative residual extropy and general weighted negative cumulative extropy
- scientific article; zbMATH DE number 7690408 (Why is no real title available?)
- Reliability and expectation bounds based on Hardy’s inequality
- Belief eXtropy: Measure uncertainty from negation
- An ordered approach on cumulative extropy measures for information analysis
- Jensen-Fisher information and Jensen-Shannon entropy measures based on complementary discrete distributions with an application to Conway's game of life
- On dynamic cumulative past inaccuracy measure based on extropy
- Extropy: Characterizations and dynamic versions
- On reconsidering entropies and divergences and their cumulative counterparts: Csiszár's, DPD's and Fisher's type cumulative and survival measures
- Integral transformation of a copula function
- Testing uniformity based on negative cumulative extropy
- Renyi extropy
- On cumulative residual (past) extropy of extreme order statistics
- Extropy based on records for random variables representing residual life
- Weighted negative cumulative extropy with application in testing uniformity
- Extropy based inaccuracy measure in order statistics
- The unified extropy and its versions in classical and Dempster-Shafer theories
- On the maximum extropy negation of a probability distribution
- Extropy properties of ranked set sample when ranking is not perfect
- Fisher information in order statistics and their concomitants for Cambanis bivariate distribution
- Development of an efficient bounded distribution with application to practical data
- Non-parametric tests for serial dependence in time series based on asymptotic implementations of ordinal-pattern statistics
- On general weighted extropy of ranked set sampling
- Tighter monogamy relations of the S^t and T^t_q-entropy entanglement measures based on dual entropy
- General results on bivariate extended Weibull Morgenstern family and concomitants of its generalized order statistics
- On cumulative residual extropy of coherent and mixed systems
- Further results involving residual and past extropy with their applications
- On the estimation of varextropy
- Extropy and statistical features of dual generalized order statistics' concomitants arising from the sarmanov family
- Residual inaccuracy extropy and its properties
- Modified cumulative extropies of doubly truncated random variables
- On weighted version of dynamic cumulative residual inaccuracy measure based on extropy
- Some results of extropy-based measure of divergence for record statistics
- General weighted cumulative residual (past) extropy of minimum (maximum) ranked set sampling with unequal samples
- Stochastic comparisons, differential entropy and varentropy for distributions induced by probability density functions
- Estimation of density functionals via cross-validation
- Nonparametric estimators for varextropy under \(\alpha\)-mixing condition with appliction in exponential AR(1) model
- The residual extropy of order statistics
- Inference on extropy of ranked set samples
- Quantile-based cumulative past extropy of record values
- Extropy-based dynamic cumulative residual inaccuracy measure: properties and applications
- On the study of the cumulative residual extropy of mixed used systems and their complexity
- Extropy: dual of entropy for uncertain random variables and iits applications
- Failure extropy properties of mixed system with application.
This page was built for publication: Extropy: complementary dual of entropy
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q254407)
