Generalised exponential families and associated entropy functions
From MaRDI portal
Publication:845355
DOI10.3390/ENTROPY-E10030131zbMATH Open1179.94048arXiv0803.0104OpenAlexW3104264842MaRDI QIDQ845355FDOQ845355
Publication date: 29 January 2010
Published in: Entropy (Search for Journal in Brave)
Abstract: A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential families. The well-known result that the inequality of Cramer and Rao becomes an equality in the case of an exponential family can be generalised. However, this requires the introduction of escort probabilities.
Full work available at URL: https://arxiv.org/abs/0803.0104
Recommendations
- Exponential family and Taneja's entropy
- Exponential families and MaxEnt calculations for entropy measures of statistical physics
- Natural Exponential Families and Generalized Hypergeometric Measures
- Exponential Families in Theory and Practice
- The generalized exponential family of distributions and its characteristics
- Generalized variance and exponential families
- Shannon's entropy in exponential families: statistical applications
- A generalization of Poincaré's characterization of exponential families
variational principlemaximum entropy principlegeneralised entropyescort probabilitybregman divergencegeneralised exponential familygeneralised Fisher information
Cites Work
- Differential-geometrical methods in statistics
- Possible generalization of Boltzmann-Gibbs statistics.
- Title not available (Why is that?)
- Deformed exponentials and logarithms in generalized thermostatistics
- Title not available (Why is that?)
- Generalized information functions
- Quasi-entropies for finite quantum systems
- Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory
- A class of measures of informativity of observation channels
- CONTINUITY OF A CLASS OF ENTROPIES AND RELATIVE ENTROPIES
- Title not available (Why is that?)
- Title not available (Why is that?)
- A variational formulation of equilibrium statistical mechanics and the Gibbs phase rule
Cited In (36)
- Thermodynamics of exponential Kolmogorov-Nagumo averages
- On the thermodynamics of classical micro-canonical systems
- A new entropy based on a group-theoretical structure
- A note on exponential families of distributions
- Optimal measures and Markov transition kernels
- Nonparametric information geometry: from divergence function to referential-representational biduality on statistical manifolds
- Modelling sociocognitive aspects of students' learning
- Some properties of generalized Fisher information in the context of nonextensive thermostatistics
- Some properties of generalized exponential entropies with applications to data compression
- Geometry of \(q\)-exponential family of probability distributions
- Title not available (Why is that?)
- Theory versus experiment for vacuum Rabi oscillations in lossy cavities
- Escort evolutionary game theory
- Combinatorial optimization with information geometry: the Newton method
- Entropies from coarse-graining: convex polytopes vs. ellipsoids
- Duality of maximum entropy and minimum divergence
- Non-extensivity of the configurational density distribution in the classical microcanonical ensemble
- \(\kappa \)-exponential models from the geometrical viewpoint
- A study of Rényi entropy based on the information geometry formalism
- A projection pricing model for non-Gaussian financial returns
- Notions of the ergodic hierarchy for curved statistical manifolds
- Maximum entropy estimation of transition probabilities of reversible Markov chains
- Truth, belief and experience -- a route to information
- Maximum Lq-likelihood estimation: a study of entropy behavior for the Pareto-exponential distribution with application
- Dually flat geometries of the deformed exponential family
- Uniqueness and characterization theorems for generalized entropies
- Beyond the Shannon-Khinchin formulation: the composability axiom and the universal-group entropy
- Families of distributions characterized by entropy
- Relationships between the Legendre structure in the \(S_{2-q}\)-formalism and the dually-flat structure in the space of escort distributions
- Escort Density Operators and Generalized Quantum Information Measures
- On a (\(\beta, q)\)-generalized Fisher information and inequalities involving \(q\)-Gaussian distributions
- DATA SET MODELS AND EXPONENTIAL FAMILIES IN STATISTICAL PHYSICS AND BEYOND
- Tsallis entropy, escort probability and the incomplete information theory
- Partial subadditivity of entropies
- Rho-tau embedding and gauge freedom in information geometry
- On the connection between linear combination of entropies and linear combination of extremizing distributions
This page was built for publication: Generalised exponential families and associated entropy functions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q845355)