Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
From MaRDI portal
Publication:3867715
DOI10.1109/TIT.1980.1056144zbMath0429.94011OpenAlexW2052958516MaRDI QIDQ3867715
Rodney W. Johnson, John E. Shore
Publication date: 1980
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1109/tit.1980.1056144
Related Items
The role of reconstructability analysis in social science research ⋮ Maximum entropy principle and nonlinear stochastic oscillators ⋮ Ranking kinematics for revising by contextual information ⋮ On \(q\)-non-extensive statistics with non-Tsallisian entropy ⋮ Local softening of information geometric indicators of chaos in statistical modeling in the presence of quantum-like considerations ⋮ An ME-based approximation for multi-server queues with preemptive priority ⋮ A Bayesian interpretation of first-order phase transitions ⋮ An information theoretic argument for the validity of the exponential model ⋮ The application of the principle of minimum cross-entropy to the characterization of the exponential-type probability distributions ⋮ Information theoretic approximations for the \(M/G/1\) retrial queue ⋮ A foundational approach to generalising the maximum entropy inference process to the multi-agent context ⋮ Entropy and set covering ⋮ Fully probabilistic design of strategies with estimator ⋮ Affinity-based extension of non-extensive entropy and statistical mechanics ⋮ Estimation of structured covariances with application to array beamforming ⋮ Rescuing complementarity with little drama ⋮ On the uniqueness of possibilistic measure of uncertainty and information ⋮ Where do we stand on measures of uncertainty, ambiguity, fuzziness, and the like? ⋮ A weighted generalized maximum entropy estimator with a data-driven weight ⋮ Command-based importance sampling for statistical model checking ⋮ A maximum entropy approach to estimation and inference in dynamic models or Counting fish in the sea using maximum entropy ⋮ On the relationship between entropy, demand uncertainty, and expected loss ⋮ A Bayesian approach to diagnosis of asset pricing models ⋮ Information and probabilistic reasoning ⋮ Estimation and inference with censored and ordered multinomial response data ⋮ Why \(q\)-expectation values must be used in nonextensive statistical mechanics ⋮ Fuzzy sets, probability and measurement ⋮ On the applicability of maximum entropy to inexact reasoning ⋮ SPIRIT and Léa Sombé: A study in probabilistic reasoning ⋮ Quadratically constrained minimum cross-entropy analysis ⋮ The finite sample properties of simultaneous equations' estimates and estimators. Bayesian and non-Bayesian approaches ⋮ Most likely ensemble with a given average energy prepared by a single slit ⋮ Models, prior information, and Bayesian analysis ⋮ Existence of a statistical equilibrium for an economy with endogenous offer sets ⋮ Deceptive updating and minimal information methods ⋮ Characterizing the principle of minimum cross-entropy within a conditional-logical framework ⋮ A maximum entropy characterization of symmetric Kotz type and Burr multivariate distribu\-tions ⋮ Minimum mutual information and non-Gaussianity through the maximum entropy method: theory and properties ⋮ On the measurability of knowledge acquisition and query processing. ⋮ Comparing dynamic equilibrium models to data: a Bayesian approach ⋮ Inference after checking multiple Bayesian models for data conflict and applications to mitigating the influence of rejected priors ⋮ A compound class of Weibull and power series distributions ⋮ Conditional ranking revision. Iterated revision with sets of conditionals ⋮ Decomposing a relation into a tree of binary relations ⋮ Can the maximum entropy principle be explained as a consistency requirement? ⋮ A note on the inevitability of maximum entropy ⋮ Derivation of regression formulae using the minimum cross-entropy principle ⋮ On quantum-classical transition of a single particle ⋮ A universal table model for categorical databases ⋮ A note on conditional logics and entropy ⋮ Reconstruction of possibilistic behavior systems ⋮ Causality and maximum entropy updating ⋮ A maximum entropy analysis of the M/G/1 and G/M/1 queueing systems at equilibrium ⋮ Cross-entropy estimation in technical efficiency analysis ⋮ Conditional clusters, musters, and probability ⋮ Explaining default intuitions using maximum entropy. ⋮ System JLZ -- rational default reasoning by minimal ranking constructions. ⋮ Geometry of quantum inference ⋮ Continuity equations, \(H\)-theorems, and maximum entropy. ⋮ Newtonian dynamics from the principle of maximum caliber ⋮ Maximum-entropy meshfree method for compressible and near-incompressible elasticity ⋮ Cross entropy minimization in uninvadable states of complex populations ⋮ The principle of maximum entropy and a problem in probability kinematics ⋮ Conditional logic and the Principle of Entropy ⋮ Sparse plus low rank network identification: a nonparametric approach ⋮ Information-flux method: a meshfree maximum-entropy Petrov-Galerkin method including stabilised finite element methods ⋮ Approximate Bayesian recursive estimation ⋮ Sticky information and model uncertainty in survey data on inflation expectations ⋮ Nonparametric search ⋮ Sparse maximum-entropy random graphs with a given power-law degree distribution ⋮ Entropy-based parameter estimation for extended Burr XII distribution ⋮ On families of beta- and generalized gamma-generated distributions and associated inference ⋮ A representation theorem and applications to measure selection and noninformative priors ⋮ Point estimation with exponentially tilted empirical likelihood ⋮ Comparing probability measures using possibility theory: a notion of relative peakedness ⋮ Revisiting prior distributions. II: Implications of the physical prior in maximum entropy analysis ⋮ Symmetric measures via moments ⋮ Cell-based maximum-entropy approximants ⋮ Minimum mutual information and non-Gaussianity through the maximum entropy method: estimation from finite samples ⋮ Information theoretic framework for process control ⋮ A minimum discrimination information estimator of preliminary conjectured normal variance ⋮ On maximum entropy characterization of Pearson's type II and VII multivariate distributions ⋮ In defense of the maximum entropy inference process ⋮ A resolution of St. Petersburg paradox ⋮ Nonequilibrium in thermodynamic formalism: the second law, gases and information geometry ⋮ Combining ranked mean value forecasts ⋮ A maximum entropy priority approximation for a stable G/G/1 queue ⋮ Representing preorders with injective monotones ⋮ Renyi entropy as a statistical entropy for complex systems ⋮ Host-based intrusion detection using dynamic and static behavioral models ⋮ Deduction with uncertain conditionals ⋮ Limited information likelihood and Bayesian analysis ⋮ Comparison of maximum entropy and higher-order entropy estimators. ⋮ Identification model based on the maximum information entropy principle ⋮ Computing the maximum-entropy extension of given discrete probability distributions ⋮ Unbiasing in iterative reconstruction algorithms for discrete compressed sensing ⋮ Entropy maximisation and queueing network models ⋮ Information theoretic analysis for a general queueing system at equilibrium with application to queues in tandem ⋮ Maximum entropy and the G/G/1/N queue ⋮ Combining probabilistic logic programming with the power of maximum entropy ⋮ MEASURES OF UNCERTAINTY AND INFORMATION BASED ON POSSIBILITY DISTRIBUTIONS ⋮ Belief revision and information fusion on optimum entropy ⋮ The compound class of extended Weibull power series distributions ⋮ Identification of the drift coeffic plank equation from the momer its stationary solution ⋮ A conditional-logical approach to minimum cross-entropy ⋮ An entropic framework for the normal distribution in capability analysis ⋮ Towards Lifted Inference Under Maximum Entropy for Probabilistic Relational FO-PCL Knowledge Bases ⋮ MINIMUM DISCRIMINATION INFORMATION ESTIMATOR OF THE INVERSE GAUSSIAN MEAN WITH KNOWN COEFFICIENT OF VARIATION ⋮ Data processing using information theory functionals ⋮ Data processing using information theory functionals ⋮ Random Simplicial Complexes: Models and Phenomena ⋮ Non-equilibrium dog-flea model ⋮ A Justification for Applying the Principle of Minimum Relative Entropy to Information Integration Problems ⋮ Multilevel aggregation of central server models: a minimum relative entropy approach ⋮ On the Origins of Imperfection and Apparent Non-rationality ⋮ Discretizing Distributions with Exact Moments: Error Estimate and Convergence Analysis ⋮ Joint dependence distribution of data set using optimizing Tsallis copula entropy ⋮ An entropic structure in capability indices ⋮ Clustering and the efficient use of cognitive resources ⋮ Fluctuation theorems in \(q\)-canonical ensembles ⋮ A simple robust asset pricing model under statistical ambiguity ⋮ Bayesian revision of a prior given prior-data conflict, expert opinion, or a similar insight: a large-deviation approach ⋮ Minimax Mutual Information Approach for Independent Component Analysis ⋮ The \(T-R \{Y\}\) power series family of probability distributions ⋮ Counterfactual prediction in complete information games: point prediction under partial identification ⋮ Padé-like approximation and maximum entropy formalism applied to chaotic systems ⋮ Optimal design of priors constrained by external predictors ⋮ Misusing the entropy maximization in the jungle of generalized entropies ⋮ On double stage minimum discrimination information estimators of the interval constrained normal mean ⋮ Dynamic metabolic resource allocation based on the maximum entropy principle ⋮ Logical perspectives on the foundations of probability ⋮ Derivatives of maximum-entropy basis functions on the boundary: Theory and computations ⋮ Maximum entropy derived and generalized under idempotent probability to address Bayes-frequentist uncertainty and model revision uncertainty: an information-theoretic semantics for possibility theory ⋮ Rules of proof for maximal entropy inference ⋮ Axiomatisation of fully probabilistic design revisited ⋮ A kinematics principle for iterated revision ⋮ Dimensional measures of generalized entropy ⋮ Probabilistic ordinal regression methods for multiple criteria sorting admitting certain and uncertain preferences ⋮ Thermodynamic resource theories, non-commutativity and maximum entropy principles ⋮ Independent Nonlinear Component Analysis ⋮ Nonequilibrium thermodynamics and information theory: basic concepts and relaxing dynamics ⋮ Model-based preference quantification ⋮ A maximum entropy framework for nonexponential distributions ⋮ Maximum entropy and empirical likelihood in length-biased setting: a comparison study ⋮ Entropic Trust Region for Densest Crystallographic Symmetry Group Packings ⋮ On shrinkage to interval estimators of the binomial p ⋮ Forecasting jump arrivals in stock prices: new attention-based network architecture using limit order book data ⋮ Quadratic maximum-entropy serendipity shape functions for arbitrary planar polygons ⋮ Cooperative metabolic resource allocation in spatially-structured systems ⋮ Signatures of quantum phase transitions from the boundary of the numerical range ⋮ Information-Theoretic Distribution Test with Application to Normality ⋮ A Convergent Iterative Procedure for Constructing Bivariate Distributions ⋮ UNCERTAINTY AND ESTIMATION IN RECONSTRUCTABILITY ANALYSIS ⋮ The information content of rules and rule sets and its application ⋮ A simultaneous estimation and variable selection rule ⋮ Bayesian general equilibrium ⋮ A Bayesian/maximum-entropy view to the spatial estimation problem ⋮ Estimation by Maximum Entropy Subject to Second‐Order Conditions ⋮ Continuity of the maximum-entropy inference: Convex geometry and numerical ranges approach ⋮ Maximum entropy and Bayesian approaches to the ratio problem ⋮ Optimality, entropy and complexity for nonextensive quantum scattering ⋮ Chaotic Dynamics in Brain Activity: An Approach Based on Cross-Prediction Errors for Nonstationary Signals ⋮ Maximum entropy characterizations of the multivariate Liouville distributions ⋮ Fully probabilistic design of hierarchical Bayesian models ⋮ Bayesian and Maximum Entropy Analyses of Flow Networks with Non-Gaussian Priors and Soft Constraints ⋮ Recall and reasoning -- an information theoretical model of cognitive processes ⋮ Continuity of the maximum-entropy inference ⋮ MEASURING DISTRIBUTION MODEL RISK ⋮ A BAYESIAN INTERPRETATION OF MULTIPLE POINT ESTIMATES ⋮ State and parameter estimation of state-space model with entry-wise correlated uniform noise ⋮ Minimum dynamic discrimination information models ⋮ The Burr XII power series distributions: a new compounding family ⋮ An effective approach for probabilistic lifetime modelling based on the principle of maximum entropy with fractional moments ⋮ Compressing strongly connected subgroups in social networks: An entropy-based approach ⋮ A Small-Sample Estimator for the Sample-Selection Model ⋮ The General Form of γ-Family of Quantum Relative Entropies ⋮ MODELS BASED ON PARTIAL INFORMATION ABOUT SURVIVAL AND HAZARD GRADIENT ⋮ Inverse Weibull power series distributions: properties and applications ⋮ Automated Preference Elicitation for Decision Making ⋮ ON THE PROBLEM OF CONSTRAINTS IN NONEXTENSIVE FORMALISM: A QUANTUM MECHANICAL TREATMENT ⋮ Integrating inconsistent data in a probabilistic model ⋮ NEW DECISION RULES IN STATISTICAL PATTERN RECOGNITION ⋮ Maximum Entropy Derivation of Quasi-Newton Methods ⋮ RECONSTRUCTABILITY ANALYSIS: Overview and Bibliography† ⋮ Quantum collapse rules from the maximum relative entropy principle ⋮ A logic for inductive probabilistic reasoning ⋮ The extraction of information from multiple point estimates ⋮ Solution of the Fokker Plank-Kolmogorov Equation by Using The Maximum Entropy Principle ⋮ DECISION MAKING IN RECONSTRUCTABILITY ANALYSIS† ⋮ Empirical entropy for right censored data
This page was built for publication: Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
