Information measures in perspective

DOI10.1111/J.1751-5823.2010.00105.XMaRDI QIDQ6574896FDOQ6574896

Authors: Nader Ebrahimi, Ehsan S. Soofi, Refik Soyer 

Publication date: 19 July 2024

Published in: International Statistical Review (Search for Journal in Brave)

zbMATH Keywords

entropymutual informationBayesian informationKullback-Leibler informationdynamic information

Mathematics Subject Classification ID

Parametric inference (62Fxx) Communication, information (94Axx) Sufficiency and information (62Bxx)

Cites Work

• Title not available (Why is that?)
• Bayesian Measures of Model Complexity and Fit
• Title not available (Why is that?)
• Bayesian experimental design: A review
• On Information and Sufficiency
• A Mathematical Theory of Communication
• Title not available (Why is that?)
• Information Theoretic Approaches to Inference in Moment Condition Models
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Expected information as ecpected utility
• Estimation with quadratic loss.
• Relative Entropy Measures of Multivariate Dependence
• An invariant form for the prior probability in estimation problems
• Empirical Bayes estimation of the multivariate normal covariance matrix
• Information gain and a general measure of correlation
• Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems
• The world according to Rényi: Thermodynamics of multifractal systems
• Possible generalization of Boltzmann-Gibbs statistics.
• Information Theory and Statistical Mechanics
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• I-divergence geometry of probability distributions and minimization problems
• Expressions for Rényi and Shannon entropies for multivariate distributions
• Information indices: Unification and applications.
• Title not available (Why is that?)
• Title not available (Why is that?)
• A measure of discrimination between past lifetime distributions
• Information theoretic framework for process control
• On a Measure of the Information Provided by an Experiment
• Bayes Estimate and Inference for Entropy and Information Index of Fit
• Information Properties of Order Statistics and Spacings
• A characterisation of the proportional hazards model through a measure of discrimination between two residual life distributions
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• A compendium to information theory in economics and econometrics
• Ordering univariate distributions by entropy and variance
• Formulas for Rényi information and related measures for univariate distributions.
• Information processing and Bayesian analysis.
• Diagnostic Measures for Model Criticism
• Maximum Entropy Utility
• The entropy of ordered sequences and order statistics
• Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
• Goodness of prediction fit
• Capturing the Intangible Concept of Information
• On Optimality Properties of the Power Prior
• A Dependence Metric for Possibly Nonlinear Processes
• An information criterion for likelihood selection
• Bayesian Hypothesis Testing: A Reference Approach
• Information Distinguishability with Application to Analysis of Failure Data
• Entropy and the central limit theorem
• Information theoretic approach to statistical properties of multivariate Cauchy-Lorentz distributions
• Maximum entropy estimation of density and regression functions
• Entropy-based measure of uncertainty in past lifetime distributions
• Title not available (Why is that?)
• Maximum dynamic entropy models
• Uncertainty, Information, and Sequential Experiments
• Multivariate maximum entropy identification, transformation, and dependence
• Minimum dynamic discrimination information models
• Title not available (Why is that?)
• On the convexity of some divergence measures based on entropy functions
• Reliability and Risk
• Title not available (Why is that?)
• Statistical methods in bioinformatics. An introduction.
• Entropy expressions for multivariate continuous distributions
• A Predictive View of the Detection and Characterization of Influential Observations in Regression Analysis
• The entropy of consecutive order statistics
• Expressions for Rényi and Shannon entropies for bivariate distributions
• Certain Inequalities in Information Theory and the Cramer-Rao Inequality
• Multivariate dynamic information
• Maximum Entropy and Reliability Distributions
• Title not available (Why is that?)
• A note on conditional logics and entropy
• Information theory as a unifying statistical approach for use in marketing research
• Effects of collinearity on information about regression coefficients
• Title not available (Why is that?)
• Information About Hyperparamters in Hierarchical Models
• A Paradigm for Masking (Camouflaging) Information
• A Closer Look at the Deviance
• Application of a Measure of Information to the Design and Comparison of Regression Experiments
• Title not available (Why is that?)
• Prediction variance and information worth of observations in time series
• Goodness of Prediction Fit for Multivariate Linear Models
• Title not available (Why is that?)
• Information importance of predictors: concept, measures, Bayesian inference, and applications
• On Information in Statistics
• Measures of dependence in normal models and exponential models by information gain
• On coherence in parametric density estimation

Cited In (1)

• On the information properties of working used systems using dynamic signature

This page was built for publication: Information measures in perspective

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6574896)