Basic inequalities for weighted entropies

DOI10.1007/S00010-015-0396-5zbMATH Open1379.94025arXiv1510.02184OpenAlexW3100215087MaRDI QIDQ304028FDOQ304028

Authors: Izabella Stuhl, Salimeh Yasaei Sekeh, Yuri Suhov, Mark Kelbert 

Publication date: 23 August 2016

Published in: Aequationes Mathematicae (Search for Journal in Brave)

Abstract: The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. In this paper, we establish a number of simple inequalities for the weighted entropies (general as well as specific), mirroring similar bounds on standard (Shannon) entropies and related quantities. The required assumptions are written in terms of various expectations of the weight functions. Examples are weighted Ky Fan and weighted Hadamard inequalities involving determinants of positive-definite matrices, and weighted Cram'{e}r-Rao inequalities involving the weighted Fisher information matrix.

Full work available at URL: https://arxiv.org/abs/1510.02184

Recommendations

• Weighted entropy: basic inequalities
• Some inequalities on generalized entropies
• Weighted Gaussian entropy and determinant inequalities
• Inequalities related to some types of entropies and divergences
• Weighted entropies and their estimations
• On a generalization of the entropy inequality
• Weighted entropies
• On weighted generalized entropy
• ON SOME INEQUALITIES AND GENERALIZED ENTROPIES: A UNIFIED APPROAC

zbMATH Keywords

concavityconvexity[https://portal.mardi4nfdi.de/w/index.php?title=+Special%3ASearch&search=weighed+Cram%EF%BF%BD%EF%BF%BDr-Rao+inequalities&go=Go weighed Cram��r-Rao inequalities]weighted conditional entropyweighted entropyweighted Fisher informationweighted Gibbs inequalityweighted Hadamard inequalityweighted mutual entropyweighted relative entropy

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17) Combinatorial probability (60C05) Probabilistic measure theory (60A10)

Cites Work

• Elements of Information Theory
• Determinant Inequalities via Information Theory
• Ky Fan inequalities
• Title not available (Why is that?)
• Maximum Properties and Inequalities for the Eigenvalues of Completely Continuous Operators
• Information theoretic inequalities
• An entropic measurement of queueing behaviour in a class of manufacturing operations
• On the general solution of a functional equation connected to sum form information measures on open domain. III
• Weighted entropy and optimal portfolios for risk-averse Kelly investments
• Weighted entropy
• Continuity of mutual entropy in the limiting signal-to-noise ratio regimes
• Basic inequalities for weighted entropies
• Entropy-based measure of uncertainty in past lifetime distributions
• Title not available (Why is that?)
• Weighted entropy with application
• Characterization of the quantitative-qualitative measure of inaccuracy for discrete generalized probability distributions
• On weighted entropy of type $(\alpha ,\beta )$ and its generalizations
• On measures of “useful” information
• A proof of the Fisher information inequality via a data processing argument
• Information theory and coding by example
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• On parametric weighted information improvement

Cited In (17)

• Response adaptive designs for phase II trials with binary endpoint based on context-dependent information measures
• Some bounds of weighted entropies with augmented Zagreb index edge weights
• Title not available (Why is that?)
• Asymptotic behaviour of the weighted Renyi, Tsallis and Fisher entropies in a Bayesian problem
• Weighted approach to general entropy function
• Basic inequalities for weighted entropies
• Weighted entropies
• A new probability model with support on unit interval: structural properties, regression of bounded response and applications
• On energy and expected uncertainty measures in weighted distributions
• A necessary and sufficient condition for the inequality of generalized weighted means
• Weighted entropy: basic inequalities
• Weighted entropy and optimal portfolios for risk-averse Kelly investments
• Weighted entropy with application
• Weighted entropy and its use in computer science and beyond
• Weighted Gaussian entropy and determinant inequalities
• Inequalities related to some types of entropies and divergences
• Wasserstein and weighted metrics for multidimensional Gaussian distributions

This page was built for publication: Basic inequalities for weighted entropies

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q304028)