Abstract: The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. In this paper, we establish a number of simple inequalities for the weighted entropies (general as well as specific), mirroring similar bounds on standard (Shannon) entropies and related quantities. The required assumptions are written in terms of various expectations of the weight functions. Examples are weighted Ky Fan and weighted Hadamard inequalities involving determinants of positive-definite matrices, and weighted Cram'{e}r-Rao inequalities involving the weighted Fisher information matrix.
Recommendations
- Weighted entropy: basic inequalities
- Some inequalities on generalized entropies
- Weighted Gaussian entropy and determinant inequalities
- Inequalities related to some types of entropies and divergences
- Weighted entropies and their estimations
- On a generalization of the entropy inequality
- Weighted entropies
- On weighted generalized entropy
- ON SOME INEQUALITIES AND GENERALIZED ENTROPIES: A UNIFIED APPROAC
Cites work
- scientific article; zbMATH DE number 3868302 (Why is no real title available?)
- scientific article; zbMATH DE number 2113099 (Why is no real title available?)
- scientific article; zbMATH DE number 913001 (Why is no real title available?)
- scientific article; zbMATH DE number 232786 (Why is no real title available?)
- scientific article; zbMATH DE number 3327942 (Why is no real title available?)
- scientific article; zbMATH DE number 3061616 (Why is no real title available?)
- A proof of the Fisher information inequality via a data processing argument
- An entropic measurement of queueing behaviour in a class of manufacturing operations
- Basic inequalities for weighted entropies
- Characterization of the quantitative-qualitative measure of inaccuracy for discrete generalized probability distributions
- Continuity of mutual entropy in the limiting signal-to-noise ratio regimes
- Determinant Inequalities via Information Theory
- Elements of Information Theory
- Entropy-based measure of uncertainty in past lifetime distributions
- Information theoretic inequalities
- Information theory and coding by example
- Ky Fan inequalities
- Maximum Properties and Inequalities for the Eigenvalues of Completely Continuous Operators
- On measures of “useful” information
- On parametric weighted information improvement
- On the general solution of a functional equation connected to sum form information measures on open domain. III
- On weighted entropy of type $(\alpha ,\beta )$ and its generalizations
- Weighted entropy
- Weighted entropy and optimal portfolios for risk-averse Kelly investments
- Weighted entropy with application
Cited in
(17)- Weighted approach to general entropy function
- A necessary and sufficient condition for the inequality of generalized weighted means
- Some bounds of weighted entropies with augmented Zagreb index edge weights
- Response adaptive designs for phase II trials with binary endpoint based on context-dependent information measures
- scientific article; zbMATH DE number 7796494 (Why is no real title available?)
- Inequalities related to some types of entropies and divergences
- Asymptotic behaviour of the weighted Renyi, Tsallis and Fisher entropies in a Bayesian problem
- Weighted entropy and its use in computer science and beyond
- Wasserstein and weighted metrics for multidimensional Gaussian distributions
- Basic inequalities for weighted entropies
- Weighted entropy: basic inequalities
- Weighted entropy and optimal portfolios for risk-averse Kelly investments
- Weighted entropies
- On energy and expected uncertainty measures in weighted distributions
- Weighted entropy with application
- Weighted Gaussian entropy and determinant inequalities
- A new probability model with support on unit interval: structural properties, regression of bounded response and applications
This page was built for publication: Basic inequalities for weighted entropies
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q304028)
