scientific article; zbMATH DE number 3623432
From the author's introduction: A key feature of Shannon's information theory is the discovery that the colloquial term information can often be given a mathematical meaning as a numerically measurable quantity, on the basis of a probabilistic model, in such a way that the solution of many important problems of information storage and transmission can be formulated in terms of this measure of the amount of information. This information measure has a very concrete operational interpretation: roughly, it equals the minimum number of binary digits needed, on the average, to encode the message in question. The coding theorems of information theory provide so overwhelming evidence for the adequateness of Shannon's information measure that to look for essentially different measures of information might appear to make no sense at all. Moreover, it has been shown by several authors, starting with \textit{C. E. Shannon} [Bell. Syst. Tech. J. 27, 379--423, 623--656 (1948; Zbl 1154.94303)], that the measure of the amount of information is uniquely determined by some rather natural postulates. Still, all the evidence that Shannon's information measure is the only possible one, is valid only within the restricted scope of coding problems considered by Shannon. As \textit{A. Rényi} pointed out in his fundamental paper [Proc. 4th Berkeley Symp. Math. Stat. Probab., Vol. 1, 547--561 (1961; Zbl 0106.33001)] on generalized information measures, in other sorts of problems other quantities may serve, just as well or even better as measures of information. This should be indicated either by their operational significance (pragmatic approach) or by a set of natural postulates characterizing them (axiomatic approach) or, preferably, by both. In this mainly expository paper, some functionals of (complete) probability distributions meeting both criteria will be discussed, with a tendency of giving priority to the operational significance (which, however, need not be connected necessarily with coding). [This article was published in the book announced in Zbl 0396.00010.]
- Measuring information beyond communication theory. Some probably useful and some almost certainly useless generalizations
- Measuring information beyond communication theory. Some probably useful and some almost certainly useless generalizations
- scientific article; zbMATH DE number 4077112
- Information and statistics. I
- scientific article; zbMATH DE number 3173999
- Gaussian limits for generalized spacings
- On some improvements of the Jensen inequality with some applications
- Information and statistics. I
- Certainty equivalents and information measures: Duality and extremal principles
- Some properties of generalized exponential entropies with applications to data compression
- Some comments on Boltzmann-Gibbs statistical mechanics
- A possible extension of Shannon's information theory
- New bounds for Shannon, relative and Mandelbrot entropies via Hermite interpolating polynomial
- Majorization, ``useful Csiszár divergence and ``useful Zipf-Mandelbrot law
- An alternative to entropy in the measurement of information
- Coordinate invariance as a fundamental constraint on the form of stimulus-specific information measures
- Measuring robustness for weighted distributions: Bayesian perspective
- On the natural measure of uncertainty and information
- Local sensitivity diagnostics for Bayesian inference
- A comparison of the Shannon and Kullback information measures
- Motivic information
- Estimation of different entropies via Hermite interpolating polynomial using Jensen-type functionals
- Levinson-type inequalities via new Green functions and Montgomery identity
- About the sharpness of the Jensen inequality
- RETRACTED ARTICLE: Generalization of the Levinson inequality with applications to information theory
- Generalization of the Levinson inequality with applications to information theory
- Estimation of f-divergence and Shannon entropy by using Levinson type inequalities for higher order convex functions via Hermite interpolating polynomial
- Majorization inequalities via Green functions and Fink's identity with applications to Shannon entropy
- Entropy results for Levinson-type inequalities via Green functions and Hermite interpolating polynomial
- Difference equations related to majorization theorems via Montgomery identity and Green's functions with application to the Shannon entropy
- Extensions of recent combinatorial refinements of discrete and integral Jensen inequalities
- Estimation of \(f\)-divergence and Shannon entropy by Levinson-type inequalities via new Green's functions and Lidstone polynomial
- Monoparametric family of metrics derived from classical Jensen-Shannon divergence
- On the properties that characterize privacy
- New converses of Jensen inequality via Green functions with applications
- Estimation of different entropies via Lidstone polynomial using Jensen-type functionals
- New refinements of the discrete Jensen's inequality generated by finite or infinite permutations
- A class of asymptotically efficient estimators based on sample spacings
- Inequalities of the Edmundson-Lah-Ribarič type for \(n\)-convex functions with applications
- Probability as a measure of information added
- Majorizatiuon and Zipf-Mandelbrot law
- Majorization, Csiszár divergence and Zipf-Mandelbrot law
- Estimations of \(f\)- and Rényi divergences by using a cyclic refinement of the Jensen's inequality
- A symmetric information divergence measure of the Csiszár's \(f\)-divergence class and its bounds
- Information and probability: collectors and Shannon compositivity
- Optimal quantization of the support of a continuous multivariate distribution based on mutual information
- Information theory over multisets
- Measures of information and uncertainty
- Predictive rate-distortion for infinite-order Markov processes
- Refinement of the Jensen integral inequality
- scientific article; zbMATH DE number 3131443 (Why is no real title available?)
- Algunas consideraciones sobre la informacion generalizada
- Quantitative information measurement and application for machine component classification codes
- scientific article; zbMATH DE number 7449527 (Why is no real title available?)
- scientific article; zbMATH DE number 4135864 (Why is no real title available?)
- scientific article; zbMATH DE number 4145822 (Why is no real title available?)
- scientific article; zbMATH DE number 4164729 (Why is no real title available?)
- An axiomatic approach to measuring of information of sign-based image representations
- The Shannon field of non-negative information functions
- The amount of information and the volume of ‘information tare’
- scientific article; zbMATH DE number 4005215 (Why is no real title available?)
- scientific article; zbMATH DE number 4023192 (Why is no real title available?)
- scientific article; zbMATH DE number 4047581 (Why is no real title available?)
- scientific article; zbMATH DE number 3731914 (Why is no real title available?)
- A new outlook on Shannon's information measures
- scientific article; zbMATH DE number 3501380 (Why is no real title available?)
- scientific article; zbMATH DE number 3601518 (Why is no real title available?)
- scientific article; zbMATH DE number 4127146 (Why is no real title available?)
- scientific article; zbMATH DE number 710359 (Why is no real title available?)
- Capturing the Intangible Concept of Information
- scientific article; zbMATH DE number 1092011 (Why is no real title available?)
- Inequalities of the Jensen and Edmundson-Lah-Ribarič type for 3-convex functions with applications
- Inequalities for discrete f-divergence measures: a survey of recent results
- On a new non-symmetric divergence measure
- Information and Coding Discrimination of Pseudo-Additive Entropies (PAE)
- Truth, belief and experience -- a route to information
- A survey of some quantitative approaches to the notion of information
- Quantitative — Qualitative Measure of Information
- An information-theoretic approach for the quantification of relevance
- scientific article; zbMATH DE number 790726 (Why is no real title available?)
- scientific article; zbMATH DE number 868060 (Why is no real title available?)
- How the type of convexity of the core function affects the Csiszár f-divergence functional
- Estimation of different entropies via Abel-Gontscharoff Green functions and Fink's identity using Jensen type functionals
- Introduction to the Information in Metric Space
- The probabilities of large deviations for a certain class of statistics associated with multinomial distribution
- New Foundations for Information Theory
- A Unified Approach to Prior and Loss Robustness
- Series of divergence measures of type \(k\), information inequalities and particular cases
- Monotonicity of the Jensen functional for \(f\)-divergences with applications to the Zipf-Mandelbrot law
- On a Jensen-type inequality for generalized \(f\)-divergences and Zipf-Mandelbrot law
- Estimation of different entropies via Taylor one point and Taylor two points interpolations using Jensen type functionals
- An axiomatic characterization of a two-parameter extended relative entropy
- Information and entropy. A double game with probabilities
- Parameter learning for alpha integration
- A Note on Divergences
- Information Efficiency
- scientific article; zbMATH DE number 3340909 (Why is no real title available?)
- scientific article; zbMATH DE number 3349715 (Why is no real title available?)
- scientific article; zbMATH DE number 3349716 (Why is no real title available?)
- Measure of information and contiguity
- Entropic nonextensivity: A possible measure of complexity
- Belief revision generalized: a joint characterization of Bayes' and Jeffrey's rules
- Information Geometry
- Generalizations of Levinson type inequalities via new Green functions with applications to information theory
- Inequalities for functions convex on the coordinates with applications to Jensen and Hermite-Hadamard type inequalities, and to new divergence functionals
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4186205)