An Identity of Chernoff Bounds With an Interpretation in Statistical Physics and Applications in Information Theory

DOI10.1109/TIT.2008.926340zbMATH Open1329.94038arXivcs/0702101MaRDI QIDQ3604753FDOQ3604753

Authors: Neri Merhav 

Publication date: 24 February 2009

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Abstract: An identity between two versions of the Chernoff bound on the probability a certain large deviations event, is established. This identity has an interpretation in statistical physics, namely, an isothermal equilibrium of a composite system that consists of multiple subsystems of particles. Several information--theoretic application examples, where the analysis of this large deviations probability naturally arises, are then described from the viewpoint of this statistical mechanical interpretation. This results in several relationships between information theory and statistical physics, which we hope, the reader will find insightful.

Full work available at URL: https://arxiv.org/abs/cs/0702101

Recommendations

• Statistical Physics and Information Theory
• Chernoff's bound forms
• A contribution to the theory of Chernoff bounds
• scientific article; zbMATH DE number 3899854
• An elementary derivation of the large deviation rate function for finite state Markov chains

zbMATH Keywords

phase transitionsthermodynamicsequipartitionstatistical physicslarge deviations theorythermal equilibriumChernoff bound

Mathematics Subject Classification ID

Large deviations (60F10) Information theory (general) (94A15) Coding theorems (Shannon theory) (94A24) Classical equilibrium statistical mechanics (general) (82B05) Rate-distortion theory in information and communication theory (94A34)

Cited In (1)

• Chernoff–Hoeffding Bounds for Applications with Limited Independence

This page was built for publication: An Identity of Chernoff Bounds With an Interpretation in Statistical Physics and Applications in Information Theory

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3604753)