Physics of the Shannon Limits
From MaRDI portal
Publication:5281289
DOI10.1109/TIT.2010.2053867zbMATH Open1366.94251arXiv0903.1484MaRDI QIDQ5281289FDOQ5281289
Authors: Neri Merhav 
Publication date: 27 July 2017
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Abstract: We provide a simple physical interpretation, in the context of the second law of thermodynamics, to the information inequality (a.k.a. the Gibbs' inequality, which is also equivalent to the log-sum inequality), asserting that the relative entropy between two probability distributions cannot be negative. Since this inequality stands at the basis of the data processing theorem (DPT), and the DPT in turn is at the heart of most, if not all, proofs of converse theorems in Shannon theory, it is observed that conceptually, the roots of fundamental limits of Information Theory can actually be attributed to the laws of physics, in particular, to the second law of thermodynamics, and at least indirectly, also to the law of energy conservation. By the same token, in the other direction: one can view the second law as stemming from information-theoretic principles.
Full work available at URL: https://arxiv.org/abs/0903.1484
This page was built for publication: Physics of the Shannon Limits
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5281289)
