Statistical Physics and Information Theory

DOI10.1561/0100000052MaRDI QIDQ3069051zbMATH OpenOpenAlexFDO

Authors Neri Merhav

Publication date 24 January 2011

Published in Foundations and Trends™ in Communications and Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1006.1565

zbMATH Keywords

Applications of statistical physics methods in Information theoryChannel modelsInformation theory generalMeasures of information, entropy

Mathematics Subject Classification ID

Information theory (general) (94A15) Measures of information, entropy (94A17) Channel models (including quantum) in information and communication theory (94A40)

Abstract: This document consists of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, as well as to graduate students in Physics who have basic background in Information Theory. Strong emphasis is given to the analogy and parallelism between Information Theory and Statistical Physics, as well as to the insights, the analysis tools and techniques that can be borrowed from Statistical Physics and `imported' to certain problem areas in Information Theory. This is a research trend that has been very active in the last few decades, and the hope is that by exposing the student to the meeting points between these two disciplines, we will enhance his/her background and perspective to carry out research in the field. A short outline of the course is as follows: Introduction; Elementary Statistical Physics and its Relation to Information Theory; Analysis Tools in Statistical Physics; Systems of Interacting Particles and Phase Transitions; The Random Energy Model (REM) and Random Channel Coding; Additional Topics (optional).

Recommendations

• Probability, information and statistical physics
• Information in statistical physics
• Information Theory and Statistical Mechanics
• Nonequilibrium statistical information theory
• Information Theory, Relative Entropy and Statistics
• Information entropy in problems of classical and quantum statistical mechanics
• scientific article; zbMATH DE number 3143969
• scientific article; zbMATH DE number 3925962
• scientific article; zbMATH DE number 1023416

Cited in

(7)

• Quantum limits on the entropy of bandlimited radiation
• Analysis of sparse recovery algorithms via the replica method
• Quantum hypothesis testing and non-equilibrium statistical mechanics
• An Identity of Chernoff Bounds With an Interpretation in Statistical Physics and Applications in Information Theory
• Lectures on Entropy. I: Information-Theoretic Notions
• A toolbox for refined information-theoretic analyses
• Active inference for binary symmetric hidden Markov models

This page was built for publication: Statistical Physics and Information Theory

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3069051)