Statistical mechanics of the data compression theorem

DOI10.1088/0305-4470/35/8/101MaRDI QIDQ4545294zbMATH OpenOpenAlexFDO

Authors Tatsuto Murayama

Publication date 15 August 2002

Published in Journal of Physics A: Mathematical and General (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/cond-mat/0106209

zbMATH Keywords

data compressionlinear codesource codingreplica symmetric ansatzGallager-type codes

Mathematics Subject Classification ID

Source coding (94A29) Coding and information theory (compaction, compression, models of communication, encoding schemes, etc.) (aspects in computer science) (68P30) Lattice systems (Ising, dimer, Potts, etc.) and systems on graphs arising in equilibrium statistical mechanics (82B20) Linear codes (general theory) (94B05)

Abstract: We analyze the performance of a linear code used for a data compression of Slepian-Wolf type. In our framework, two correlated data are separately compressed into codewords employing Gallager-type codes and casted into a communication network through two independent input terminals. At the output terminal, the received codewords are jointly decoded by a practical algorithm based on the Thouless-Anderson-Palmer approach. Our analysis shows that the achievable rate region presented in the data compression theorem by Slepian and Wolf is described as first-order phase transitions among several phases. The typical performance of the practical decoder is also well evaluated by the replica method.

Recommendations

• Statistical Mechanical Approach to Error Exponents of Lossy Data Compression
• Effective entropies and data compression
• Entropy and data compression schemes
• The data compression theorem for ergodic quantum information sources
• scientific article; zbMATH DE number 3463524
• Reconciling Data Compression and Kolmogorov Complexity
• scientific article; zbMATH DE number 3893089
• Epsilon Entropy and Data Compression
• Toward an abstract theory of data compression

Cited in

(6)

• Data Processing Theorems and the Second Law of Thermodynamics
• Statistical Mechanical Approach to Error Exponents of Lossy Data Compression
• One step RSB scheme for the rate distortion function
• Statistical mechanical analysis of a hierarchical random code ensemble in signal processing
• scientific article; zbMATH DE number 2226639 (Why is no real title available?)
• Epsilon Entropy and Data Compression

This page was built for publication: Statistical mechanics of the data compression theorem

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4545294)