Statistical mechanics of the data compression theorem

DOI10.1088/0305-4470/35/8/101zbMATH Open1003.94018arXivcond-mat/0106209OpenAlexW2045896434MaRDI QIDQ4545294FDOQ4545294

Authors: Tatsuto Murayama 

Publication date: 15 August 2002

Published in: Journal of Physics A: Mathematical and General (Search for Journal in Brave)

Abstract: We analyze the performance of a linear code used for a data compression of Slepian-Wolf type. In our framework, two correlated data are separately compressed into codewords employing Gallager-type codes and casted into a communication network through two independent input terminals. At the output terminal, the received codewords are jointly decoded by a practical algorithm based on the Thouless-Anderson-Palmer approach. Our analysis shows that the achievable rate region presented in the data compression theorem by Slepian and Wolf is described as first-order phase transitions among several phases. The typical performance of the practical decoder is also well evaluated by the replica method.

Full work available at URL: https://arxiv.org/abs/cond-mat/0106209

Recommendations

• Statistical Mechanical Approach to Error Exponents of Lossy Data Compression
• Effective entropies and data compression
• Entropy and data compression schemes
• The data compression theorem for ergodic quantum information sources
• scientific article; zbMATH DE number 3463524
• Reconciling Data Compression and Kolmogorov Complexity
• scientific article; zbMATH DE number 3893089
• Epsilon Entropy and Data Compression
• Toward an abstract theory of data compression

zbMATH Keywords

data compressionlinear codesource codingreplica symmetric ansatzGallager-type codes

Mathematics Subject Classification ID

Source coding (94A29) Coding and information theory (compaction, compression, models of communication, encoding schemes, etc.) (aspects in computer science) (68P30) Lattice systems (Ising, dimer, Potts, etc.) and systems on graphs arising in equilibrium statistical mechanics (82B20) Linear codes (general theory) (94B05)

Cited In (6)

• Title not available (Why is that?)
• Statistical mechanical analysis of a hierarchical random code ensemble in signal processing
• One step RSB scheme for the rate distortion function
• Data Processing Theorems and the Second Law of Thermodynamics
• Epsilon Entropy and Data Compression
• Statistical Mechanical Approach to Error Exponents of Lossy Data Compression

This page was built for publication: Statistical mechanics of the data compression theorem

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4545294)