Statistical Mechanical Approach to Error Exponents of Lossy Data Compression
From MaRDI portal
Interacting random processes; statistical mechanics type models; percolation theory (60K35) Coding and information theory (compaction, compression, models of communication, encoding schemes, etc.) (aspects in computer science) (68P30) Information theory (general) (94A15) Rate-distortion theory in information and communication theory (94A34)
Abstract: The encoder and decoder for lossy data compression of binary memoryless sources are developed on the basis of a specific-type nonmonotonic perceptron. Statistical mechanical analysis indicates that the potential ability of the perceptron-based code saturates the theoretically achievable limit in most cases although exactly performing the compression is computationally difficult. To resolve this difficulty, we provide a computationally tractable approximation algorithm using belief propagation (BP), which is a current standard algorithm of probabilistic inference. Introducing several approximations and heuristics, the BP-based algorithm exhibits performance that is close to the achievable limit in a practical time scale in optimal cases.
Recommendations
Cites work
Cited in
(6)- Statistical mechanical analysis of a hierarchical random code ensemble in signal processing
- Mismatched codebooks and the role of entropy coding in lossy data compression
- Statistical mechanics of the data compression theorem
- The theoretical capacity of the parity source coder
- One step RSB scheme for the rate distortion function
- scientific article; zbMATH DE number 2226639 (Why is no real title available?)
This page was built for publication: Statistical Mechanical Approach to Error Exponents of Lossy Data Compression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4671580)