Thermodynamics of the binary symmetric channel

DOI10.1186/S40736-015-0021-5MaRDI QIDQ2364722zbMATH OpenOpenAlexWikidataFDO

Authors Evgeny Verbitskiy

Publication date 24 July 2017

Published in Pacific Journal of Mathematics for Industry (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1509.03231

zbMATH Keywords

denoisingGibbs statehidden Markov modelthermodynamic formalism

Mathematics Subject Classification ID

Thermodynamic formalism, variational principles, equilibrium states for dynamical systems (37D35) Lattice systems (Ising, dimer, Potts, etc.) and systems on graphs arising in equilibrium statistical mechanics (82B20) Disordered systems (random Ising models, random Schrödinger operators, etc.) in equilibrium statistical mechanics (82B44)

Abstract: We study a hidden Markov process which is the result of a transmission of the binary symmetric Markov source over the memoryless binary symmetric channel. This process has been studied extensively in Information Theory and is often used as a benchmark case for the so-called denoising algorithms. Exploiting the link between this process and the 1D Random Field Ising Model (RFIM), we are able to identify the Gibbs potential of the resulting Hidden Markov process. Moreover, we obtain a stronger bound on the memory decay rate. We conclude with a discussion on implications of our results for the development of denoising algorithms.

Recommendations

• Bounds on the entropy rate of binary hidden Markov processes
• Thermodynamics of hidden Markov processes
• The entropy of a binary hidden Markov process
• Thermodynamic derivation of the mutual information for discrete symmetric channels
• On the entropy of a hidden Markov process

Cites work

• Hidden Markov processes
• On regularity of functions of Markov chains
• On the entropy of a hidden Markov process
• Schemes for Bidirectional Modeling of Discrete Stationary Sources
• Some systems with unique equilibrium states
• State learning and mixing in entropy of hidden Markov processes and the Gilbert-Elliott channel
• Thermodynamic Gibbs Formalism and Information Theory
• Thermodynamics of hidden Markov processes
• Universal discrete denoising: known channel

Cited in

(2)

• On entropy production of repeated quantum measurements. II: Examples
• scientific article; zbMATH DE number 3294114 (Why is no real title available?)

This page was built for publication: Thermodynamics of the binary symmetric channel

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2364722)