Rate–Distortion Function via Minimum Mean Square Error Estimation

DOI10.1109/TIT.2011.2143850MaRDI QIDQ5273583zbMATH OpenOpenAlexFDO

Authors Neri Merhav

Publication date 12 July 2017

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1004.5189

Mathematics Subject Classification ID

Information theory (general) (94A15) Rate-distortion theory in information and communication theory (94A34)

Abstract: We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the distortion $Delta=d(X,Y)$ based on the source symbol $X$, with respect to a certain joint distribution of these two random variables. At first glance, these relations may seem somewhat similar to the I-MMSE relations due to Guo, Shamai and Verd'u, but they are, in fact, quite different. The new relations among rate, distortion, and MMSE are discussed from several aspects, and more importantly, it is demonstrated that they can sometimes be rather useful for obtaining non-trivial upper and lower bounds on the rate-distortion function, as well as for determining the exact asymptotic behavior for very low and for very large distortion. Analogous MMSE relations hold for channel capacity as well.

Cited in

(1)

• Distortion Rate Function of Sub-Nyquist Sampled Gaussian Sources

This page was built for publication: Rate–Distortion Function via Minimum Mean Square Error Estimation

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5273583)