Distortion Rate Function of Sub-Nyquist Sampled Gaussian Sources

DOI10.1109/TIT.2015.2485271MaRDI QIDQ2977075zbMATH OpenOpenAlexWikidataFDO

Authors Alon Kipnis, Andrea J. Goldsmith, Y. C. Eldar, Tsachy Weissman

Publication date 28 April 2017

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1405.5329

Mathematics Subject Classification ID

Signal theory (characterization, reconstruction, filtering, etc.) (94A12)

Abstract: The amount of information lost in sub-Nyquist sampling of a continuous-time Gaussian stationary process is quantified. We consider a combined source coding and sub-Nyquist reconstruction problem in which the input to the encoder is a noisy sub-Nyquist sampled version of the analog source. We first derive an expression for the mean squared error in the reconstruction of the process from a noisy and information rate-limited version of its samples. This expression is a function of the sampling frequency and the average number of bits describing each sample. It is given as the sum of two terms: Minimum mean square error in estimating the source from its noisy but otherwise fully observed sub-Nyquist samples, and a second term obtained by reverse waterfilling over an average of spectral densities associated with the polyphase components of the source. We extend this result to multi-branch uniform sampling, where the samples are available through a set of parallel channels with a uniform sampler and a pre-sampling filter in each branch. Further optimization to reduce distortion is then performed over the pre-sampling filters, and an optimal set of pre-sampling filters associated with the statistics of the input signal and the sampling frequency is found. This results in an expression for the minimal possible distortion achievable under any analog to digital conversion scheme involving uniform sampling and linear filtering. These results thus unify the Shannon-Whittaker-Kotelnikov sampling theorem and Shannon rate-distortion theory for Gaussian sources.

Recommendations

• The rate distortion function for a class of sources
• Rate-distortion function for a Gaussian source model of images (Corresp.)
• The Distortion-Rate Function of Sampled Wiener Processes
• Nonanticipative Rate Distortion Function and Relations to Filtering Theory
• Aliasing-Truncation Errors in Sampling Approximations of Sub-Gaussian Signals
• Rate–Distortion Function via Minimum Mean Square Error Estimation
• Rate-distortion performance in coding bandlimited sources by sampling and dithered quantization
• On the rate-distortion function for the nonstationary Gaussian autoregressive process (Corresp.)
• Rate distortion function for Nth-order Gaussian Markov process
• Sampling and reconstruction of signals with finite rate of innovation in the presence of noise

Cited in

(3)

• Dynamical properties of endomorphisms, multiresolutions, similarity and orthogonality relations
• On high-resolution adaptive sampling of deterministic signals
• Optimal Discrete Gaussian Function: The Closed-Form Functions Satisfying Tao’s and Donoho’s Uncertainty Principle With Nyquist Bandwidth

This page was built for publication: Distortion Rate Function of Sub-Nyquist Sampled Gaussian Sources

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2977075)