A Note on Rate-Distortion Functions for Nonstationary Gaussian Autoregressive Processes

DOI10.1109/TIT.2007.915713zbMATH Open1311.94045arXivcs/0702150OpenAlexW1978432233MaRDI QIDQ3604568FDOQ3604568

Authors: Takeshi Hashimoto, Robert M. Gray 

Publication date: 24 February 2009

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Abstract: Source coding theorems and Shannon rate-distortion functions were studied for the discrete-time Wiener process by Berger and generalized to nonstationary Gaussian autoregressive processes by Gray and by Hashimoto and Arimoto. Hashimoto and Arimoto provided an example apparently contradicting the methods used in Gray, implied that Gray's rate-distortion evaluation was not correct in the nonstationary case, and derived a new formula that agreed with previous results for the stationary case and held in the nonstationary case. In this correspondence it is shown that the rate-distortion formulas of Gray and Hashimoto and Arimoto are in fact consistent and that the example of of Hashimoto and Arimoto does not form a counter example to the methods or results of the earlier paper. Their results do provide an alternative, but equivalent, formula for the rate-distortion function in the nonstationary case and they provide a concrete example that the classic Kolmogorov formula differs from the autoregressive formula when the autoregressive source is not stationary. Some observations are offered on the different versions of the Toeplitz asymptotic eigenvalue distribution theorem used in the two papers to emphasize how a slight modification of the classic theorem avoids the problems with certain singularities.

Full work available at URL: https://arxiv.org/abs/cs/0702150

Recommendations

• On the rate-distortion function for the nonstationary Gaussian autoregressive process (Corresp.)
• Information rates of autoregressive processes
• Information rates of Wiener processes
• Fixed-rate encoding of nonstationary information sources
• A bound on the rate of a system for encoding an unknown Gaussian autoregressive source

Mathematics Subject Classification ID

Time series, auto-correlation, regression, etc. in statistics (GARCH) (62M10) Gaussian processes (60G15) Coding theorems (Shannon theory) (94A24) Source coding (94A29)

Cited In (9)

• Information rates of Wiener processes
• Stationary and ergodic properties of stochastic nonlinear systems controlled over communication channels
• Rate distortion function for \(N\)th-order Gaussian Markov process
• Correction to: ``Predictive rate-distortion for infinite-order Markov processes
• Nonlinear autoregression in the theory of signal compression
• Optimal estimation via nonanticipative rate distortion function and applications to time-varying Gauss-Markov processes
• Title not available (Why is that?)
• Rate-distortion functions of non-stationary Markoff chains and their block-independent approximations
• On the rate-distortion function for the nonstationary Gaussian autoregressive process (Corresp.)

This page was built for publication: A Note on Rate-Distortion Functions for Nonstationary Gaussian Autoregressive Processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3604568)