Directed Information, Causal Estimation, and Communication in Continuous Time
From MaRDI portal
Publication:2989342
DOI10.1109/TIT.2012.2227677zbMATH Open1364.94474arXiv1109.0351MaRDI QIDQ2989342FDOQ2989342
Tsachy Weissman, Younghan Kim, Haim Permuter
Publication date: 8 June 2017
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Abstract: A notion of directed information between two continuous-time processes is proposed. A key component in the definition is taking an infimum over all possible partitions of the time interval, which plays a role no less significant than the supremum over "space" partitions inherent in the definition of mutual information. Properties and operational interpretations in estimation and communication are then established for the proposed notion of directed information. For the continuous-time additive white Gaussian noise channel, it is shown that Duncan's classical relationship between causal estimation and information continues to hold in the presence of feedback upon replacing mutual information by directed information. A parallel result is established for the Poisson channel. The utility of this relationship is then demonstrated in computing the directed information rate between the input and output processes of a continuous-time Poisson channel with feedback, where the channel input process is constrained to be constant between events at the channel output. Finally, the capacity of a wide class of continuous-time channels with feedback is established via directed information, characterizing the fundamental limit on reliable communication.
Full work available at URL: https://arxiv.org/abs/1109.0351
Cited In (6)
- Information Structures, Causality, and Nonsequential Stochastic Control. II: Design-Dependent Properties
- Information-Theoretic Causal Power
- Relations Between Information and Estimation in the Presence of Feedback
- Information thermodynamics for interacting stochastic systems without bipartite structure
- Estimating the Directed Information and Testing for Causality
- Information exchange in causally non-separable processes
This page was built for publication: Directed Information, Causal Estimation, and Communication in Continuous Time
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2989342)
