The Capacity of Channels With Feedback

DOI10.1109/TIT.2008.2008147MaRDI QIDQ4975699zbMATH OpenOpenAlexFDO

Authors Sekhar Tatikonda, Sanjoy K. Mitter

Publication date 8 August 2017

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/cs/0609139

Mathematics Subject Classification ID

Coding theorems (Shannon theory) (94A24) Channel models (including quantum) in information and communication theory (94A40)

Abstract: We introduce a general framework for treating channels with memory and feedback. First, we generalize Massey's concept of directed information and use it to characterize the feedback capacity of general channels. Second, we present coding results for Markov channels. This requires determining appropriate sufficient statistics at the encoder and decoder. Third, a dynamic programming framework for computing the capacity of Markov channels is presented. Fourth, it is shown that the average cost optimality equation (ACOE) can be viewed as an implicit single-letter characterization of the capacity. Fifth, scenarios with simple sufficient statistics are described.

Cited in

(21)

• Stationary and ergodic properties of stochastic nonlinear systems controlled over communication channels
• Some Aspects of Information Theory in Gambling and Economics
• On the Feedback Capacity of the Fully Connected K-User Interference Channel
• scientific article; zbMATH DE number 5880527 (Why is no real title available?)
• On multiple access channels with feedback (Corresp.)
• The feedback capacity region of a class of discrete memoryless multiple access channels (Corresp.)
• Quantification of effective connectivity in the brain using a measure of directed information
• On Shannon's duality of a source and a channel and nonanticipative communication and communication for control
• Nonanticipative Duality of Sources and Channels with Memory and Feedback
• Capacity-equivocation regions of the DMBCs with noiseless feedback
• Delay-constrained capacity with causal feedback
• Feedback does not increase the capacity of discrete channels with additive noise
• Feedback Capacity of the Compound Channel
• On directed information theory and Granger causality graphs
• Estimating the directed information to infer causal relationships in ensemble neural spike train recordings
• Ergodic control-coding capacity of stochastic control systems: information signalling and hierarchical optimality of Gaussian systems
• Design of Information Channels for Optimization and Stabilization in Networked Control
• An introductory review of information theory in the context of computational neuroscience
• Signalling and control of nonlinear partially observable stochastic systems: information states, sufficient statistics, and applications
• Statistical complexity and optimal algorithms for nonlinear ridge bandits
• The relation between Granger causality and directed information theory: a review

This page was built for publication: The Capacity of Channels With Feedback

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4975699)