Estimating the Directed Information and Testing for Causality

DOI10.1109/TIT.2016.2604842MaRDI QIDQ2976483zbMATH OpenFDO

Authors Ioannis Kontoyiannis, Maria Skoularidou

Publication date 28 April 2017

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1507.01234

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Abstract: The problem of estimating the directed information rate between two discrete processes $X_n$ and $Y_n$ via the plug-in (or maximum-likelihood) estimator is considered. When the joint process $(X_n,Y_n)$ is a Markov chain of a given memory length, the plug-in estimator is shown to be asymptotically Gaussian and to converge at the optimal rate $O(1/sqrtn)$ under appropriate conditions; this is the first estimator that has been shown to achieve this rate. An important connection is drawn between the problem of estimating the directed information rate and that of performing a hypothesis test for the presence of causal influence between the two processes. Under fairly general conditions, the null hypothesis, which corresponds to the absence of causal influence, is equivalent to the requirement that the directed information rate be equal to zero. In that case a finer result is established, showing that the plug-in converges at the faster rate $O(1/n)$ and that it is asymptotically $ch{i}^2$-distributed. This is proved by showing that this estimator is equal to (a scalar multiple of) the classical likelihood ratio statistic for the above hypothesis test. Finally it is noted that these results facilitate the design of an actual likelihood ratio test for the presence or absence of causal influence.

Recommendations

• Directed Information, Causal Estimation, and Communication in Continuous Time
• On directed information theory and Granger causality graphs
• Information-geometric approach to inferring causal directions
• The relation between Granger causality and directed information theory: a review
• Universal Estimation of Directed Information
• Information-Theoretic Causal Power
• AI 2005: Advances in Artificial Intelligence
• Estimating the directed information to infer causal relationships in ensemble neural spike train recordings
• Causality in Time Series: Its Detection and Quantification by Means of Information Theory
• INFORMATION FLOWS IN CAUSAL NETWORKS

Cited in

(5)

• Information-Theoretic Causal Power
• Granger causality from quantized measurements
• A statistical test of market efficiency based on information theory
• scientific article; zbMATH DE number 6954656 (Why is no real title available?)
• Identification of directed influence: Granger causality, Kullback-Leibler divergence, and complexity

This page was built for publication: Estimating the Directed Information and Testing for Causality

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2976483)