Transfer entropy for coupled autoregressive processes
Summary: A method is shown for computing transfer entropy over multiple time lags for coupled autoregressive processes using formulas for the differential entropy of multivariate Gaussian processes. Two examples are provided: (1) a first-order filtered noise process whose state is measured with additive noise, and (2) two first-order coupled processes each of which is driven by white process noise. We found that, for the first example, increasing the first-order AR coefficient while keeping the correlation coefficient between filtered and measured process fixed, transfer entropy increased since the entropy of the measured process was itself increased. For the second example, the minimum correlation coefficient occurs when the process noise variances match. It was seen that matching of these variances results in minimum information flow, expressed as the sum of transfer entropies in both directions. Without a match, the transfer entropy is larger in the direction away from the process having the larger process noise. Fixing the process noise variances, transfer entropies in both directions increase with the coupling strength. Finally, we note that the method can be generally employed to compute other information theoretic quantities as well.
- Information transfer in continuous processes
- Linearized transfer entropy for continuous second order systems
- Symbolic transfer entropy rate is equal to transfer entropy rate for bivariate finite-alphabet stationary ergodic Markov processes
- Computing algebraic transfer entropy and coupling directions via transcripts
- Detection of directionality of information transfer in nonlinear dynamical systems
- Information transfer in continuous processes
- Transfer entropy coefficient: quantifying level of information flow between financial time series
- Nonlinear transformation on the transfer entropy of financial time series
- Characterization of autoregressive processes using entropic quantifiers
- Linearized transfer entropy for continuous second order systems
- Transfer entropy expressions for a class of non-Gaussian distributions
- Computing algebraic transfer entropy and coupling directions via transcripts
- The extended Granger causality analysis for Hodgkin-Huxley neuronal models
- Deriving pairwise transfer entropy from network structure and motifs
- An information-theoretic approach to study spatial dependencies in small datasets
- A general theory to estimate information transfer in nonlinear systems
This page was built for publication: Transfer entropy for coupled autoregressive processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q742673)
