Information thermodynamics for interacting stochastic systems without bipartite structure
From MaRDI portal
Publication:5149683
Abstract: Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or information thermodynamics. This means that fluctuations in each subsystem are not independent: subsystems jump simultaneously if the dynamics is modeled as a Markov jump process, or noises are correlated for diffusion processes. In this paper, we consider information and thermodynamic exchanges between a pair of coupled systems that do not satisfy the bipartite property. The generalization of information-theoretic measures, such as learning rates and transfer entropy rates, to this situation is non-trivial and also involves introducing several additional rates. We describe how this can be achieved in the framework of general continuous-time Markov processes, without restricting the study to the steady-state regime. We illustrate our general formalism on the case of diffusion processes and derive an extension of the second law of information thermodynamics in which the difference of transfer entropy rates in the forward and backward time directions replaces the learning rate. As a side result, we also generalize an important relation linking information theory and estimation theory. To further obtain analytical expressions we treat in detail the case of Ornstein-Uhlenbeck processes, and discuss the ability of the various information measures to detect a directional coupling in the presence of correlated noises. Finally, we apply our formalism to the analysis of the directional influence between cellular processes in a concrete example, which also requires considering the case of a non-bipartite and non-Markovian process.
Recommendations
- Role of mutual information in entropy production under information exchanges
- Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation
- Mutual entropy production in bipartite systems
- Multipartite information flow for multiple Maxwell demons
- Fluctuation theorem of information exchange between subsystems that co-evolve in time
Cites work
- scientific article; zbMATH DE number 5719294 (Why is no real title available?)
- scientific article; zbMATH DE number 52614 (Why is no real title available?)
- scientific article; zbMATH DE number 1515832 (Why is no real title available?)
- scientific article; zbMATH DE number 1546925 (Why is no real title available?)
- scientific article; zbMATH DE number 3796268 (Why is no real title available?)
- scientific article; zbMATH DE number 2199188 (Why is no real title available?)
- scientific article; zbMATH DE number 2237386 (Why is no real title available?)
- scientific article; zbMATH DE number 3054885 (Why is no real title available?)
- An introduction to transfer entropy. Information flow in complex systems
- Backwards Markovian models for second-order stochastic processes (Corresp.)
- Directed Information, Causal Estimation, and Communication in Continuous Time
- Efficiency of cellular information processing
- Elements of Information Theory
- Feedback systems: an introduction for scientists and engineers.
- Fluctuation relations for diffusion processes
- Handbook of stochastic methods for physics, chemistry and the natural sciences.
- Investigating Causal Relations by Econometric Models and Cross-spectral Methods
- Markov Processes, Brownian Motion, and Time Symmetry
- Measurement of Linear Dependence and Feedback Between Multiple Time Series
- Multipartite information flow for multiple Maxwell demons
- Mutual entropy production in bipartite systems
- Mutual information for stochastic differential equations
- On the Calculation of Mutual Information
- On the spectral formulation of Granger causality
- Piecewise constant orthogonal functions and their application to systems and control
- Rate of mutual information between coarse-grained non-Markovian variables
- Relations between information and estimation in the presence of feedback
- Reverse-time diffusion equation models
- Second-law-like inequalities with information and their interpretations
- Short Run and Long Run Causality in Time Series: Theory
- Stochastic approaches for systems biology.
- Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation
- The Fokker-Planck equation. Methods of solution and applications.
- The relation between Granger causality and directed information theory: a review
- Time reversal of diffusions
- Universal form of stochastic evolution for slow variables in equilibrium systems
- Validity of Time Reversal for Testing Granger Causality
Cited in
(8)- scientific article; zbMATH DE number 4008268 (Why is no real title available?)
- Optimal work extraction and the minimum description length principle
- Stochastic thermodynamics: experiment and theory
- Fluctuation theorem of information exchange between subsystems that co-evolve in time
- Role of mutual information in entropy production under information exchanges
- Probabilities for informational free lunches in stochastic thermodynamics
- Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation
- Efficiency of cellular information processing
This page was built for publication: Information thermodynamics for interacting stochastic systems without bipartite structure
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5149683)