Information thermodynamics for interacting stochastic systems without bipartite structure

DOI10.1088/1742-5468/AB47FEzbMATH Open1456.92069arXiv1905.06216OpenAlexW2945568732MaRDI QIDQ5149683FDOQ5149683

Authors: R. Chetrite, M. L. Rosinberg, Takahiro Sagawa, G. Tarjus 

Publication date: 12 February 2021

Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Abstract: Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or information thermodynamics. This means that fluctuations in each subsystem are not independent: subsystems jump simultaneously if the dynamics is modeled as a Markov jump process, or noises are correlated for diffusion processes. In this paper, we consider information and thermodynamic exchanges between a pair of coupled systems that do not satisfy the bipartite property. The generalization of information-theoretic measures, such as learning rates and transfer entropy rates, to this situation is non-trivial and also involves introducing several additional rates. We describe how this can be achieved in the framework of general continuous-time Markov processes, without restricting the study to the steady-state regime. We illustrate our general formalism on the case of diffusion processes and derive an extension of the second law of information thermodynamics in which the difference of transfer entropy rates in the forward and backward time directions replaces the learning rate. As a side result, we also generalize an important relation linking information theory and estimation theory. To further obtain analytical expressions we treat in detail the case of Ornstein-Uhlenbeck processes, and discuss the ability of the various information measures to detect a directional coupling in the presence of correlated noises. Finally, we apply our formalism to the analysis of the directional influence between cellular processes in a concrete example, which also requires considering the case of a non-bipartite and non-Markovian process.

Full work available at URL: https://arxiv.org/abs/1905.06216

Recommendations

• Role of mutual information in entropy production under information exchanges
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation
• Mutual entropy production in bipartite systems
• Multipartite information flow for multiple Maxwell demons
• Fluctuation theorem of information exchange between subsystems that co-evolve in time

Mathematics Subject Classification ID

Systems biology, networks (92C42) Stochastic methods (Fokker-Planck, Langevin, etc.) applied to problems in time-dependent statistical mechanics (82C31)

Cites Work

• Elements of Information Theory
• Title not available (Why is that?)
• Title not available (Why is that?)
• Investigating Causal Relations by Econometric Models and Cross-spectral Methods
• The Fokker-Planck equation. Methods of solution and applications.
• Time reversal of diffusions
• Measurement of Linear Dependence and Feedback Between Multiple Time Series
• Title not available (Why is that?)
• Short Run and Long Run Causality in Time Series: Theory
• Markov Processes, Brownian Motion, and Time Symmetry
• Handbook of stochastic methods for physics, chemistry and the natural sciences.
• Title not available (Why is that?)
• Piecewise constant orthogonal functions and their application to systems and control
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation
• Mutual entropy production in bipartite systems
• Efficiency of cellular information processing
• Second-law-like inequalities with information and their interpretations
• The relation between Granger causality and directed information theory: a review
• Feedback systems: an introduction for scientists and engineers.
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Fluctuation relations for diffusion processes
• Title not available (Why is that?)
• On the spectral formulation of Granger causality
• Reverse-time diffusion equation models
• On the Calculation of Mutual Information
• Stochastic approaches for systems biology.
• Backwards Markovian models for second-order stochastic processes (Corresp.)
• An introduction to transfer entropy. Information flow in complex systems
• Rate of mutual information between coarse-grained non-Markovian variables
• Directed Information, Causal Estimation, and Communication in Continuous Time
• Universal form of stochastic evolution for slow variables in equilibrium systems
• Mutual information for stochastic differential equations
• Multipartite information flow for multiple Maxwell demons
• Validity of Time Reversal for Testing Granger Causality
• Relations between information and estimation in the presence of feedback

Cited In (8)

• Stochastic thermodynamics: experiment and theory
• Fluctuation theorem of information exchange between subsystems that co-evolve in time
• Role of mutual information in entropy production under information exchanges
• Probabilities for informational free lunches in stochastic thermodynamics
• Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation
• Efficiency of cellular information processing
• Title not available (Why is that?)
• Optimal work extraction and the minimum description length principle

This page was built for publication: Information thermodynamics for interacting stochastic systems without bipartite structure

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5149683)