Dynamic statistical information theory

DOI10.1007/S11433-005-0102-ZMaRDI QIDQ2507433zbMATH OpenOpenAlexFDO

Authors Xiusan Xing

Publication date 11 October 2006

Published in Science in China. Series G (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/cond-mat/0505009

zbMATH Keywords

dynamic channel capacitydynamic mutual informationentropy production rateevolution equation of Boltzmann information (entropy)evolution equation of shannon information (entropy)information (entropy) diffusioninformation (entropy) flowinformation dissipation rate

Mathematics Subject Classification ID

Reaction-diffusion equations (35K57) General theory of infinite-dimensional dissipative dynamical systems, nonlinear semigroups, evolution equations (37L05) Diffusion processes (60J60) Brownian motion (60J65) Statistical aspects of information-theoretic topics (62B10) Information theory (general) (94A15) Channel models (including quantum) in information and communication theory (94A40)

Abstract: We extend present Shannon's static statistical information theory to dynamic processes and establish a dynamic statistical information theory. We derive the nonlinear evolution equations of dynamic information density and dynamic information entropy density. We present the expressions of drift information flow and diffusion information flow, the formulas of information entropy production rate and information dissipation rate. The information dissipation rate is equal to the information entropy production rate in a same dynamic system. Information diffusion and information dissipation occur at the same time. We obtain the dynamic mutual information and dynamic channel capacity reflecting the dynamic dissipation character in the transmission process. These derivations and results are unified and rigorous from evolution equations of dynamic information and dynamic information entropy without adding any extra assumption. Two actual dynamic topics are discussed.

Recommendations

• scientific article; zbMATH DE number 2145733
• Nonequilibrium statistical information theory
• Physical entropy, information entropy and their evolution equations
• On Information/Entropy Flow in Stochastic Dynamical Systems
• Shannon versus Kullback-Leibler entropies in nonequilibrium random motion

Cites work

• scientific article; zbMATH DE number 51968 (Why is no real title available?)
• scientific article; zbMATH DE number 107482 (Why is no real title available?)
• scientific article; zbMATH DE number 176034 (Why is no real title available?)
• scientific article; zbMATH DE number 4184623 (Why is no real title available?)
• Information and impossibilities
• Information and self organization. A macroscopic approach to complex systems
• Information dynamics and open systems. Classical and quantum approach
• New progress in the principle of nonequilibrium statistical physics
• Nonequilibrium statistical information theory
• On basic equation of statistical physics
• On the fundamental equation of nonequilibrium statistical physics.
• Physical entropy, information entropy and their evolution equations
• Principle of information diffusion

Cited in

(13)

• Physical entropy, information entropy and their evolution equations
• Dynamical sources in information theory: Fundamental intervals and word prefixes
• Dynamic information acquisition and time-varying uncertainty
• scientific article; zbMATH DE number 5899438 (Why is no real title available?)
• Nonequilibrium statistical information theory
• scientific article; zbMATH DE number 3867219 (Why is no real title available?)
• scientific article; zbMATH DE number 1984015 (Why is no real title available?)
• scientific article; zbMATH DE number 1544062 (Why is no real title available?)
• scientific article; zbMATH DE number 2145733 (Why is no real title available?)
• scientific article; zbMATH DE number 762962 (Why is no real title available?)
• Information rates of autoregressive processes
• scientific article; zbMATH DE number 3185241 (Why is no real title available?)
• Time evolution of entropy, in various scenarios

This page was built for publication: Dynamic statistical information theory

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2507433)