Entropy evolution and uncertainty estimation with dynamical systems
Summary: This paper presents a comprehensive introduction and systematic derivation of the evolutionary equations for absolute entropy \(H\) and relative entropy \(D\), some of which exist sporadically in the literature in different forms under different subjects, within the framework of dynamical systems. In general, both \(H\) and \(D\) are dissipated, and the dissipation bears a form reminiscent of the Fisher information; in the absence of stochasticity, \(dH/dt\) is connected to the rate of phase space expansion, and \(D\) stays invariant, i.e., the separation of two probability density functions is always conserved. These formulas are validated with linear systems, and put to application with the Lorenz system and a large-dimensional stochastic quasi-geostrophic flow problem. In the Lorenz case, \(H\) falls at a constant rate with time, implying that \(H\) will eventually become negative, a situation beyond the capability of the commonly used computational technique like coarse-graining and bin counting. For the stochastic flow problem, it is first reduced to a computationally tractable low-dimensional system, using a reduced model approach, and then handled through ensemble prediction. Both the Lorenz system and the stochastic flow system are examples of self-organization in the light of uncertainty reduction. The latter particularly shows that, sometimes stochasticity may actually enhance the self-organization process.
- On Information/Entropy Flow in Stochastic Dynamical Systems
- Evolution of the entropy and Renyi difference information during self-organization of open additive systems
- Physical entropy, information entropy and their evolution equations
- Dynamics of informational entropy associated with self-organisation process in open system
- scientific article; zbMATH DE number 4168381
- A mathematical framework for stochastic climate models
- A Mathematical Theory of Communication
- A rigorous formalism of information transfer between dynamical system components. I. Discrete mapping
- Entropy and entropy production: old misconceptions and new breakthroughs
- Entropy production and thermodynamics of nonequilibrium stationary states: A point of view
- Fact-checking Ziegler's maximum entropy production principle beyond the linear regime and towards steady states
- Free energy, value, and attractors
- HOW SHOULD ONE DEFINE ENTROPY PRODUCTION FOR NONEQUILIBRIUM QUANTUM SPIN SYSTEMS?
- scientific article; zbMATH DE number 1865707 (Why is no real title available?)
- Information Theory and Statistical Mechanics
- Local predictability and information flow in complex dynamical systems
- On entropy production for controlled Markovian evolution
- On the (Boltzmann) entropy of non-equilibrium systems
- On the definition of entropy production, via examples
- Predictability, uncertainty, and hyperbolicity in the ocean
- STOCHASTIC DYNAMICS OF A COUPLED ATMOSPHERE–OCEAN MODEL
- Uncertainty estimation and prediction for interdisciplinary ocean dynamics
- Time-restricted sensitivity and entropy for random dynamical systems
- scientific article; zbMATH DE number 14590 (Why is no real title available?)
- Evolution of uncertainty about the state of a dynamical system
- Causation and information flow with respect to relative entropy
- Implication of entropy flow for the development of a system as suggested by the life cycle of a hurricane
- A novel R/S fractal analysis and wavelet entropy characterization approach for robust forecasting based on self-similar time series modeling
- A general theory to estimate information transfer in nonlinear systems
- A generalized transformed path integral approach for stochastic processes
- Boltzmann-Gibbs disentropy of f-invariant measures
- On the spectral entropy behavior of self-organizing processes
This page was built for publication: Entropy evolution and uncertainty estimation with dynamical systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q296287)
