Abstract: The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the {em Markov order}). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally "most random" distributions.
Recommendations
Cites work
- A Mathematical Theory of Communication
- Axioms and uniqueness theorem for Tsallis entropy
- Engineering model reduction and entropy-based Lyapunov functions in chemical reaction kinetics
- From \(f\)-divergence to quantum quasi-entropies and their use
- Generalized moment based estimation and inference
- Gibbs vs Boltzmann Entropies
- Goodness-of-fit statistics for discrete multivariate data
- scientific article; zbMATH DE number 3152029 (Why is no real title available?)
- scientific article; zbMATH DE number 5504088 (Why is no real title available?)
- scientific article; zbMATH DE number 3911472 (Why is no real title available?)
- scientific article; zbMATH DE number 1194469 (Why is no real title available?)
- scientific article; zbMATH DE number 3772354 (Why is no real title available?)
- scientific article; zbMATH DE number 958376 (Why is no real title available?)
- scientific article; zbMATH DE number 2247573 (Why is no real title available?)
- Information Theory and Statistical Mechanics
- Markov Processes and the H-Theorem
- Maximum entropy fundamentals
- Monotonically equivalent entropies and solution of additivity equation
- Nonlinear Aspects of Competition Between Three Species
- On contraction properties of Markov kernels
- On Information and Sufficiency
- On the (Boltzmann) entropy of non-equilibrium systems
- On the Lambert \(w\) function
- On the way towards a generalized entropy maximization procedure
- Possible generalization of Boltzmann-Gibbs statistics.
- Recursive density types and Nerode extensions of arithmetic
- Relative entropy under mappings by stochastic matrices
Cited in
(27)- Generalizations of Crooks and Lin's results on Jeffreys-Csiszár and Jensen-Csiszár \(f\)-divergences
- Trend to equilibrium for a reaction-diffusion system modelling reversible enzyme reaction
- Statistical estimation of the Shannon entropy
- Enhancement of the stability of lattice Boltzmann methods by dissipation control
- Entropy of high-order Markov chains beyond the pair correlations
- Universal Lyapunov functions for non-linear reaction networks
- Editorial: Grasping complexity
- \textit{Maxallent}: maximizers of all entropies and uncertainty of uncertainty
- A hierarchy of maximum entropy closures for Galerkin systems of incompressible flows
- Modified entropies as the origin of generalized uncertainty principles
- A second law for open Markov processes
- Entropy of chemical processes versus numerical representability of orderings
- Generalized information and entanglement entropy, gravitation and holography
- Mathematical modeling of extinction of inhomogeneous populations
- Entropy-inspired Lyapunov functions and linear first integrals for positive polynomial systems
- scientific article; zbMATH DE number 4138891 (Why is no real title available?)
- scientific article; zbMATH DE number 4161809 (Why is no real title available?)
- The entropy production for superior order Markov chains
- The Michaelis-Menten-Stueckelberg theorem
- On extracting probability distribution information from time series
- Implications of the Cressie-Read family of additive divergences for information recovery
- scientific article; zbMATH DE number 569363 (Why is no real title available?)
- The entropy of Markov trajectories
- The resource theory of informational nonequilibrium in thermodynamics
- Engineering model reduction and entropy-based Lyapunov functions in chemical reaction kinetics
- A natural order in dynamical systems based on Conley-Markov matrices
- Ranking nodes according to their path-complexity
This page was built for publication: Entropy: the Markov ordering approach
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657470)
