Abstract: The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the {em Markov order}). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally "most random" distributions.
Recommendations
Cites work
- scientific article; zbMATH DE number 3152029 (Why is no real title available?)
- scientific article; zbMATH DE number 5504088 (Why is no real title available?)
- scientific article; zbMATH DE number 3911472 (Why is no real title available?)
- scientific article; zbMATH DE number 1194469 (Why is no real title available?)
- scientific article; zbMATH DE number 3772354 (Why is no real title available?)
- scientific article; zbMATH DE number 958376 (Why is no real title available?)
- scientific article; zbMATH DE number 2247573 (Why is no real title available?)
- A Mathematical Theory of Communication
- Axioms and uniqueness theorem for Tsallis entropy
- Engineering model reduction and entropy-based Lyapunov functions in chemical reaction kinetics
- From \(f\)-divergence to quantum quasi-entropies and their use
- Generalized moment based estimation and inference
- Gibbs vs Boltzmann Entropies
- Goodness-of-fit statistics for discrete multivariate data
- Information Theory and Statistical Mechanics
- Markov Processes and the H-Theorem
- Maximum entropy fundamentals
- Monotonically equivalent entropies and solution of additivity equation
- Nonlinear Aspects of Competition Between Three Species
- On Information and Sufficiency
- On contraction properties of Markov kernels
- On the (Boltzmann) entropy of non-equilibrium systems
- On the Lambert \(w\) function
- On the way towards a generalized entropy maximization procedure
- Possible generalization of Boltzmann-Gibbs statistics.
- Recursive density types and Nerode extensions of arithmetic
- Relative entropy under mappings by stochastic matrices
Cited in
(26)- scientific article; zbMATH DE number 569363 (Why is no real title available?)
- The Michaelis-Menten-Stueckelberg theorem
- Engineering model reduction and entropy-based Lyapunov functions in chemical reaction kinetics
- Implications of the Cressie-Read family of additive divergences for information recovery
- On extracting probability distribution information from time series
- Statistical estimation of the Shannon entropy
- Generalizations of Crooks and Lin's results on Jeffreys-Csiszár and Jensen-Csiszár \(f\)-divergences
- Entropy of chemical processes versus numerical representability of orderings
- Enhancement of the stability of lattice Boltzmann methods by dissipation control
- A hierarchy of maximum entropy closures for Galerkin systems of incompressible flows
- Editorial: Grasping complexity
- Mathematical modeling of extinction of inhomogeneous populations
- Ranking nodes according to their path-complexity
- The entropy of Markov trajectories
- Entropy of high-order Markov chains beyond the pair correlations
- A second law for open Markov processes
- scientific article; zbMATH DE number 4138891 (Why is no real title available?)
- scientific article; zbMATH DE number 4161809 (Why is no real title available?)
- Trend to equilibrium for a reaction-diffusion system modelling reversible enzyme reaction
- Generalized information and entanglement entropy, gravitation and holography
- Entropy-inspired Lyapunov functions and linear first integrals for positive polynomial systems
- Modified entropies as the origin of generalized uncertainty principles
- \textit{Maxallent}: maximizers of all entropies and uncertainty of uncertainty
- A natural order in dynamical systems based on Conley-Markov matrices
- The resource theory of informational nonequilibrium in thermodynamics
- Universal Lyapunov functions for non-linear reaction networks
This page was built for publication: Entropy: the Markov ordering approach
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657470)
