Abstract: The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the {em Markov order}). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally "most random" distributions.
Recommendations
Cites work
- scientific article; zbMATH DE number 3152029 (Why is no real title available?)
- scientific article; zbMATH DE number 5504088 (Why is no real title available?)
- scientific article; zbMATH DE number 3911472 (Why is no real title available?)
- scientific article; zbMATH DE number 1194469 (Why is no real title available?)
- scientific article; zbMATH DE number 3772354 (Why is no real title available?)
- scientific article; zbMATH DE number 958376 (Why is no real title available?)
- scientific article; zbMATH DE number 2247573 (Why is no real title available?)
- A Mathematical Theory of Communication
- Axioms and uniqueness theorem for Tsallis entropy
- Engineering model reduction and entropy-based Lyapunov functions in chemical reaction kinetics
- From \(f\)-divergence to quantum quasi-entropies and their use
- Generalized moment based estimation and inference
- Gibbs vs Boltzmann Entropies
- Goodness-of-fit statistics for discrete multivariate data
- Information Theory and Statistical Mechanics
- Markov Processes and the H-Theorem
- Maximum entropy fundamentals
- Monotonically equivalent entropies and solution of additivity equation
- Nonlinear Aspects of Competition Between Three Species
- On Information and Sufficiency
- On contraction properties of Markov kernels
- On the (Boltzmann) entropy of non-equilibrium systems
- On the Lambert \(w\) function
- On the way towards a generalized entropy maximization procedure
- Possible generalization of Boltzmann-Gibbs statistics.
- Recursive density types and Nerode extensions of arithmetic
- Relative entropy under mappings by stochastic matrices
Cited in
(26)- scientific article; zbMATH DE number 569363 (Why is no real title available?)
- The entropy of Markov trajectories
- Engineering model reduction and entropy-based Lyapunov functions in chemical reaction kinetics
- Entropy of chemical processes versus numerical representability of orderings
- Generalizations of Crooks and Lin's results on Jeffreys-Csiszár and Jensen-Csiszár \(f\)-divergences
- Implications of the Cressie-Read family of additive divergences for information recovery
- On extracting probability distribution information from time series
- Universal Lyapunov functions for non-linear reaction networks
- A natural order in dynamical systems based on Conley-Markov matrices
- Generalized information and entanglement entropy, gravitation and holography
- Mathematical modeling of extinction of inhomogeneous populations
- Ranking nodes according to their path-complexity
- Entropy-inspired Lyapunov functions and linear first integrals for positive polynomial systems
- Modified entropies as the origin of generalized uncertainty principles
- The resource theory of informational nonequilibrium in thermodynamics
- \textit{Maxallent}: maximizers of all entropies and uncertainty of uncertainty
- Statistical estimation of the Shannon entropy
- Trend to equilibrium for a reaction-diffusion system modelling reversible enzyme reaction
- scientific article; zbMATH DE number 4138891 (Why is no real title available?)
- Entropy of high-order Markov chains beyond the pair correlations
- A hierarchy of maximum entropy closures for Galerkin systems of incompressible flows
- Editorial: Grasping complexity
- The Michaelis-Menten-Stueckelberg theorem
- Enhancement of the stability of lattice Boltzmann methods by dissipation control
- scientific article; zbMATH DE number 4161809 (Why is no real title available?)
- A second law for open Markov processes
This page was built for publication: Entropy: the Markov ordering approach
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657470)
