Finite non-homogeneous Markov chains: Asymptotic behaviour

DOI10.2307/1426141MaRDI QIDQ4147366zbMATH OpenOpenAlexFDO

Authors Harry Cohn

Publication date 1976

Published in Advances in Applied Probability (Search for Journal in Brave)

Full work available at URL https://doi.org/10.2307/1426141

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Sums of independent random variables; random walks (60G50)

Cited in

(6)

• On an extremal property of Markov chains and sufficiency of Markov strategies in Markov decision processes with the Dubins-Savage criterion
• On a class of non-homogeneous Markov chains
• Convergence of nonhomogeneous stochastic chains with countable states
• Non-homogeneous Markov chains: Tail idempotents, tail sigma-fields and basis
• The Dynamic Behaviour of Non-Homogeneous Single-Unireducible Markov and Semi-Markov Chains
• Modeling Markovian biological systems via optimization operators

This page was built for publication: Finite non-homogeneous Markov chains: Asymptotic behaviour

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4147366)