Potentials for denumerable Markov chains

DOI10.1016/0022-247X(61)90054-3MaRDI QIDQ5896038zbMATH OpenWikidataFDO

Authors John G. Kemeny, J. Laurie Snell

Publication date 1961

Published in Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/0022-247X(61)90054-3

zbMATH Keywords

probability theory

Cites work

• Finite Continuous Time Markov Chains
• scientific article; zbMATH DE number 3164979 (Why is no real title available?)
• scientific article; zbMATH DE number 3223982 (Why is no real title available?)
• scientific article; zbMATH DE number 3195751 (Why is no real title available?)
• scientific article; zbMATH DE number 3085434 (Why is no real title available?)
• Markoff processes and potentials. I, II, III
• Modèles finis en théorie du potentiel

Cited in

(25)

• Variational characterizations in Markov decision processes
• On the Green functions of 1-dimensional diffusion processes
• Foolproof convergence in multichain policy iteration
• Kac's moment formula and the Feynman-Kac formula for additive functionals of a Markov process
• Reward algorithms for semi-Markov processes
• Recurrence relations for generalized hitting times for semi-Markov processes
• Laplace and bi-Laplace equations for directed networks and Markov chains
• Limit theorems involing capacities for recurrent Markov chains
• Leveraging environmental correlations: the thermodynamics of requisite variety
• Potential kernels for recurrent Markov chains
• La théorie du potentiel et les processus recurrents
• Potentials associated with recurrent Markov renewal processes
• Über die diskrete Potentialtheorie
• Slowly spreading chains of the first kind
• A further note on discrete potential theory
• On homogeneous and oscillating random walks on the integers
• Emptiness Under Isolation and the Value Problem for Hierarchical Probabilistic Automata
• Probabilistic Büchi automata with non-extremal acceptance thresholds
• Continuous time markov decision processes with interventions
• A global Riesz decomposition theorem on trees without positive potentials
• Potential theory and non-Markovian chains
• Representation Theory for Denumerable Markov Chains
• Boundary Theory for Recurrent Markov Chains
• Power of Randomization in Automata on Infinite Strings
• Extinction times and size of the surviving species in a two-species competition process

This page was built for publication: Potentials for denumerable Markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5896038)