On transformations of Markov chains and Poisson boundary

DOI10.1090/TRAN/7975zbMATH Open1439.31009arXiv1909.11217OpenAlexW2986662778WikidataQ126799491 ScholiaQ126799491MaRDI QIDQ5217898FDOQ5217898

Authors: Iddo Ben-Ari, Behrang Forghani 

Publication date: 26 February 2020

Published in: Transactions of the American Mathematical Society (Search for Journal in Brave)

Abstract: A discrete-time Markov chain can be transformed into a new Markov chain by looking at its states along iterations of an almost surely finite stopping time. By the optional stopping theorem, any bounded harmonic function with respect to the transition function of the original chain is harmonic with respect to the transition function of the transformed chain. The reverse inclusion is in general not true. Our main result provides a sufficient condition on the stopping time which guarantees that the space of bounded harmonic functions for the transformed chain embeds in the space of bounded harmonic sequences for the original chain. We also obtain a similar result on positive unbounded harmonic functions, under some additional conditions. Our work was motivated by and is analogous to Forghani-Kaimanovich, the well-studied case when the Markov chain is a random walk on a discrete group.

Full work available at URL: https://arxiv.org/abs/1909.11217

Recommendations

• On the space of Markov chain's finite projections
• On transience conditions for Markov chains
• Boundary and entropy of space homogeneous Markov chains
• The Poisson boundary for homogeneous random walks
• Harmonic functions and ends of graphs

zbMATH Keywords

Markov chainsharmonic functionsPoisson boundarystopping timesMartin boundary

Mathematics Subject Classification ID

Harmonic, subharmonic, superharmonic functions on other spaces (31C05) Boundary theory for Markov processes (60J50) Martin boundary theory (31C35)

Cites Work

• Title not available (Why is that?)
• BOUNDARY THEORY OF MARKOV PROCESSES (THE DISCRETE CASE)
• The Poisson formula for groups with hyperbolic properties
• A Poisson formula for semi-simple Lie groups
• Boundaries Induced by Non-negative Matrices
• Title not available (Why is that?)
• Denumerable Markov chains. Generating functions, boundary theory, random walks on trees.
• On Transient Markov Processes with a Countable Number of States and Stationary Transition Probabilities
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Asymptotic entropy of transformed random walks
• Boundary and entropy of space homogeneous Markov chains
• Title not available (Why is that?)
• The Martin Boundary for Random Walk
• Probability measures on groups and some related ideals in group algebras
• A note on stationarity of spherical measures
• Title not available (Why is that?)
• Positive harmonic functions of transformed random walks

Cited In (4)

• Positive harmonic functions of transformed random walks
• Trajectory composition of Poisson time changes and Markov counting systems
• Anticipative Markovian transformations on the Poisson space.
• On the space of Markov chain's finite projections

This page was built for publication: On transformations of Markov chains and Poisson boundary

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5217898)