Asymptotic behaviour of stationary distributions for countable Markov chains, with some applications (Q1301754)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Asymptotic behaviour of stationary distributions for countable Markov chains, with some applications |
scientific article |
Statements
Asymptotic behaviour of stationary distributions for countable Markov chains, with some applications (English)
0 references
12 September 1999
0 references
Let \(\{Z_n\), \(n\geq 0\}\) be an aperiodic irreducible recurrent (not necessarily positive recurrent) Markov chain taking values on a countable unbounded subset \(S\) of \(\mathbb{R}^d\), \(\pi(\cdot)\) its invariant measure and \(f\) be a nonnegative function defined on \(S\). The authors find sufficient conditions under which \(\int_S f(z) \pi(dz)= \infty\), and obtain lower and upper bounds for the values of the invariant measure \(\pi\) on the subsets \(B\) of \(S\). These bounds are expressed in terms of first passage probabilities and the first exit time from \(B\).
0 references
occupation time
0 references
recurrent Markov chain
0 references
reflected random walk
0 references
stationary measure
0 references
submartingale
0 references
supermartingale
0 references