On the ergodic decomposition for a class of Markov chains (Q2485833)

From MaRDI portal
scientific article
Language Label Description Also known as
English
On the ergodic decomposition for a class of Markov chains
scientific article

    Statements

    On the ergodic decomposition for a class of Markov chains (English)
    0 references
    0 references
    0 references
    5 August 2005
    0 references
    This paper focuses on the question of the ergodic decomposition of Markov chains and the existence of invariant probability measures for Markov chains. For discrete-time Markov chains, there are known sufficient conditions, based on a Foster-Lyapunov type criterion, for a given Markov chain on a general state space to have an invariant probability measure (S. Meyn and R. Tweedie; 1993). Continuing their previous work (2000), the authors propose an answer to the question of necessary conditions holding for the above mentioned problem. There are explored further properties of the so-called T\('\)-condition that represents an abstract generalization of T-chains and irreducible chains (since T-chains and irreducible chains satisfy T\('\)-condition but the reverse may not be true). Under no separability assumption on the \(\sigma\)-field (of the Markov chain defined on a measurable space), the paper proves that the T\('\)-condition is sufficient for the requirement that there are no uncountable disjoint absorbing sets and, under some hypothesis, T\('\)-condition is also necessary. For the case when \(\sigma\)-field is countably generated and separated, the T\('\)-condition is equivalent to the existence of a T-continuous component (everywhere non-trivial) for the considered Markov chain. Furthermore, under the assumption that the space is a compact separable metric one, it is shown that the Foster-Lyapunov criterion represents a necessary and sufficient condition for the existence of an invariant probability measure for the Markov chain, and that every probability measure for the Markov chain is non-singular, in this case.
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    invariant probability measures
    0 references
    countable ergodic decomposition
    0 references
    Foster-Lyapunov criterion
    0 references
    T-chains
    0 references
    T\('\)-condition
    0 references
    separability assumption
    0 references
    0 references