Ergodicity conditions for two-dimensional Markov chains on the positive quadrant (Q1113205)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Ergodicity conditions for two-dimensional Markov chains on the positive quadrant
scientific article

    Statements

    Ergodicity conditions for two-dimensional Markov chains on the positive quadrant (English)
    0 references
    0 references
    1989
    0 references
    The basic problem considered in this paper is that of determining conditions for recurrence and transience for two-dimensional irreducible Markov chains whose state space is \(Z^ 2_+=Z_+\times Z_+\). Assuming bounded jumps and a homogeneity condition \textit{V. A. Malyshev} [Sov. Math., Dok. 13, No.1, 136-139 (1972); translation from Dokl. Akad. Nauk SSSR 202, 526-528 (1972; Zbl 0246.60055)] obtained necessary and sufficient conditions for recurrence and transience of two-dimensional random walks on the positive quadrant. Unfortunately, his hypothesis that the jumps of the Markov chain be bounded rules out, for example, the Poisson arrival process. In this paper we generalize Malyshev's theorem by means of a method that makes novel use of the solution to Laplace's equation in the first quadrant satisfying an oblique derivative condition on the boundaries. This method, which allows one to replace the very restrictive boundedness condition by a moment condition and a lower boundedness condition, is of independent interest.
    0 references
    0 references
    conditions for recurrence and transience
    0 references
    two-dimensional random walks on the positive quadrant
    0 references
    boundedness condition
    0 references
    moment condition
    0 references