Ergodicity conditions for two-dimensional Markov chains on the positive quadrant (Q1113205)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Ergodicity conditions for two-dimensional Markov chains on the positive quadrant |
scientific article |
Statements
Ergodicity conditions for two-dimensional Markov chains on the positive quadrant (English)
0 references
1989
0 references
The basic problem considered in this paper is that of determining conditions for recurrence and transience for two-dimensional irreducible Markov chains whose state space is \(Z^ 2_+=Z_+\times Z_+\). Assuming bounded jumps and a homogeneity condition \textit{V. A. Malyshev} [Sov. Math., Dok. 13, No.1, 136-139 (1972); translation from Dokl. Akad. Nauk SSSR 202, 526-528 (1972; Zbl 0246.60055)] obtained necessary and sufficient conditions for recurrence and transience of two-dimensional random walks on the positive quadrant. Unfortunately, his hypothesis that the jumps of the Markov chain be bounded rules out, for example, the Poisson arrival process. In this paper we generalize Malyshev's theorem by means of a method that makes novel use of the solution to Laplace's equation in the first quadrant satisfying an oblique derivative condition on the boundaries. This method, which allows one to replace the very restrictive boundedness condition by a moment condition and a lower boundedness condition, is of independent interest.
0 references
conditions for recurrence and transience
0 references
two-dimensional random walks on the positive quadrant
0 references
boundedness condition
0 references
moment condition
0 references
0 references