Covering problems for Markov chains (Q749044)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Covering problems for Markov chains |
scientific article |
Statements
Covering problems for Markov chains (English)
0 references
1988
0 references
The problem considered in this article is similar to the coupon collector's problem as considered by \textit{W. Feller} [An introduction to probability theory and its applications, Vol. I, third ed. (1968; Zbl 0155.231)]. Consider an N-state Markov chain. How long until the Markov chain has covered its state space, i.e., how long until all states are visited? How many states have not been visited after N(log N\(+C)\) steps? \textit{D. J. Aldous} [Z. Wahrscheinlichkeitstheor. Verw. Geb. 62, 375-394 (1983; Zbl 0503.60046)] first considered this type of problem, and in a previous paper, the author [Ann. Probab. 16, No.1, 189-199 (1988; Zbl 0638.60014)] gave bounds applicable to mean covering times for finite Markov chains. In this article an extension to bounds on the moment- generating function is given.
0 references
coupon collector's problem
0 references
moment-generating function
0 references