The state reduction and related algorithms and their applications to the study of Markov chains, graph theory, and the optimal stopping problem (Q1304617)
From MaRDI portal
scientific article
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | The state reduction and related algorithms and their applications to the study of Markov chains, graph theory, and the optimal stopping problem |
scientific article |
Statements
The state reduction and related algorithms and their applications to the study of Markov chains, graph theory, and the optimal stopping problem (English)
0 references
22 September 1999
0 references
A beautiful survey of results on state reduction algorithm for countable Markov chains is given. Applications of the algorithm for different problems are considered. There are the calculation of invariant distribution and other characteristics of Markov chains, the optimal stopping time problem for Markov chains, estimation of perturbation bounds for Markov chains and some problems in graph theory. The author presents new results in the field and improves the proofs of some known results. Some applications are also considered.
0 references
countable Markov chain
0 references
invariant distribution
0 references
spanning tree
0 references
optimal stopping time
0 references
0 references
0 references
0 references
0 references
