A note on expected hitting times for birth and death chains (Q1126106)

From MaRDI portal
scientific article
Language Label Description Also known as
English
A note on expected hitting times for birth and death chains
scientific article

    Statements

    A note on expected hitting times for birth and death chains (English)
    0 references
    0 references
    0 references
    2 June 1997
    0 references
    A reversible Markov random walk on a locally finite graph is considered. A one step transition from a knot \(i\) to a knot \(j\) is possible (i.e. \(p_{ij}\neq 0\)) iff they are connected with an edge. Formulae for conditional expectations of a hitting time of the state \(j\) given an initial point \(i\) both for the finite and the infinite graph are derived. These formulae are interpreted in terms of electrical resistances inserted between knots in accordance with transition probabilities.
    0 references
    Markov random walk
    0 references
    graph
    0 references
    transition
    0 references
    stationary distribution
    0 references
    resistance
    0 references

    Identifiers