Dual bounds on the equilibrium distribution of a finite Markov chain (Q1092519)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Dual bounds on the equilibrium distribution of a finite Markov chain
scientific article

    Statements

    Dual bounds on the equilibrium distribution of a finite Markov chain (English)
    0 references
    0 references
    1987
    0 references
    Consider a stationary finite Markov chain with states numbered 1,2,...,N and transition probability matrix \(P=[P_{ij}]\), \(1\leq i\), \(j\leq N\), \(P_{ij}\geq 0\), \(\sum^{N}_{j=1}P_{ij}=1\). The author assumes that P is both unichained and aperiodic and gives sharp upper and lower bounds for the equilibrium state probabilities \(\pi_ k\) (1\(\leq k\leq N)\) of P, along with an iterative scheme which moves the bounds monotonically and geometrically inward to \(\pi_ k.\) The present bounds generalize a result of \textit{J. G. Kemeny} and \textit{J. L. Snell} [Finite Markov Chains (p.173) (1960; Zbl 0089.137)]. It may be noted that they have the advantage of being tight for small values of n, thereby reducing computational effort, but they have the disadvantage of working for only one choice of k at a time, so that bounding the entire equilibrium distribution requires N-fold effort.
    0 references
    0 references
    stationary finite Markov chain
    0 references
    sharp upper and lower bounds for the equilibrium state probabilities
    0 references