Representations for the decay parameter of Markov chains (Q527480)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Representations for the decay parameter of Markov chains
scientific article

    Statements

    Representations for the decay parameter of Markov chains (English)
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    11 May 2017
    0 references
    According to Kingman's classical result under some assumptions for the Markov chains there exists the limit \[ -\lambda _1=\lim _{t\to \infty }t^{-1}\log P_{ij}(t), \] which is independent of \(i\) and \(j\). If the chain is transient or null recurrent, then \(\lambda _1\) characterizes the exponential decay rate of the process. Let \[ \lambda ^{*}=-\lim _{t\to \infty }t^{-1}\log \| P(t)\| _u, \] where \(\| P(t)\| _u\) is the norm of the operator \(P(t)\), then \(\lambda _1\geq \lambda ^*\). In many typical cases, \(\lambda ^*\) really is in the spectrum. The aim of the paper is to provide variational representation for \(\lambda _1\) for more general chains and is motivated by the works of \textit{M. D. Donsker} and \textit{S. R. S. Varadhan} [Proc. Natl. Acad. Sci. USA 72, 780--783 (1975; Zbl 0353.49039); Commun. Pure Appl. Math. 29, 595--621 (1976; Zbl 0356.35065)]. Using the Donsker-Varadhan \(I\)-functional some dual representations are given, they are connected with the Perron-Frobenius eigenvalue. Connections with quasi-stationarity and quasi-ergodicity are discussed.
    0 references
    0 references
    decay parameter
    0 references
    Markov chain
    0 references
    quasi-ergodicity
    0 references
    quasi-stationarity
    0 references