Eigentime identity for transient Markov chains (Q819653)

From MaRDI portal
Revision as of 12:36, 24 June 2024 by ReferenceBot (talk | contribs) (‎Changed an Item)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
scientific article
Language Label Description Also known as
English
Eigentime identity for transient Markov chains
scientific article

    Statements

    Eigentime identity for transient Markov chains (English)
    0 references
    29 March 2006
    0 references
    Let \(X_t\), \(t\geq 0\), be continuous time Markov chain with the minimal \(Q\)-function \(P(t)=(p_{ij}(t):i,j \in S)\) and \(Q\)-matrix \(Q=(q_{ij}:i,j \in S)\), the latter is assumed to be conservative, totally stable and irreducible on a countable infinite state space \(S\). Let \(\xi_0=0\), \(\xi_n=\inf\{t:t>\xi_{n-1}, X_t \neq X_{\xi_{n-1}}\}\), \(n \geq 1\), be succ\text{ess}ive jumps, \(\xi= \lim_{n \to \infty} \xi_n\) be the first leap time and \(E_i \xi\) be the expectation of \(\xi\) provided that \(X_0=i\). The proc\text{ess} is assumed to be transient, that is, the Green matrix \(G=(g_{ij}=\int_0^\infty p_{ij}(t) dt: i,j \in S)\) satisfies \(g_{ij}< \infty\) for all \(i,j \in S\). Let \(\text{tr}(G)=\sum_{i \in S} g_{ii}\) be the trace of \(G\). In the article the relationship among \(\text{tr}(G)\), \(E_i \xi\) and the eigenvalues of the corresponding Markov generator are studied. For general Markov chains it is proved that \(\sup_{i \in S} E_i \xi \leq \text{tr}(G)\). Therefore the proc\text{ess} is explosive if \(\text{tr}(G)< \infty\). For a single birth proc\text{ess} (\(S=Z_+\), \(q_{i,i+1}>0\), \(q_{i,i+j}=0\) for \(i\in Z_+\), \(j \geq 2\)) it is proved that \(\text{tr}(G)=\sup_{i \in S} E_i \xi\). Then symmetrizable proc\text{ess}es are considered, that is, \(\mu_i q_{ij}= \mu_j q_{ji}\) for all \(i,j \in S\) and for some measure \(\mu=(\mu_i>0, i \in S)\), whose total mass is infinite. Let \(L\) be the self-adjoint operator in \(L^2(\mu)\) associated with \(Q=(q_{ij})\) and let \(\sigma_{\text{ess}}(L)\) denote the \text{ess}ential spectrum of \(-L\) in \(L^2(\mu)\). For the symmetrizable proc\text{ess} with \(\sigma_{\text{ess}}(L)=\emptyset\) the general type eigentime identity \[ \sum_{n \geq 1} \lambda_n^{-1}=\text{tr}(G) \] is proved, where \(\lambda_1 \leq \lambda_2 \dots\) are all the eigenvalues of \(-L\), counting multiplicity. For example, a birth-death proc\text{ess} (\(S=Z_+\), \(q_{i,i+1}=b_i\) (\(i\geq 0\)), \(q_{i,i-1}=a_i\) (\(i\geq 1\)) and \(q_{ij}=0\) for all \(| i-j| \geq 2\)) is symmetrizable with the measure \(\mu_0=1\), \(\mu_i=b_0 b_1\dots b_{i-1}/(a_1 a_2\dots a_i)\) \((i \geq 1\)). If \(\sum_{i=0}^\infty \mu_i=\infty\) and \(R=\sum_{i=0}^\infty \mu_i \sum_{j=i}^\infty (\mu_j b_j)^{-1} < \infty\), then the eigentime formula reads \(\sum_{n \geq 1} \lambda_n^{-1}=R.\) As an application, the bounds of exponential convergence rates of (sub-) Markov semigroups \(P_t\) with the Markov generator \(L\) from \(l_\infty\) to \(l_\infty\) are given.
    0 references
    Markov chain
    0 references
    Eigenvalue
    0 references
    Essential spectrum
    0 references
    Eigentime identity
    0 references
    Green matrix
    0 references
    0 references

    Identifiers