Uniformization for λ-positive markov chains

From MaRDI portal
Publication:4385215





Consider a positive recurrent continuous time Markov chain with finite or countable state space. Denote by \(p(t)\) the distribution of the chain at time \(t\) and by \(\pi\) the stationary distribution of the chain. It is known that for certain number \(q\) and matrix \(R\) the following representation \[ p(t)= \pi+ e^{-qt} \sum^\infty_{n= 0} {(qt)^n\over n!} (p(0)\mathbb{R}^n- \pi) \] generates (by replacing the series with its partial sum) uniform in time approximation for \(p(t)\). The paper extends the result to the case of transient chains satisfying the condition of \(\lambda\)-positive recurrence. As an example, birth and death processes and closed Jackson network models are considered.











This page was built for publication: Uniformization for λ-positive markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4385215)