Uniformization for λ-positive markov chains
Consider a positive recurrent continuous time Markov chain with finite or countable state space. Denote by \(p(t)\) the distribution of the chain at time \(t\) and by \(\pi\) the stationary distribution of the chain. It is known that for certain number \(q\) and matrix \(R\) the following representation \[ p(t)= \pi+ e^{-qt} \sum^\infty_{n= 0} {(qt)^n\over n!} (p(0)\mathbb{R}^n- \pi) \] generates (by replacing the series with its partial sum) uniform in time approximation for \(p(t)\). The paper extends the result to the case of transient chains satisfying the condition of \(\lambda\)-positive recurrence. As an example, birth and death processes and closed Jackson network models are considered.
- Uniformization for nonhomogeneous Markov chains
- On a simple proof of uniformization for continuous and discrete-state continuous-time Markov chains
- A Note on External Uniformization for Finite Markov Chains in Continuous Time
- Uniform CLT for Markov chains with a countable state space
- Uniform CLT for Markov chains with a countable state space
- Some Results for Uniformizable Semi-Markov Processes
This page was built for publication: Uniformization for λ-positive markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4385215)