Uniformization for λ-positive markov chains (Q4385215)
From MaRDI portal
!
This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:
scientific article; zbMATH DE number 1140171
| Language | Label | Description | Also known as |
|---|---|---|---|
| default for all languages | No label defined |
||
| English | Uniformization for λ-positive markov chains |
scientific article; zbMATH DE number 1140171 |
Statements
Uniformization for λ-positive markov chains (English)
0 references
12 November 1998
0 references
Markov chain
0 references
uniformization
0 references
stationary distribution
0 references
approximation
0 references
lambda-positive recurrence
0 references
Jackson network models
0 references
0.9292734
0 references
0.89669704
0 references
0.8917213
0 references
0.88368005
0 references
0.88368005
0 references
0.87806237
0 references
Consider a positive recurrent continuous time Markov chain with finite or countable state space. Denote by \(p(t)\) the distribution of the chain at time \(t\) and by \(\pi\) the stationary distribution of the chain. It is known that for certain number \(q\) and matrix \(R\) the following representation \[ p(t)= \pi+ e^{-qt} \sum^\infty_{n= 0} {(qt)^n\over n!} (p(0)\mathbb{R}^n- \pi) \] generates (by replacing the series with its partial sum) uniform in time approximation for \(p(t)\). The paper extends the result to the case of transient chains satisfying the condition of \(\lambda\)-positive recurrence. As an example, birth and death processes and closed Jackson network models are considered.
0 references