On three classical problems for Markov chains with continuous time parameters
Let \((p_{ij}(t))\) be a sub-Markov transition probability matrix on a countable state space \(E\) with the totally stable and conservative \(Q\)- matrix \(Q=(q_{ij})\). The author studies three classical problems: The uniqueness of the \(Q\)-semigroup, recurrence and positive recurrence of the corresponding Markov chain. For a flavor of obtained results, here is the uniqueness theorem: If there exists a sequence \(\{E_ n\}^ \infty_ 1\), \(E_ n\uparrow E\), and a non-negative function \(\phi\) such that \(\sup_{i\in E_ n} q_ i<\infty\), \(\lim_{n\to\infty}\) \(\inf_{i\not\in E_ n}\phi_ i=\infty\), and \[ \sum_ j q_{ij}(\phi_ j-\phi_ i)\leq c\phi_ i,\quad i\in E, \] for some \(c\in{\mathbf R}\), then the \(Q\)-process is unique. - The main tool in proving results is the concept of the minimal, non- negative solution to a non-negative linear equation. Examples are given illustrating applicability of criteria.
- On the stationary distribution of queue lengths in a multi-class priority queueing system with customer transfers
- Continuous-time controlled Markov chains.
- Stochastic montonicity and duality for continuous time Markov chains with general \(q\)-matrix
- Light-traffic analysis of random access systems without collisions
- Stability of a priority queueing system with customer transfers
- Spatially inhomogeneous populations with seed-banks. I: Duality, existence and clustering
- A note on the classification of Q-processes when Q is not regular
- The exit time finite state projection scheme: bounding exit distributions and occupation measures of continuous-time Markov chains
- Branching processes with interactions: subcritical cooperative regime
- Uniqueness criteria for continuous-time Markov chains with general transition structures
- Reaction-diffusion processes
- On truncated and full classical Markov moment problems
- Exponential ergodicity of branching processes with immigration and competition
- Column continuous transition functions
This page was built for publication: On three classical problems for Markov chains with continuous time parameters
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3977672)
