Inverse problems for ergodicity of Markov chains
The paper deals mostly with continuous-time Markov chains and provides criteria for non-ergodicity, nonalgebraic ergodicity, non-exponential ergodicity, and non-strong ergodicity. For discrete-time Markov chains, it contains criteria for non-ergodicity, non-algebraic ergodicity, and non-strong ergodicity. The criteria are given in terms of the existence of solutions to inequalities involving the \(Q\)-matrix (or transition matrix \(P\) in time-discrete case) of the chain. Theorem 1 represents a typical result of the paper. Let \(\Pi = \left( {{\Pi _{ij}}:i,j \in E} \right)\) be the matrix of the embedded chain of the \(Q\)-process. Theorem 1. Let \(Q\) be an irreducible regular \(Q\)-matrix and \(H\) be a non-empty finite subset of \(E\). Then the \(Q\)-process is non-ergodic iff there exists a sequence \(\left\{ {{y^{(n)}}} \right\}_{n = 1}^\infty \), where \({y^{(n)}} = {(y_i^{(n)})_{i \in E}}\) for each \(n \ge 1\), and \(\left\{ {{y^{(n)}}} \right\}_{n = 1}^\infty \) satisfies the following conditions: (1) for each \(n \ge 1\), \({y^{(n)}} = {(y_i^{(n)})_{i \in E}}\) satisfies \({\sup _{i \in E}}y_i^{(n)} < \infty \) and solves the inequality \({y_i} \le \sum\limits_{j \notin H} {{\Pi _{ij}}{y_j}} + \frac{1}{{{q_i}}}\),\(i \in E\); (2) \({\sup _{n \ge 1}}{\max _{i \in H}}y_i^{(n)} = \infty \). The author applies these results to a special class of single birth processes and several multidimensional models.
- A Class of Multidimensional Q-Processes
- A sufficient condition of nonergodicity of a Markov chain (Corresp.)
- Algebraic convergence for discrete-time ergodic Markov chains
- Algebraic convergence of Markov chains
- Conditions for the non-ergodicity of Markov chains with application to a communication system
- Criteria for ergodicity, exponential ergodicity and strong ergodicity of Markov processes
- Ergodic degrees for continuous-time Markov chains
- Exponential ergodicity for single-birth processes
- scientific article; zbMATH DE number 1153075 (Why is no real title available?)
- scientific article; zbMATH DE number 2133327 (Why is no real title available?)
- Markov Chains and Stochastic Stability
- Multi-dimensional Q-processes
- On nonergodicity of some continuous-time Markov chains
- Stability of Markovian processes I: criteria for discrete-time Chains
- Stability of Markovian processes II: continuous-time processes and sampled chains
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
- Strong ergodicity for single-birth processes
- Technical Note—Mean Drifts and the Non-Ergodicity of Markov Chains
- Tests for the Nonergodicity of Multidimensional Markov Chains
- Unified representation of formulas for single birth processes
- Markov chains: ergodicity in time-discrete cases
- Ergodic properties of a class of non-Markovian processes
- Some sufficient conditions for non-ergodicity of markov chains
- Tests for the Nonergodicity of Multidimensional Markov Chains
- scientific article; zbMATH DE number 1323345 (Why is no real title available?)
- scientific article; zbMATH DE number 6847567 (Why is no real title available?)
- Ergodicity criterion for one class of Markov chains with continuous time
- scientific article; zbMATH DE number 2213983 (Why is no real title available?)
- On stability of jump processes with uniformly finite range upward
- Tests for nonergodicity of denumerable continuous time Markov processes
This page was built for publication: Inverse problems for ergodicity of Markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2235934)
