Continuous-time block-monotone Markov chains and their block-augmented truncations
From MaRDI portal
(Redirected from Publication:347491)
Abstract: This paper considers continuous-time block-monotone Markov chains (BMMCs) and their block-augmented truncations. We first introduce the block monotonicity and block-wise dominance relation for continuous-time Markov chains, and then provide some fundamental results on the two notions. Using these results, we show that the stationary distribution vectors obtained by the block-augmented truncation converge to the stationary distribution vector of the original BMMC. We also show that the last-column-block-augmented truncation (LC-block-augmented truncation) provides the best (in a certain sense) approximation to the stationary distribution vector of a BMMC among all the block-augmented truncations. Furthermore, we present computable upper bounds for the total variation distance between the stationary distribution vectors of a Markov chain and its LC-block-augmented truncation, under the assumption that the original Markov chain itself may not be block-monotone but is block-wise dominated by a BMMC with exponential ergodicity. Finally, we apply the obtained bounds to a queue with a batch Markovian arrival process and state-dependent departure rates.
Recommendations
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under subgeometric drift conditions
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under geometric drift conditions
- Error bounds for last-column-block-augmented truncations of block-structured Markov chains
- Augmented truncation approximations of discrete-time Markov chains
- Stochastic block–monotonicity in the approximation of the stationary distribution of infinite markov chains
Cites work
- scientific article; zbMATH DE number 47926 (Why is no real title available?)
- scientific article; zbMATH DE number 1325007 (Why is no real title available?)
- scientific article; zbMATH DE number 4119378 (Why is no real title available?)
- scientific article; zbMATH DE number 3236503 (Why is no real title available?)
- scientific article; zbMATH DE number 3274494 (Why is no real title available?)
- A CONVEXITY PROPERTY OF POSITIVE MATRICES
- A first course in stochastic models.
- Approximating Markov chains and \(V\)-geometric ergodicity via weak perturbation theory
- Augmented truncation approximations of discrete-time Markov chains
- Comparison methods for stochastic models and risks
- Computable exponential convergence rates for stochastically ordered Markov processes
- Continuous-time Markov chains. An applications-oriented approach
- Derivatives of Eigenvalues and Eigenvectors of Matrix Functions
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under geometric drift conditions
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under subgeometric drift conditions
- Introduction to Matrix Analytic Methods in Stochastic Modeling
- Markov Chains
- Markov chains and stochastic stability
- Monotone infinite stochastic matrices and their augmented truncations
- New results on the single server queue with a batch markovian arrival process
- Numerical Methods for Structured Markov Chains
- On truncations for weakly ergodic inhomogeneous birth and death processes
- Perturbation Bounds forMt/Mt/NQueue with Catastrophes
- Perturbation bounds and truncations for a class of Markovian queues
- Probability with Martingales
- Stochastic block–monotonicity in the approximation of the stationary distribution of infinite markov chains
- Stochastically monotone Markov Chains
- Truncation approximations of invariant measures for Markov chains
Cited in
(15)- Characterization of the conditional stationary distribution in Markov chains via systems of linear inequalities
- Two-sided truncations for a class of continuous-time Markov chains
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under subgeometric drift conditions
- A sequential update algorithm for computing the stationary distribution vector in upper block-Hessenberg Markov chains
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under geometric drift conditions
- Error bounds for augmented truncation approximations of Markov chains via the perturbation method
- Error bounds for augmented truncation approximations of continuous-time Markov chains
- Stationary distributions of continuous-time Markov chains: a review of theory and truncation-based approximations
- A geometric convergence formula for the level-increment-truncation approximation of \(M/G/1\)-type Markov chains
- Numerical Methods for Integral Equations of the Second Kind with NonSmooth Solutions of Bounded Variation
- Stochastic block–monotonicity in the approximation of the stationary distribution of infinite markov chains
- Stochastic monotonicity and comparability of Markov chains with block-monotone transition matrices and their applications to queueing systems
- Error bounds for last-column-block-augmented truncations of block-structured Markov chains
- Perturbation analysis for continuous-time Markov chains in a weak sense
- A new matrix-infinite-product-form solution for upper block-Hessenberg Markov chains and its quasi-algorithmic constructibility
This page was built for publication: Continuous-time block-monotone Markov chains and their block-augmented truncations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q347491)
