scientific article; zbMATH DE number 19247
[For the entire collection see Zbl 0733.00019.] The purpose of this paper is to suggest an approach to evaluate transient behaviour of time homogeneous Markov chains that have large or infinite state spaces, and to provide bounds for these characteristics. The authors exploit the fact that the transient characteristics of a time- homogeneous Markov chain, which is ergodic or not, can often be computed via a transformed process that is ergodic. Aggregation can then be used to analyze this process if its state space is too large and is beyond the capabilities of classical numerical methods. The technique proposed here provides bounds on transient characteristics, such as the drift and the moments of the time before absorption; no specific structure is assumed for the Markov chain.
- Bounds and Approximations for the Transient Behavior of Continuous-Time Markov Chains
- Bounds and approximations for continuous-time Markovian transition probabilities and large systems
- Transient phenomena for Markov chains and applications
- On transience conditions for Markov chains
- Some bounds for Markov chains
- Large deviations for Markov chains with random transitions
- Large Deviation Bounds for Markov Chains
- Comparing Markov chains: aggregation and precedence relations applied to sets of states, with applications to assemble-to-order systems
- Asymptotic expansions for stationary distributions of perturbed semi-Markov processes
- GENERALIZED CLASS [script C] MARKOV CHAINS AND COMPUTATION OF CLOSED-FORM BOUNDING DISTRIBUTIONS
- TRANSIENT PROBABILITIES OF HOMOGENEOUS ROW-CONTINUOUS BIVARIATE MARKOV CHAINS WITH ONE OR TWO BOUNDARIES
- Refinable bounds for large Markov chains
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3976680)
