SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS

DOI10.1017/S0269964807000034zbMath1124.60056MaRDI QIDQ5422217

Arie Hordijk, Miranda van Uitert, Bernd F. Heidergott

Publication date: 26 October 2007

Published in: Probability in the Engineering and Informational Sciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1017/s0269964807000034

Mathematics Subject Classification ID

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

Related Items

Robust power series algorithm for epistemic uncertainty propagation in Markov chain models, Analysis of Markov Influence Graphs, A parametric uncertainty analysis method for queues with vacations, Parameterized Markov decision process and its application to service rate control, Statistical techniques for a numerical evaluation of the proximity of \(G/G/1\) and \(G/M/1\) queueing systems, Strong stability of the embedded Markov chain in an \(GI/M/1\) queue with negative customers, Error bounds on practical approximation for two tandem queue with blocking and non-preemptive priority, Approximation in the \(M_{2}/G_{2}/1\) queue with preemptive priority, Perturbation analysis of the \(\mathrm{GI}/\mathrm{M}/s\) queue, Ranking nodes in general networks: a Markov multi-chain approach, Measure of performances of the strong stability method, Strong truncation approximation in tandem queues with blocking, The jump start power method: a new approach for computing the ergodic projector of a finite Markov chain, New perturbation bounds for denumerable Markov chains, A unified perturbation analysis framework for countable Markov chains, A functional approximation for the M/G/1/N queue, Nonparametric estimation of the claim amount in the strong stability analysis of the classical risk model, Robust Sensitivity Analysis for Stochastic Systems, Markov Reward Models and Markov Decision Processes in Discrete and Continuous Time: Performance Evaluation and Optimization, Strong stability in a two-dimensional classical risk model with independent claims, Unnamed Item, Strong Stability of the Batch Arrival Queueing Systems, Quantitative Estimates in an M₂/G₂/1 Priority Queue with Non-Preemptive Priority: The Method of Strong Stability, Structural Perturbation Analysis of a Single Server Queue with Breakdowns