Approximate uniformization for continuous-time Markov chains with an application to performability analysis

DOI10.1016/0304-4149(92)90018-LzbMath0753.60066MaRDI QIDQ1190175

Nico M. van Dijk

Publication date: 27 September 1992

Published in: Stochastic Processes and their Applications (Search for Journal in Brave)

zbMATH Keywords

continuous-time Markov chainsjump ratesqueueing applicationuniformization technique

Mathematics Subject Classification ID

Communication networks in operations research (90B18) Markov and semi-Markov decision processes (90C40) Applications of renewal theory (reliability, demand theory, etc.) (60K10) Continuous-time Markov processes on discrete state spaces (60J27)

Related Items

Optimization problems in chemical reactions using continuous-time Markov chains ⋮ Unnamed Item ⋮ Uniformization for nonhomogeneous Markov chains ⋮ On product form approximations for communication networks with losses: Error bounds ⋮ A Simple Performability Estimate for Jackson Networks with an Unreliable Output Channel ⋮ Approximate adaptive uniformization of continuous-time Markov chains ⋮ On first passage times in discrete skeletons and uniformized versions of a continuous-time Markov chain ⋮ On the Whittle index of Markov modulated restless bandits

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A simple technique in Markovian control with applications to resource allocation to resource allocation in communication networks
• On the finite horizon Bellman equation for controlled Markov jump models with unbounded characteristics: Existence and approximation
• Simple bounds and monotonicity results for finite multi-server exponential tandem queues
• Controlled jump processes
• Non-negative matrices and Markov chains.
• Priority queues
• Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes
• Approximating Transition Probabilities and Mean Occupation Times in Continuous-Time Markov Chains
• Bounds and Approximations for the Transient Behavior of Continuous-Time Markov Chains
• Simple bounds for queueing systems with breakdowns
• A Concept of Monotonicity and Its Characterization for Closed Queueing Networks
• Stochastic Monotonicity of the Queue Lengths in Closed Queueing Networks
• Comparing counting processes and queues
• Truncation of Markov Chains with Applications to Queueing
• Stochastic monotonicity in general queueing networks