A unified perturbation analysis framework for countable Markov chains
From MaRDI portal
Publication:2361570
DOI10.1016/j.laa.2017.05.002zbMath1370.60118OpenAlexW2612574518MaRDI QIDQ2361570
Publication date: 30 June 2017
Published in: Linear Algebra and its Applications (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/j.laa.2017.05.002
Computational methods in Markov chains (60J22) Queueing theory (aspects of probability theory) (60K25) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Branching processes (Galton-Watson, birth-and-death, etc.) (60J80) Continuous-time Markov processes on discrete state spaces (60J27)
Related Items
Queueing Network Controls via Deep Reinforcement Learning, The time-dependent expected reward and deviation matrix of a finite QBD process, Matrix-Analytic Methods for Solving Poisson’s Equation with Applications to Markov Chains of GI/G/1-Type, Sensitivity of the stationary distributions of denumerable Markov chains, Error bounds for augmented truncation approximations of Markov chains via the perturbation method, Singularly Perturbed Markov Modulated Fluid Queues
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Tail asymptotics for a generalized two-demand queueing model -- a kernel method
- Markov chains and stochastic stability
- Strongly stable Markov chains
- Perturbations of countable Markov chains and processes
- Optimal control of Markov chains admitting strong and weak interactions
- Ergodic control of a singularly perturbed Markov process in discrete time with general state and compact action spaces
- New perturbation bounds for denumerable Markov chains
- Perturbation analysis for continuous-time Markov chains
- Series Expansions for Continuous-Time Markov Processes
- Tail Decay Rates in Double QBD Processes and Related Reflected Random Walks
- Discrete-time Markov chains with two-time scales and a countable state space: limit results and queueing applications
- A Reduction Process for Perturbed Markov Chains
- Control of singularly perturbed Markov chains: A numerical study
- Singularly Perturbed Discrete-Time Markov Chains
- Perturbation analysis for denumerable Markov chains with application to queueing models
- Explicit criteria for several types of ergodicity of the embedded M/G/1 and GI/M/n queues
- THE DEVIATION MATRIX OF A CONTINUOUS-TIME MARKOV CHAIN
- Asymptotic Expansions of Singularly Perturbed Systems Involving Rapidly Fluctuating Markov Chains
- Perturbation Bounds for the Stationary Distributions of Markov Chains
- SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS
- Stability Estimates for Finite Homogeneous Continuous-time Markov Chains
- Several Types of Ergodicity for M/G/1-Type Markov Chains and Markov Processes
- Nearly optimal control of singularly perturbed Markov decision processes in discrete time
