Inequalities in Theorems of Ergodicity and Stability for Markov Chains with Common Phase Space. II

DOI10.1137/1130063zbMath0619.60066OpenAlexW4230050935MaRDI QIDQ3756250

N. V. Kartashov

Publication date: 1986

Published in: Theory of Probability & Its Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/1130063

zbMATH Keywords

transition kernelsergodicity and stability of general Markov chainssplit kernel

Mathematics Subject Classification ID

Queueing theory (aspects of probability theory) (60K25) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Related Items

Stability and exponential convergence of continuous-time Markov chains ⋮ Approximation of average cost optimal policies for general Markov decision processes with unbounded costs ⋮ SIMPLE CONTINUITY INEQUALITIES FOR RUIN PROBABILITY IN THE CLASSICAL RISK MODEL ⋮ Perturbation bounds and degree of imprecision for uniquely convergent imprecise Markov chains ⋮ ``Super-overtaking optimal policies for Markov control processes ⋮ Phase-type approximations of service-time distributions in \(M/G/1\) queues ⋮ Robustness of iterated function systems of Lipschitz maps ⋮ Explicit bounds for spectral theory of geometrically ergodic Markov kernels and applications ⋮ Unnamed Item ⋮ Average Cost Optimality Inequality for Markov Decision Processes with Borel Spaces and Universally Measurable Policies ⋮ Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited ⋮ Markov control processes with pathwise constraints ⋮ Sensitivity and convergence of uniformly ergodic Markov chains ⋮ Unnamed Item ⋮ Stability estimation of some Markov controlled processes