Singularly Perturbed Discrete-Time Markov Chains

DOI10.1137/S0036139999354297MaRDI QIDQ4507316zbMATH OpenOpenAlexFDO

Authors G. Yin, Q. Zhang

Publication date 18 October 2000

Published in SIAM Journal on Applied Mathematics (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1137/s0036139999354297

zbMATH Keywords

asymptotic expansiondiscrete-time Markov chainquasi-stationary distribution

Mathematics Subject Classification ID

Perturbations, asymptotics of solutions to ordinary differential equations (34E10) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Recommendations

• scientific article; zbMATH DE number 1944270
• scientific article; zbMATH DE number 1786116
• Singularly perturbed Markov chains: Convergence and aggregation
• Exponential bounds for discrete-time singularly perturbed Markov chains
• Singularly perturbed Markov chains: limit results and applications

Cited in

(21)

• Stability of Markov modulated discrete-time dynamic systems.
• Near-optimal controls of discrete-time dynamic systems driven by singularly-perturbed Markov chains
• Exponential bounds for discrete-time singularly perturbed Markov chains
• Asymptotic properties of consensus-type algorithms for networked systems with regime-switching topologies
• A unified perturbation analysis framework for countable Markov chains
• On finite capacity queues with time dependent arrival rates
• A note on two-person zero-sum communicating stochastic games
• Singularly perturbed Markov chains: limit results and applications
• Discrete-time Markov chains with two-time scales and a countable state space: limit results and queueing applications
• Stability of Discrete-Time Regime-Switching Dynamic Systems with Delays
• A formula for singular perturbations of Markov chains
• scientific article; zbMATH DE number 1113626 (Why is no real title available?)
• scientific article; zbMATH DE number 1944270 (Why is no real title available?)
• Discrete-time singularly perturbed Markov chains: aggregation, occupation measures, and switching diffusion limit
• Control of singularly perturbed Markov chains: A numerical study
• scientific article; zbMATH DE number 1836394 (Why is no real title available?)
• scientific article; zbMATH DE number 843059 (Why is no real title available?)
• Discrete-time approximation of Wonham filters
• The fundamental matrix of singularly perturbed Markov chains
• scientific article; zbMATH DE number 970112 (Why is no real title available?)
• Asymptotically optimal controls of hybrid linear quadratic regulators in discrete time.

This page was built for publication: Singularly Perturbed Discrete-Time Markov Chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4507316)