Singularly perturbed Markov chains: limit results and applications
From MaRDI portal
Publication:2467116
Abstract: This work focuses on time-inhomogeneous Markov chains with two time scales. Our motivations stem from applications in reliability and dependability, queueing networks, financial engineering and manufacturing systems, where two-time-scale scenarios naturally arise. One of the important questions is: As the rate of fluctuation of the Markov chain goes to infinity, if the limit distributions of suitably centered and scaled sequences of occupation measures exist, what can be said about the convergence rate? By combining singular perturbation techniques and probabilistic methods, this paper addresses the issue by concentrating on sequences of centered and scaled functional occupation processes. The results obtained are then applied to treat a queueing system example.
Recommendations
- Singularly perturbed Markov chains: Convergence and aggregation
- Occupation measures of singularly perturbed Markov chains with absorbing states
- Singularly Perturbed Discrete-Time Markov Chains
- Discrete-time Markov chains with two-time scales and a countable state space: limit results and queueing applications
- scientific article; zbMATH DE number 1944270
Cites work
- A new method to prove strassen type laws of invariance principle. 1
- An approximation of partial sums of independent RV'-s, and the sample DF. I
- An approximation of stopped sums with applications in queueing theory
- Applications of functional analysis and operator theory
- Asymptotic Analysis of the Time Dependent M/M/1 Queue
- Asymptotic Expansions of Singularly Perturbed Systems Involving Rapidly Fluctuating Markov Chains
- Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states.
- scientific article; zbMATH DE number 425394 (Why is no real title available?)
- scientific article; zbMATH DE number 3858075 (Why is no real title available?)
- scientific article; zbMATH DE number 3723610 (Why is no real title available?)
- scientific article; zbMATH DE number 43057 (Why is no real title available?)
- scientific article; zbMATH DE number 46732 (Why is no real title available?)
- scientific article; zbMATH DE number 193660 (Why is no real title available?)
- scientific article; zbMATH DE number 3502497 (Why is no real title available?)
- scientific article; zbMATH DE number 1350741 (Why is no real title available?)
- scientific article; zbMATH DE number 1113626 (Why is no real title available?)
- scientific article; zbMATH DE number 1517499 (Why is no real title available?)
- scientific article; zbMATH DE number 3320019 (Why is no real title available?)
- Invariance principles for renewal processes
- On the accuracy of Kingman's heavy traffic approximation in the theory of queues
- Perturbation analysis for denumerable Markov chains with application to queueing models
- Production control in a failure-prone manufactoring system: Diffusion approximation and asymptotic optimality
- Skorohod embedding of multivariate RV's, and the sample DF
- Strong approximation of additive functionals
- Strong approximation theorems for density dependent Markov chains
- The invariance principle for Banach space valued random variables
- Time-Dependent Queues
- Two-Time-Scale Markov Chains and Applications to Quasi-Birth-Death Queues
- Uniform acceleration expansions for Markov chains with time-varying rates
- Weak convergence methods and singularly perturbed stochastic control and filtering problems
Cited in
(31)- Limit properties and optimization of processes with separation of time
- Limit behavior of two-time-scale diffusions revisited
- A central limit theorem for singularly perturbed nonstationary finite state Markov chains
- Exponential bounds for discrete-time singularly perturbed Markov chains
- Delay-dependent exponential stability results for uncertain stochastic Hopfield neural networks with interval time-varying delays
- An averaging principle for two-time-scale stochastic functional differential equations
- A natural extension of Markov processes and applications to singular SDEs
- Fast-slow-coupled stochastic functional differential equations
- Limiting characteristics of queueing systems with vanishing perturbations
- Reduction of Markov chains with two-time-scale state transitions
- Asymptotic properties of Markov-modulated random sequences with fast and slow timescales
- Weak convergence of Markov-modulated random sequences
- Discrete-time Markov chains with two-time scales and a countable state space: limit results and queueing applications
- Stability of Discrete-Time Regime-Switching Dynamic Systems with Delays
- On some problems arising in asymptotic analysis of Markov processes with singularly perturbed generators
- Asymptotic properties of hybrid random processes modulated by Markov chains
- A formula for singular perturbations of Markov chains
- scientific article; zbMATH DE number 1113626 (Why is no real title available?)
- Singularly Perturbed Discrete-Time Markov Chains
- Two-Time-Scale Markov Chains and Applications to Quasi-Birth-Death Queues
- scientific article; zbMATH DE number 1836394 (Why is no real title available?)
- Countable-state-space Markov chains with two time scales and applications to queueing systems
- OnM-multisplittings of singularM-matrices with application to Markov chains
- The fundamental matrix of singularly perturbed Markov chains
- Singularly perturbed Markov chains with two small parameters: A matched asymptotic expansion
- An averaging principle for fast-slow-coupled neutral stochastic differential equations with time-varying delay
- Weak convergence of McKean-Vlasov stochastic differential equations with two-time-scale Markov switching
- Two-time-scale stochastic functional differential equations: inclusion of infinite delay and coupled segment processes
- Systems of singularly perturbed forward-backward stochastic differential equations and control problems
- Near-optimal controls of two-time scale functional diffusion systems
- Title not available (Why is no real title available?)
This page was built for publication: Singularly perturbed Markov chains: limit results and applications
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2467116)
