Optimal control of Markov-modulated multiclass many-server queues
From MaRDI portal
Publication:5113896
Abstract: We study multiclass many-server queues for which the arrival, service and abandonment rates are all modulated by a common finite-state Markov process. We assume that the system operates in the "averaged" Halfin-Whitt regime, which means that it is critically loaded in the average sense, although not necessarily in each state of the Markov process. We show that under any static priority policy, the Markov-modulated diffusion-scaled queueing process is geometrically ergodic. This is accomplished by employing a solution to an associated Poisson equation in order to construct a suitable Lyapunov function. We establish a functional central limit theorem for the diffusion-scaled queueing process and show that the limiting process is a controlled diffusion with piecewise linear drift and constant covariance matrix. We address the infinite-horizon discounted and long-run average (ergodic) optimal control problems and establish asymptotic optimality.
Recommendations
- Ergodic control of multi-class \(\mathrm{M}/\mathrm{M}/N+\mathrm{M}\) queues in the Halfin-Whitt regime
- Scheduling a multi class queue with many exponential servers: asymptotic optimality in heavy traffic.
- Simplified control problems for multiclass many-server queueing systems
- On uniform exponential ergodicity of Markovian multiclass many-server queues in the Halfin-Whitt regime
- Scheduling control for Markov-modulated single-server multiclass queueing systems in heavy traffic
Cites work
- scientific article; zbMATH DE number 3951715 (Why is no real title available?)
- scientific article; zbMATH DE number 1354815 (Why is no real title available?)
- A functional central limit theorem for a Markov-modulated infinite-server queue
- Dynamic service rate control for a single-server queue with Markov-modulated arrivals
- Ergodic control of diffusion processes.
- Ergodic control of multi-class \(\mathrm{M}/\mathrm{M}/N+\mathrm{M}\) queues in the Halfin-Whitt regime
- Ergodicity of a Lévy-driven SDE arising from multiclass many-server queues
- Exponential ergodicity for Markov processes with random switching
- Heavy-Traffic Limits for Queues with Many Exponential Servers
- Heavy-traffic limits for many-server queues with service interruptions
- Infinite horizon asymptotic average optimality for large-scale parallel server networks
- Infinite-horizon average optimality of the N-network in the Halfin-Whitt regime
- Invariant densities for dynamical systems with random switching
- Martingale proofs of many-server heavy-traffic limits for Markovian queues
- Multiclass multiserver queueing system in the Halfin-Whitt heavy traffic regime: asymptotics of the stationary distribution
- On the functional and local limit theorems for Markov modulated compound Poisson processes
- Positive recurrence of piecewise Ornstein-Uhlenbeck processes and common quadratic Lyapunov functions
- Qualitative properties of certain piecewise deterministic Markov processes
- Scheduling a multi class queue with many exponential servers: asymptotic optimality in heavy traffic.
- Scheduling control for Markov-modulated single-server multiclass queueing systems in heavy traffic
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
- Stability of regime-switching diffusions
- Stability of regime-switching stochastic differential equations
- Stability of stochastic differential equations with Markovian switching
Cited in
(14)- On the Whittle index of Markov modulated restless bandits
- Optimal scheduling of critically loaded multiclass \(GI/m/n+m\) queues in an alternating renewal environment
- Exponential ergodicity and steady-state approximations for a class of Markov processes under fast regime switching
- Multithreshold control of the \(BMAP/G/1\) queuing system with map flow of Markovian disasters
- Scheduling control for Markov-modulated single-server multiclass queueing systems in heavy traffic
- Markovian bulk-arrival and bulk-service queues with general state-dependent control
- Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis
- Optimal service rate perturbations of many server queues in heavy traffic
- Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues
- Weak convergence of stochastic integrals with respect to the state occupation measure of a Markov chain
- On uniform exponential ergodicity of Markovian multiclass many-server queues in the Halfin-Whitt regime
- An ergodic control problem for many-server multiclass queueing systems with cross-trained servers
- Optimal intensity control of a multi-class queue
- Risk-sensitive control for the multiclass many-server queues in the moderate deviation regime
This page was built for publication: Optimal control of Markov-modulated multiclass many-server queues
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5113896)
