Random walk, birth-and-death process and their fluid approximations: Absorbing case

DOI10.1007/s00186-008-0269-yzbMath1183.49027OpenAlexW2154130907MaRDI QIDQ1040689

Aleksey B. Piunovskiy

Publication date: 25 November 2009

Published in: Mathematical Methods of Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00186-008-0269-y

zbMATH Keywords

dynamic programmingrandom walkfluid modelinformation transmissionbirth-and-death processqueuing systemapproximation of operators

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Control/observation systems governed by partial differential equations (93C20) Queues and service in operations research (90B22) Discrete approximations in optimal control (49M25)

Related Items

LIQUIDATION IN LIMIT ORDER BOOKS WITH CONTROLLED INTENSITY ⋮ Asymptotic Fluid Optimality and Efficiency of the Tracking Policy for Bandwidth-Sharing Networks ⋮ On the accuracy of fluid approximations to a class of inventory-level-dependent EOQ and EPQ models ⋮ Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Multicriteria impulsive control of jump Markov processes
• On the structure of the optimal server control for fluid networks
• Strong approximation for Markovian service networks
• An explicit optimal isolation policy for a deterministic epidemic model
• A stability criterion via fluid limits and its application to a polling system
• On positive Harris recurrence of multiclass queueing networks: A unified approach via fluid limit models
• Global properties of infectious disease models with nonlinear incidence
• ON THE COMPARISON OF QUEUEING SYSTEMS WITH THEIR FLUID LIMITS
• Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
• Optimal control of queueing networks: an approach via fluid models
• Revenue Management for a Multiclass Single-Server Queue via a Fluid Model Analysis
• Stochastic theory of a fluid model of producers and consumers coupled by a buffer
• On ergodicity and recurrence properties of a Markov chain by an application to an open jackson network
• A simple fluid model for servicing priority traffic
• Stability and convergence of moments for multiclass queueing networks via fluid limit models
• Block-Structured Fluid Queues Driven by QBD Processes