An Escape-Time Criterion for Queueing Networks: Asymptotic Risk-Sensitive Control via Differential Games

DOI10.1287/MOOR.28.4.801.20514MaRDI QIDQ5704151zbMATH OpenOpenAlexWikidataFDO

Authors Rami Atar, Paul Dupuis, Adam Shwartz

Publication date 11 November 2005

Published in Mathematics of Operations Research (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/math/0501031

zbMATH Keywords

stochastic controlQueueing network

Mathematics Subject Classification ID

Queues and service in operations research (90B22) Queueing theory (aspects of probability theory) (60K25) Differential games and control (49N70) Differential games (aspects of game theory) (91A23)

Abstract: We consider the problem of risk-sensitive control of a stochastic network. In controlling such a network, an escape time criterion can be useful if one wishes to regulate the occurrence of large buffers and buffer overflow. In this paper a risk-sensitive escape time criterion is formulated, which in comparison to the ordinary escape time criteria penalizes exits which occur on short time intervals more heavily. The properties of the risk-sensitive problem are studied in the large buffer limit, and related to the value of a deterministic differential game with constrained dynamics. We prove that the game has value, and that the value is the (viscosity) solution of a PDE. For a simple network, the value is computed, demonstrating the applicability of the approach.

Recommendations

• Explicit solution for a network control problem in the large deviation regime
• Risk-Sensitive and Robust Escape Criteria
• Risk-Sensitive Control for the Parallel Server Model
• A differential game formulation of a controlled network
• Explicit Solution to a Robust Queueing Control Problem

Cited in

(12)

• Ergodic risk sensitive control of Markovian multiclass many-server queues with abandonment
• Risk-sensitive control for a class of diffusions with jumps
• Fluid limits of optimally controlled queueing networks
• Weak convergence and fluid limits in optimal time-to-empty queueing control problems
• Explicit solution for a network control problem in the large deviation regime
• Boundary-influenced robust controls: two network examples
• Control of the multiclass \(\mathrm{G}/\mathrm{G}/1\) queue in the moderate deviation regime
• A d-person differential game with state space constraints
• A characterization of the reflected quasipotential
• A differential game for a multiclass queueing model in the moderate-deviation heavy-traffic regime
• Simple singularities for Hamilton-Jacobi equations with max-concave Hamiltonians and generalized characteristics
• Risk-sensitive control for the multiclass many-server queues in the moderate deviation regime

This page was built for publication: An Escape-Time Criterion for Queueing Networks: Asymptotic Risk-Sensitive Control via Differential Games

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5704151)