| Publication | Date of Publication | Type |
|---|
| Single-Run Gradient Estimation Via Measure-Valued Differentiation | 2017-07-12 | Paper |
| Large deviations bounds for face-homogeneous random walks in the quarter-plane | 2016-05-23 | Paper |
| Large deviations analysis of a coupled-processors system | 2016-05-23 | Paper |
| Balanced sequences and optimal routing | 2015-12-17 | Paper |
| A Genetic Algorithm for Finding Good Balanced Sequences in a Customer Assignment Problem with no State Information | 2015-07-28 | Paper |
| Perturbation analysis of waiting times in the G/G/1 queue | 2013-10-21 | Paper |
| Series Expansions for Continuous-Time Markov Processes | 2011-11-17 | Paper |
| An Approximation Approach for the Deviation Matrix of Continuous-Time Markov Processes with Application to Markov Decision Theory | 2011-11-17 | Paper |
| Strong bounds on perturbations | 2009-09-09 | Paper |
| https://portal.mardi4nfdi.de/entity/Q5324429 | 2009-08-03 | Paper |
| Derivatives of Markov Kernels and Their Jordan Decomposition | 2008-10-01 | Paper |
| Measure-Valued Differentiation for Stationary Markov Chains | 2008-05-27 | Paper |
| SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS | 2007-10-26 | Paper |
| ON THE OPTIMAL OPEN-LOOP CONTROL POLICY FOR DETERMINISTIC AND EXPONENTIAL POLLING SYSTEMS | 2007-06-04 | Paper |
| On the Assignment of Customers to Parallel Queues | 2007-01-19 | Paper |
| On the Optimality of the Generalized Shortest Queue Policy | 2007-01-19 | Paper |
| On the Shortest Queue Policy for the Tandem Parallel Queue | 2007-01-19 | Paper |
| On Suboptimal Policies in Multiclass Tandem Models | 2006-08-30 | Paper |
| On the structure of the optimal server control for fluid networks | 2006-02-08 | Paper |
| On the Average Waiting Time for Regular Routing to Deterministic Queues | 2005-11-11 | Paper |
| Correction | 2005-04-05 | Paper |
| Periodic routing to parallel queues and billiard sequences | 2005-02-11 | Paper |
| The unbalance and bounds on the average waiting time for periodic routing to one queue: the unbalance of routing sequences | 2004-09-22 | Paper |
| NOTE ON THE CONVEXITY OF THE STATIONARY WAITING TIME AS A FUNCTION OF THE DENSITY | 2004-08-16 | Paper |
| Characterization and sufficient conditions for normed ergodicity of Markov chains | 2004-05-27 | Paper |
| Large-deviations analysis of the fluid approximation for a controllable tandem queue | 2004-03-30 | Paper |
| Taylor series expansions for stationary Markov chains | 2004-03-07 | Paper |
| Discrete-event control of stochastic networks: multimodularity and regularity. | 2004-01-07 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4547440 | 2003-11-30 | Paper |
| Regular ordering and applications in control policies | 2002-08-19 | Paper |
| Performance bounds for queues via generating functions | 2002-07-21 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4537747 | 2002-06-20 | Paper |
| Comparison of queues with different discrete-time arrival processes | 2002-01-17 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4805103 | 2002-01-01 | Paper |
| Multimodularity, convexity, and optimization properties | 2001-11-26 | Paper |
| ON THE EXISTENCE OF THE PUISEUX EXPANSION OF THE DISCOUNTED REWARDS: A COUNTEREXAMPLE | 2001-10-08 | Paper |
| Smoothing effect of the superposition of homogeneous sources in tandem networks | 2001-10-04 | Paper |
| Optimal static customer routing in a closed queuing network | 2001-07-05 | Paper |
| Optimal open-loop control of vacations, polling and service assignment | 2001-06-19 | Paper |
| Open-loop routeing to M parallel servers with no buffers | 2001-05-13 | Paper |
| Admission control in stochastic event graphs | 2000-10-17 | Paper |
| Blackwell optimality in the class of all policies in Markov decision chains with a Borel state space and unbounded rewards | 2000-05-07 | Paper |
| Blackwell optimality in the class of stationary policies in Markov decision chains with a Borel state space and unbounded rewards | 1999-11-22 | Paper |
| Analysis of a finite-source customer assignment model with no state information | 1999-08-22 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3842620 | 1998-08-17 | Paper |
| Applications of Borovkov's Renovation Theory to Non-Stationary Stochastic Recursive Sequences and Their Control | 1998-06-09 | Paper |
| Contraction Conditions for Average and α-Discount Optimality in Countable State Markov Games with Unbounded Rewards | 1998-05-25 | Paper |
| Optimal service control against worst case admission policies: A multichained stochastic game | 1998-03-10 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4338419 | 1997-11-10 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4343717 | 1997-07-06 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4338427 | 1997-07-03 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4895164 | 1997-02-17 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4331900 | 1997-02-13 | Paper |
| Zero-sum Markov games and worst-case optimal control of queueing systems | 1996-11-25 | Paper |
| Undiscounted Markov decision chains with partial information; an algorithm for computing a locally optimal periodic policy | 1995-06-25 | Paper |
| On the Relation Between Recurrence and Ergodicity Properties in Denumerable Markov Decision Chains | 1994-12-11 | Paper |
| On the optimality of LEPT and μc rules for parallel processors and dependent arrival processes | 1994-02-07 | Paper |
| Recurrence Conditions for Average and Blackwell Optimality in Denumerable State Markov Decision Chains | 1993-01-16 | Paper |
| On ergodicity and recurrence properties of a Markov chain by an application to an open jackson network | 1993-01-16 | Paper |
| The µc-rule is not optimal in the second node of the tandem queue: a counterexample | 1992-06-28 | Paper |
| Denumerable semi-Markov decision chains with small interest rates | 1992-06-25 | Paper |
| Constrained admission control to a queueing system | 1989-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4207798 | 1989-01-01 | Paper |
| Are limits of \(\alpha\)-discounted optimal policies Blackwell optimal? A counterexample | 1989-01-01 | Paper |
| Average, Sensitive and Blackwell Optimal Policies in Denumerable Markov Decision Chains with Unbounded Rewards | 1988-01-01 | Paper |
| Insensitive bounds for the stationary distribution of non-reversible Markov chains | 1988-01-01 | Paper |
| Stochastic inequalities for an overflow model | 1987-01-01 | Paper |
| On the Convergence of Policy Iteration in Finite State Undiscounted Markov Decision Processes: The Unichain Case | 1987-01-01 | Paper |
| On the Optimality of $(s,S)$-Policies in Continuous Review Inventory Models | 1986-01-01 | Paper |
| Markov Decision Drift Processes; Conditions for Optimality Obtained by Discretization | 1985-01-01 | Paper |
| Sensitivity analysis in discounted Markovian decision problems | 1985-01-01 | Paper |
| Selection of order of observation in optimal stopping problems | 1985-01-01 | Paper |
| Constrained Undiscounted Stochastic Dynamic Programming | 1984-01-01 | Paper |
| Discretization and Weak Convergence in Markov Decision Drift Processes | 1984-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3734820 | 1984-01-01 | Paper |
| Transient policies in discrete dynamic programming: Linear programming including suboptimality tests and additional constraints | 1984-01-01 | Paper |
| Average optimal policies in Markov decision drift processes with applications to a queueing and a replacement model | 1983-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3709574 | 1983-01-01 | Paper |
| Semi-Markov strategies in stochastic games | 1983-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3666619 | 1983-01-01 | Paper |
| Weak convergence for generalized semi-Markov processes | 1982-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3795028 | 1982-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3922501 | 1981-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3919486 | 1981-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3919487 | 1981-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3914786 | 1981-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4175072 | 1979-01-01 | Paper |
| Linear Programming and Markov Decision Chains | 1979-01-01 | Paper |
| Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion | 1979-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3049651 | 1979-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3888878 | 1979-01-01 | Paper |
| A note on simultaneous recurrence conditions on a set of denumerable stochastic matrices | 1978-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q3908791 | 1978-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4177365 | 1978-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4149257 | 1977-01-01 | Paper |
| Sensitive Optimality Criteria in Countable State Dynamic Programming | 1977-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4120435 | 1976-01-01 | Paper |
| Discrete time methods for simulating continuous time Markov chains | 1976-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4152116 | 1976-01-01 | Paper |
| A Simple Proof of the Equivalence of the Limiting Distributions of the Continuous-Time and the Embedded Process of the Queue Size in the M/G/1 Queue | 1976-01-01 | Paper |
| The asymptotic behaviour of the minimal total expected cost for the denumerable state Markov decision model | 1975-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4096726 | 1975-01-01 | Paper |
| A modified form of the iterative method of dynamic programming | 1975-01-01 | Paper |
| On the convergence of moments in stationary Markov chains | 1975-01-01 | Paper |
| On a Conjecture of Iglehart | 1975-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4771778 | 1974-01-01 | Paper |
| Technical Note—The Method of Successive Approximations and Markovian Decision Problems | 1974-01-01 | Paper |
| On the convergence of the average expected return in dynamic programming | 1974-01-01 | Paper |
| Convergence Results and Approximations for Optimal (s, S) Policies | 1974-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q4042861 | 1973-01-01 | Paper |
| The Rate of Growth of Sample Maxima | 1972-01-01 | Paper |
| A counterexample in discounted dynamic programming | 1972-01-01 | Paper |
| https://portal.mardi4nfdi.de/entity/Q5526584 | 1967-01-01 | Paper |
