Markov-Renewal Programming. I: Formulation, Finite Return Models

From MaRDI portal
Publication:5332971


DOI10.1287/opre.11.6.938zbMath0126.15905MaRDI QIDQ5332971

William S. Jewell

Publication date: 1963

Published in: Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/opre.11.6.938



Related Items

Zur Extrapolation in Markoffschen Entscheidungsmodellen mit Diskontierung, Unnamed Item, Unnamed Item, Unnamed Item, Exact distributions for reward functions on semi-Markov and Markov additive processes, Sorbe una aplicacion de los procesos de renovacion markovianos a los juegos estocasticos no terminativos, Programacion secuencial en concurrencia con factor descuento continuo, Semi‐Markov processes and mobility†, Critique of probabilistic models: Application of the Semi‐Markov model to migration, Bounds on the fixed point of a monotone contraction operator, On the solvability of Bellman's functional equations for Markov renewal programming, Computation of optimal policies in discounted semi-Markov decision chains, Optimal dynamic routing in flexible manufacturing systems with limited buffers, Generalized polynomial approximations in Markovian decision processes, The variational calculus and approximation in policy space for Markovian decision processes, Variational characterizations in Markov decision processes, On the existence of relative values for undiscounted Markovian decision processes with a scalar gain rate, Solving Markovian decision processes by successive elimination of variables, A Brouwer fixed-point mapping approach to communicating Markov decision processes, Nonstationary Markov decision problems with converging parameters, Markov renewal decision processes with finite horizon, A natural extension of the MacQueen extrapolation, Denumerable semi-Markov decision chains with small interest rates, Some models of queueing control with switchover, Markov ratio decision processes, Semi-Markov processes and their applications, Dynamic programming of expectation and variance, A second-order approximation for the variance of a renewal reward process, Continuous time control of the arrival process in an M/G/1 queue, Foolproof convergence in multichain policy iteration, Contraction mappings underlying undiscounted Markov decision problems, Multiple perspective dynamic decision making, Obituary: William S. Jewell (1932--2003), On the existence of relative values for undiscounted multichain Markov decision processes, The optimization of K-effect models by linear and dynamic programming, Fluctuations of a renewal-reward process, Finite state continuous time Markov decision processes with an infinite planning horizon, Optimal control of stationary Markov processes, Block-scaling of value-iteration for discounted Markov renewal programming, Replacement process decomposition for discounted Markov renewal programming, The bellman equation for vector-valued semi-markovian dyanmic programiing, On-line scheduling of a robotic manufacturing cell with stochastic sequence-dependent processing rates, Generalized Markovian decision processes, A value-iteration scheme for undiscounted multichain Markov renewal programs, A Fixed Point Approach to Undiscounted Markov Renewal Programs, Sensitivitätsanalysen in entscheidungsmodellen, On a control of a Markov chain under conditions with respect to the absolute stationary probabilities and cost, Improved iterative computation of the expected discounted return in Markov and semi-Markov chains, A further anticycling rule in multichain policy iteration for undiscounted Markov renewal programs, Computation techniques for large scale undiscounted markov decision processes, Discounted Stochastic Ratio Games, A decision exclusion algorithm for a class of Markovian Decision Processes, Solving stochastic dynamic programming problems by linear programming — An annotated bibliography