The value iteration method for countable state Markov decision processes

DOI10.1016/S0167-6377(99)00015-2zbMath0954.90060WikidataQ127932269 ScholiaQ127932269MaRDI QIDQ1306452

Yossi Aviv, Awi Federgruen

Publication date: 9 February 2001

Published in: Operations Research Letters (Search for Journal in Brave)

zbMATH Keywords

Markov decision processesunbounded costsoptimal policycountable state spacevalue-iteration method

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Related Items (8)

Optimal threshold control of a retrial queueing system with finite buffer ⋮ Heuristic Solution for the Optimal Thresholds in a Controllable Multi-server Heterogeneous Queueing System Without Preemption ⋮ An optimal control approach to day-to-day congestion pricing for stochastic transportation networks ⋮ A CONTINUOUS REVIEW MODEL WITH GENERAL SHELF AGE AND DELAY-DEPENDENT INVENTORY COSTS ⋮ Structural properties of the optimal resource allocation policy for single-queue systems ⋮ Analysis of the optimal resource allocation for a tandem queueing system ⋮ Optimal Control of a Two-Server Heterogeneous Queueing System with Breakdowns and Constant Retrials ⋮ Stochastic Inventory Models with Limited Production Capacity and Periodically Varying Parameters

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Value iteration in countable state average cost Markov decision processes with unbounded costs
• Stochastic optimal control. The discrete time case
• On strong average optimality of Markov decision processes with unbounded costs
• Comparing recent assumptions for the existence of average optimal stationary policies
• The convergence of value iteration in average cost Markov decision chains
• Denumerable Undiscounted Semi-Markov Decision Processes with Unbounded Rewards
• An Inventory Model with Limited Production Capacity and Uncertain Demands I. The Average-Cost Criterion
• Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded Costs
• On the Second Optimality Equation for Semi-Markov Decision Models
• The asymptotic behaviour of the minimal total expected cost for the denumerable state Markov decision model
• Computing the optimal policy for capacitated inventory models
• X-Y Band and Modified (s, S) Policy
• Bounds and Asymptotics for Planning Critical Safety Stocks
• Sensitivity Analysis for Base-Stock Levels in Multiechelon Production-Inventory Systems
• Stochastic Inventory Models with Limited Production Capacity and Periodically Varying Parameters
• Semi-Markov Decision Processes with Unbounded Rewards

This page was built for publication: The value iteration method for countable state Markov decision processes