A value-iteration scheme for undiscounted multichain Markov renewal programs

DOI10.1007/BF01920916zbMath0557.90104MaRDI QIDQ3221782

Paul J. Schweitzer

Publication date: 1984

Published in: Zeitschrift für Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf01920916

zbMATH Keywords

policy iteration; hierarchical decomposition; finite sets of states and actions; multi-chain case; undiscounted Markov renewal programs; value-iteration scheme

Mathematics Subject Classification ID

90C40: Markov and semi-Markov decision processes

Related Items

An algorithm for Ph/Ph/c queues, Markov property for a function of a Markov chain: A linear algebra approach, A value iteration method for undiscounted multichain Markov decision processes

Cites Work

• Nonstationary Markov decision problems with converging parameters
• Foolproof convergence in multichain policy iteration
• Iterative solution of the functional equations of undiscounted Markov renewal programming
• A Dynamic Programming Algorithm for Embedded Markov Chains when the Planning Horizon is at Infinity
• A Fixed Point Approach to Undiscounted Markov Renewal Programs
• Linear Programming and Markov Decision Chains
• A New Specification of the Multichain Policy Iteration Algorithm in Undiscounted Markov Renewal Programs
• Technical Note—Improved Conditions for Convergence in Undiscounted Markov Renewal Programming
• The Functional Equations of Undiscounted Markov Renewal Programming
• Geometric convergence of value-iteration in multichain Markov decision problems
• Markov-Renewal Programming. I: Formulation, Finite Return Models
• On Finding Optimal Policies in Discrete Dynamic Programming with No Discounting
• Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix
• Multichain Markov Renewal Programs
• Optimal decision procedures for finite markov chains. Part I: Examples