A value-iteration scheme for undiscounted multichain Markov renewal programs
From MaRDI portal
Publication:3221782
DOI10.1007/BF01920916zbMath0557.90104MaRDI QIDQ3221782
Publication date: 1984
Published in: Zeitschrift für Operations Research (Search for Journal in Brave)
policy iteration; hierarchical decomposition; finite sets of states and actions; multi-chain case; undiscounted Markov renewal programs; value-iteration scheme
90C40: Markov and semi-Markov decision processes
Related Items
An algorithm for Ph/Ph/c queues, Markov property for a function of a Markov chain: A linear algebra approach, A value iteration method for undiscounted multichain Markov decision processes
Cites Work
- Nonstationary Markov decision problems with converging parameters
- Foolproof convergence in multichain policy iteration
- Iterative solution of the functional equations of undiscounted Markov renewal programming
- A Dynamic Programming Algorithm for Embedded Markov Chains when the Planning Horizon is at Infinity
- A Fixed Point Approach to Undiscounted Markov Renewal Programs
- Linear Programming and Markov Decision Chains
- A New Specification of the Multichain Policy Iteration Algorithm in Undiscounted Markov Renewal Programs
- Technical Note—Improved Conditions for Convergence in Undiscounted Markov Renewal Programming
- The Functional Equations of Undiscounted Markov Renewal Programming
- Geometric convergence of value-iteration in multichain Markov decision problems
- Markov-Renewal Programming. I: Formulation, Finite Return Models
- On Finding Optimal Policies in Discrete Dynamic Programming with No Discounting
- Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix
- Multichain Markov Renewal Programs
- Optimal decision procedures for finite markov chains. Part I: Examples
