Arbitrary state semi-Markov decision processes

DOI10.1080/02331938708843260MaRDI QIDQ3768705zbMATH OpenOpenAlexFDO

Authors Kazuyoshi Wakuta

Publication date 1987

Published in Optimization (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1080/02331938708843260

zbMATH Keywords

existence of an optimal stationary policysemi- Markov decision processestotal discounted rewardsunbounded rewardsuncountable state and action spaces

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Recommendations

• On the expected total reward with unbounded returns for Markov decision processes
• Controlled semi-Markov models - the discounted case
• scientific article; zbMATH DE number 1536370
• Vector-valued semi-Markovian decision programming
• scientific article; zbMATH DE number 3898637

Cites work

• Average cost semi-markov decision processes
• Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
• Discounted Dynamic Programming
• scientific article; zbMATH DE number 3320878 (Why is no real title available?)
• scientific article; zbMATH DE number 3338194 (Why is no real title available?)
• Markovian Decision Processes with Compact Action Spaces
• Note—A Note on Dynamic Programming with Unbounded Rewards
• On Dynamic Programming with Unbounded Rewards
• Optimal Plans for Dynamic Programming Problems
• Semi-Markov decision processes with polynomial reward

Cited in

(17)

• On the expected total reward with unbounded returns for Markov decision processes
• Average cost optimal policies for Markov control processes with Borel state space and unbounded costs
• Admission control in a two-class loss system with periodically varying parameters and abandonments
• Semi-Markov decision processes with variance minimization criterion
• Optimal control of Markov processes with age-dependent transition rates
• The Borel state space semi-Markov decision process with expected total rewards in a semi-Markov environment
• Optimality of quasi-open-loop policies for discounted semi-Markov decision processes
• On undiscounted semi-Markov decision processes with absorbing states
• A semi-Markov inventory control model
• Existence of Optimal Policies for Semi-Markov Decision Processes Using Duality for Infinite Linear Programming
• scientific article; zbMATH DE number 3898637 (Why is no real title available?)
• On undiscounted markovian decision processes with compact action spaces
• scientific article; zbMATH DE number 3969813 (Why is no real title available?)
• scientific article; zbMATH DE number 4003943 (Why is no real title available?)
• On the Second Optimality Equation for Semi-Markov Decision Models
• The exponential utility optimality for infinite horizon semi-Markov decision processes
• Performance analysis for controlled semi-Markov systems with application to maintenance

This page was built for publication: Arbitrary state semi-Markov decision processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3768705)