SEMI-MARKOV DECISION PROCESSES

DOI10.1017/S026996480700037XMaRDI QIDQ5433644zbMATH OpenOpenAlexFDO

Authors

Publication date 9 January 2008

Published in Probability in the Engineering and Informational Sciences (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1017/s026996480700037x

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Recommendations

• Variability Sensitive Markov Decision Processes
• scientific article; zbMATH DE number 2189774
• Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces
• Semi-Markov decision processes with a reachable state-subset
• Constrained Semi-Markov decision processes with average rewards

Cites work

• Asymptotic properties of constrained Markov Decision Processes
• Average cost semi-markov decision processes
• Constrained Semi-Markov decision processes with average rewards
• Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion
• Markov Renewal Programming by Linear Fractional Programming
• Multichain Markov Renewal Programs
• On Average Reward Semi-Markov Decision Processes with a General Multichain Structure
• On Semi-Markov Controlled Models with an Average Reward Criterion
• Optimal decision procedures for finite Markov chains. Part II: Communicating systems
• Optimal policies for controlled Markov chains with a constraint
• Programming with linear fractional functionals
• The analytic methods of operations research
• The optimality equation in average cost denumerable state semi-Markov decision problems, recurrency conditions and algorithms
• Time-average optimal constrained semi-Markov decision processes
• Uniformization for semi-Markov decision processes under stationary policies

Cited in

(18)

• Semi-Markov decision processes with limiting ratio average rewards
• Special subclass of generalized semi-Markov decision processes with discrete time
• Computing semi-stationary optimal policies for multichain semi-Markov decision processes
• A decentralized partially observable Markov decision model with action duration for goal recognition in real time strategy games
• Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces
• Optimality of quasi-open-loop policies for discounted semi-Markov decision processes
• On undiscounted semi-Markov decision processes with absorbing states
• Uniformization for semi-Markov decision processes under stationary policies
• An inequality for variances of the discounted rewards
• scientific article; zbMATH DE number 5719844 (Why is no real title available?)
• Variance minimization for constrained discounted continuous-time MDPs with exponentially distributed stopping times
• Semi-Markov decision processes with a reachable state-subset
• Variability Sensitive Markov Decision Processes
• Semi-Markov and reward fields
• A survey on semi-Markov decision processes
• A Poisson equation for the risk-sensitive average cost in semi-Markov chains
• Average criteria in denumerable semi-Markov decision chains under risk-aversion
• A Hemimetric Extension of Simulation for Semi-Markov Decision Processes

This page was built for publication: SEMI-MARKOV DECISION PROCESSES

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5433644)