Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces

DOI10.1287/moor.1060.0210zbMath1278.90426OpenAlexW2150606382MaRDI QIDQ5388016

Xianping Guo

Publication date: 27 May 2008

Published in: Mathematics of Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/moor.1060.0210

zbMATH Keywords

optimal stationary policydiscounted rewardgeneral state spaceq-process

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Related Items (31)

Average stochastic games for continuous-time jump processes ⋮ Risk sensitive control of pure jump processes on a general state space ⋮ Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces ⋮ Asymptotic optimality and rates of convergence of quantized stationary policies in continuous-time Markov decision processes ⋮ Strong \(n\)-discount and finite-horizon optimality for continuous-time Markov decision processes ⋮ The risk probability criterion for discounted continuous-time Markov decision processes ⋮ The transformation method for continuous-time Markov decision processes ⋮ Average sample-path optimality for continuous-time Markov decision processes in Polish spaces ⋮ An average-value-at-risk criterion for Markov decision processes with unbounded costs ⋮ Construction and regularity of transition functions on Polish spaces under measurability conditions ⋮ Bias and Overtaking Optimality for Continuous-Time Jump Markov Decision Processes in Polish Spaces ⋮ Verifiable conditions for average optimality of continuous-time Markov decision processes ⋮ Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach ⋮ Discounted continuous-time constrained Markov decision processes in Polish spaces ⋮ Denumerable continuous-time Markov decision processes with multiconstraints on average costs ⋮ Continuous-time Markov decision processes with state-dependent discount factors ⋮ New optimality conditions for average-payoff continuous-time Markov games in Polish spaces ⋮ Zero-sum games for continuous-time jump Markov processes in Polish spaces: discounted payoffs ⋮ Variance minimization for continuous-time Markov decision processes: two approaches ⋮ Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates ⋮ Note on discounted continuous-time Markov decision processes with a lower bounding function ⋮ Unnamed Item ⋮ New sufficient conditions for average optimality in continuous-time Markov decision processes ⋮ Multiobjective Stopping Problem for Discrete-Time Markov Processes: Convex Analytic Approach ⋮ New discount and average optimality conditions for continuous-time Markov decision processes ⋮ On the nonexplosion and explosion for nonhomogeneous Markov pure jump processes ⋮ Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates ⋮ Zero-sum games for pure jump processes with risk-sensitive discounted cost criteria ⋮ Average optimality for continuous-time Markov decision processes under weak continuity conditions ⋮ On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes ⋮ Unnamed Item

This page was built for publication: Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces