A note on optimality conditions for continuous-time Markov decision processes with average cost criterion

DOI10.1109/9.975505zbMath1017.90120OpenAlexW2098000180MaRDI QIDQ4540283

Xianping Guo, Ke Liu

Publication date: 21 July 2002

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1109/9.975505

zbMATH Keywords

existence of optimal stationary policies

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Markov and semi-Markov decision processes (90C40)

Related Items (17)

Continuous-time controlled Markov chains. ⋮ Constrained Continuous-Time Markov Control Processes with Discounted Criteria ⋮ Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates ⋮ Strong \(n\)-discount and finite-horizon optimality for continuous-time Markov decision processes ⋮ Average sample-path optimality for continuous-time Markov decision processes in Polish spaces ⋮ Bias and Overtaking Optimality for Continuous-Time Jump Markov Decision Processes in Polish Spaces ⋮ Total reward criteria for unconstrained/constrained continuous-time Markov decision processes ⋮ Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs ⋮ Average optimality for continuous-time Markov decision processes with a policy iteration approach ⋮ Average optimality inequality for continuous-time Markov decision processes in Polish spaces ⋮ Continuous-time Markov decision processes with \(n\)th-bias optimality criteria ⋮ Constrained continuous-time Markov decision processes with average criteria ⋮ A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) ⋮ Average optimality for continuous-time Markov decision processes in Polish spaces ⋮ Zero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates ⋮ Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates ⋮ Average optimality for continuous-time Markov decision processes under weak continuity conditions

This page was built for publication: A note on optimality conditions for continuous-time Markov decision processes with average cost criterion