Conditions for the uniqueness of optimal policies of discounted Markov decision processes

DOI10.1007/s001860400372zbMath1104.90053OpenAlexW2088705090MaRDI QIDQ2386346

Francisco Sergio Salem-Silva, Daniel Cruz-Suárez, Raúl Montes-De-oca

Publication date: 22 August 2005

Published in: Mathematical Methods of Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s001860400372

zbMATH Keywords

ConvexityStochastic orderDiscounted Markov decision processesUniqueness of optimal policies

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Markov and semi-Markov decision processes (90C40)

Related Items

Unnamed Item ⋮ Unnamed Item ⋮ Nonuniqueness versus uniqueness of optimal policies in convex discounted Markov decision processes ⋮ Approximate stochastic annealing for online control of infinite horizon Markov decision processes ⋮ A version of the Euler equation in discounted Markov decision processes ⋮ Detection-averse optimal and receding-horizon control for Markov decision processes ⋮ An envelope theorem and some applications to discounted Markov decision processes ⋮ Unnamed Item ⋮ Stackelberg equilibrium in a dynamic stimulation model with complete information ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Unnamed Item ⋮ A note on deterministic approximation of discounted Markov decision processes ⋮ Semi-Markov decision processes with variance minimization criterion ⋮ A Moreau-Yosida regularization for Markov decision processes