Value iteration in a class of average controlled Markov chains with unbounded costs: necessary and sufficient conditions for pointwise convergence

DOI10.2307/3214980zbMath0869.93054OpenAlexW4255849103MaRDI QIDQ3122864

Emmanuel Fernández-Gaucherand, Rolando Cavazos-Cadena

Publication date: 5 March 1997

Published in: Journal of Applied Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.2307/3214980

zbMATH Keywords

necessary and sufficient optimality conditions average cost Lyapunov condition controlled Markov chain

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Markov and semi-Markov decision processes (90C40)

Related Items (6)

Continuous-time controlled Markov chains. ⋮ Approximation of average cost optimal policies for general Markov decision processes with unbounded costs ⋮ Time-average optimal constrained semi-Markov decision processes ⋮ A pause control approach to the value iteration scheme in average Markov decision processes ⋮ A note on the convergence rate of the value iteration scheme in controlled Markov chains ⋮ STRONG AVERAGE OPTIMALITY FOR CONTROLLED NONHOMOGENEOUS MARKOV CHAINS^*

This page was built for publication: Value iteration in a class of average controlled Markov chains with unbounded costs: necessary and sufficient conditions for pointwise convergence