Handbook of Markov decision processes. Methods and applications (Q5954951)

The articles of this volume will be reviewed individually. Indexed articles: \textit{Feinberg, Eugene A.; Shwartz, Adam}, Introduction, 1-15 [Zbl 1014.90105] \textit{Kallenberg, Lodewijk}, Finite state and action MDPs, 21-87 [Zbl 1004.90063] \textit{Lewis, Mark E.; Puterman, Martin L.}, Bias optimality, 89-111 [Zbl 1014.90109] \textit{Avrachenkov, Konstantin E.; Filar, Jerzy; Haviv, Moshe}, Singular perturbations of Markov chains and decision processes, 113-150 [Zbl 1014.90108] \textit{Sennott, Linn I.}, Average reward optimization theory for denumerable state spaces, 153-172 [Zbl 1008.90068] \textit{Feinberg, Eugene A.}, Total reward criteria, 173-207 [Zbl 1014.90107] \textit{Feinberg, Eugene A.; Shwartz, Adam}, Mixed criteria, 209-230 [Zbl 1014.90106] \textit{Hordijk, Arie; Yushkevich, Alexander A.}, Blackwell optimality, 233-267 [Zbl 1024.90068] \textit{Makowski, Armand M.; Shwartz, Adam}, The Poisson equation for countable Markov chains: Probabilistic methods and interpretations, 269-303 [Zbl 1014.90111] \textit{Meyn, Sean P.}, Stability, performance evaluation, and optimization, 305-346 [Zbl 1003.90041] \textit{Borkar, Vivek S.}, Convex analytic methods in Markov decision processes, 341-375 [Zbl 1003.90048] \textit{Hernández-Lerma, Onésimo; Lasserre, Jean B.}, The linear programming approach, 377-407 [Zbl 1038.90051] \textit{Dubins, Lester E.; Maitra, Ashok P.; Sudderth, William D.}, Invariant gambling problems and Markov decision processes, 409-428 [Zbl 1014.90112] \textit{van Roy, Benjamin}, Neuro-dynamic programming: Overview and recent trends, 431-459 [Zbl 1014.90104] \textit{Schäl, Manfred}, Markov decision processes in finance and dynamic options, 461-487 [Zbl 1133.90416] \textit{Altman, Eitan}, Applications of Markov decision processes in communication networks, 489-536 [Zbl 1003.90049] \textit{Lamond, Bernard F.; Boukhtouta, Abdeslem}, Water reservoir applications of Markov decision processes, 537-558 [Zbl 1003.90051]