Bias optimality versus strong 0-discount optimality in Markov control processes with unbounded costs

DOI10.1023/A:1024996308133MaRDI QIDQ1408677zbMATH OpenOpenAlexFDO

Authors Nadine Hilgert, Onésimo Hernández-Lerma

Publication date 25 September 2003

Published in Acta Applicandae Mathematicae (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1023/a:1024996308133

zbMATH Keywords

average costbias optimalitydiscount-sensitive criteriaMarkov control processes

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Optimal stochastic control (93E20)

Review text

Discrete-time Markov control problems on Borel spaces are studied under the aspects of optimality w.r.t. expected average cost, discount-sensitive criteria, and bias. The relation of the results on the different problems is explained and an example illustrates the usefulness of the results.

Recommendations

• Bias optimality and strong n (n= -1,0) discount optimality for Markov decision processes
• Ergodic Control, Bias, and Sensitive Discount Optimality for Markov Diffusion Processes
• scientific article; zbMATH DE number 179178
• Another Set of Conditions for Strongn(n = −1, 0) Discount Optimality in Markov Decision Processes
• scientific article; zbMATH DE number 729193

Cited in

(13)

• Bias optimality and strong n (n= -1,0) discount optimality for Markov decision processes
• Sample-path optimality and variance-maximization for Markov decision processes
• Blackwell optimality in the class of Markov policies for continuous-time controlled Markov chains
• Discount-sensitive equilibria in zero-sum stochastic differential games
• Ergodic Control, Bias, and Sensitive Discount Optimality for Markov Diffusion Processes
• scientific article; zbMATH DE number 179178 (Why is no real title available?)
• A probabilistic analysis of bias optimality in unichain Markov decision processes
• Asymptotic normality of discrete-time Markov control processes
• Constrained Markov decision processes in Borel spaces: from discounted to average optimality
• Blackwell Optimality for Controlled Diffusion Processes
• Another Set of Conditions for Strongn(n = −1, 0) Discount Optimality in Markov Decision Processes
• Strong n-discount and finite-horizon optimality for continuous-time Markov decision processes
• A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)

This page was built for publication: Bias optimality versus strong 0-discount optimality in Markov control processes with unbounded costs

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1408677)