An optimal threshold policy in applications of a two-state Markov process

DOI10.1007/978-3-319-00669-7_11MaRDI QIDQ4979409zbMATH OpenOpenAlexFDO

Authors Eugene Khmelnitsky

Publication date 20 June 2014

Published in International Series in Operations Research & Management Science (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/978-3-319-00669-7_11

zbMATH Keywords

necessary optimality conditionsoptimal threshold policyregular and singular control regimesstate-costate dynamicstwo-state Markov process

Mathematics Subject Classification ID

Optimality conditions for problems involving randomness (49K45) Applications of optimal control and differential games (49N90) Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20)

Recommendations

• Optimal control of the two-state Markov process in discrete time
• scientific article; zbMATH DE number 1424150
• Markov decision processes associated with two threshold probability criteria
• Optimal threshold probability and policy iteration in semi-Markov decision processes
• Optimal control of Markov processes with age-dependent transition rates

Cites work

• A Survey of the Maximum Principles for Optimal Control Problems with State Constraints
• Balancing facilities in aggregate production planning: Make-to-order and make-to-stock environments
• scientific article; zbMATH DE number 52107 (Why is no real title available?)
• scientific article; zbMATH DE number 1734433 (Why is no real title available?)
• Occupation times and Bessel densities
• On temporally completely monotone functions for Markov processes
• Optimal control of production rate in a failure prone manufacturing system
• Optimal feedback production planning in a stochastic \(N\)-machine flowshop
• Optimal investment, stochastic labor income and retirement
• Optimal production control of a failure-prone machine

Cited in

(4)

• Optimal threshold probability in undiscounted Markov decision processes with a target set.
• Optimal control of the two-state Markov process in discrete time
• scientific article; zbMATH DE number 2041503 (Why is no real title available?)
• Symbolic and Quantitative Approaches to Reasoning with Uncertainty

This page was built for publication: An optimal threshold policy in applications of a two-state Markov process

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4979409)