Technical Note—Identifying Forecast Horizons in Nonhomogeneous Markov Decision Processes

DOI10.1287/OPRE.37.2.339MaRDI QIDQ4729637zbMATH OpenOpenAlexFDO

Authors Wallace J. Hopp

Publication date 1989

Published in Operations Research (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1287/opre.37.2.339

zbMATH Keywords

nonhomogeneous Markov decision processesforecast horizonsepsilon optimalityKarkov finite staterelative value functions

Mathematics Subject Classification ID

Dynamic programming (90C39) Markov and semi-Markov decision processes (90C40)

Recommendations

• Forecast horizon in nonstationary Markov decision problems
• A Stopping Rule for Forecasting Horizons in Nonhomogeneous Markov Decision Processes
• The forecast horizon in discounted Markov decision processes: a panoramic view
• Solution and Forecast Horizons for Infinite-Horizon Nonhomogeneous Markov Decision Processes
• A forecast horizon and a stopping rule for general Markov decision processes
• Markovian Forecast Processes
• Decision and forecast horizons in a stochastic environment: A survey
• Forecasting with non-homogeneous hidden Markov models
• Forecasting with non-homogeneous hidden Markov models
• Concepts of Forecast and Decision Horizons: Applications to Dynamic Stochastic Optimization Problems

Cited in

(14)

• Solution and Forecast Horizons for Infinite-Horizon Nonhomogeneous Markov Decision Processes
• Sensitivity analysis in discrete dynamic programming
• The infinite horizon non-stationary stochastic inventory problem: Near myopic policies and weak ergodicity
• A Stopping Rule for Forecasting Horizons in Nonhomogeneous Markov Decision Processes
• Conditions for the discovery of solution horizons
• A model for equipment replacement due to technological obsolescence
• Markovian Forecast Processes
• Resource-constrained management of heterogeneous assets with stochastic deterioration
• To protect or not to protect: Bayes decisions with forecasts
• Forecast horizon in nonstationary Markov decision problems
• Denumerable state nonhomogeneous Markov decision processes
• Dual Ascent and Primal-Dual Algorithms for Infinite-Horizon Nonstationary Markov Decision Processes
• scientific article; zbMATH DE number 3978864 (Why is no real title available?)
• A forecast horizon and a stopping rule for general Markov decision processes

This page was built for publication: Technical Note—Identifying Forecast Horizons in Nonhomogeneous Markov Decision Processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4729637)