Some Monotonicity Results for Partially Observed Markov Decision Processes

DOI10.1287/OPRE.35.5.736MaRDI QIDQ3793968zbMATH OpenOpenAlexFDO

Authors William S. Lovejoy

Publication date 1987

Published in Operations Research (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1287/opre.35.5.736

zbMATH Keywords

discrete-time, partially observed Markov decision processfinite and ordered sets of states, actions and observationsfinite horizoninfinite horizonmonotonicity resultsoptimal policy

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Recommendations

• Monotonicity properties for two-action partially observable Markov decision processes on partially ordered spaces
• Structural results for partially observed control models
• Partially observable Markov decision processes and periodic policies with applications
• Structural properties for contracting state partially observable Markov decision processes
• scientific article; zbMATH DE number 14315

Cited in

(26)

• Some structured dynamic programs arising in economics
• Structural properties for contracting state partially observable Markov decision processes
• Optimal policies under risk for changing software systems based on customer satisfaction
• Ambiguous partially observable Markov decision processes: structural results and applications
• A model of project evaluation with limited attention
• Partially observed Markov decision processes with binomial observations
• The effect of multi-sensor data on condition-based maintenance policies
• Optimizing active surveillance for prostate cancer using partially observable Markov decision processes
• Monotonicity properties for two-action partially observable Markov decision processes on partially ordered spaces
• A survey of algorithmic methods for partially observed Markov decision processes
• On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes
• Myopic bounds for optimal policy of POMDPs: an extension of lovejoy's structural results
• Multistate Bayesian control chart over a finite horizon
• A Stochastic Ordering and Related Sequential Decision Problems
• Optimal Threshold Policies for Multivariate Stopping-Time POMDPs
• Monotonicity in a Markov Decision Process
• scientific article; zbMATH DE number 14315 (Why is no real title available?)
• Structural results for partially observed control models
• Stochastic allocation of inspection capacity to competitive processes
• Patient-type Bayes-adaptive treatment plans
• Optimal control of partially observable semi-Markovian failing systems: an analysis using a phase methodology
• Monotonic properties for a sequential decision problem with partial maintenance on a Markov process
• Monotonicity in Markov Reward and Decision Chains: Theory and Applications
• Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations
• Fifty years of decision analysis in operational research: a review
• Modified monotone policy iteration for interpretable policies in Markov decision processes and the impact of state ordering rules

This page was built for publication: Some Monotonicity Results for Partially Observed Markov Decision Processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3793968)