Partially observable Markov decision process approximations for adaptive sensing

DOI10.1007/S10626-009-0071-XMaRDI QIDQ977009zbMATH OpenOpenAlexFDO

Authors Edwin K. P. Chong, Christopher M. Kreucher, Alfred O. III Hero

Publication date 16 June 2010

Published in Discrete Event Dynamic Systems (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s10626-009-0071-x

zbMATH Keywords

Markov decision processschedulingtrackingsensingPOMDP

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Stochastic scheduling theory in operations research (90B36)

Recommendations

• Partially observed Markov decision processes. From filtering to controlled sensing
• Constrained Partially Observed Markov Decision Processes With Probabilistic Criteria for Adaptive Sequential Detection
• Nonmyopic Multiaspect Sensing With Partially Observable Markov Decision Processes
• Markov decision processes with sequential sensor measurements
• Partially Observable Risk-Sensitive Markov Decision Processes
• Partially observable Markov decision processes with imprecise parameters
• Partially observable Markov decision processes incorporating
• scientific article; zbMATH DE number 4172885
• On the adaptive control of a class of partially observed Markov decision processes

Cites work

• scientific article; zbMATH DE number 3126094 (Why is no real title available?)
• scientific article; zbMATH DE number 2061746 (Why is no real title available?)
• scientific article; zbMATH DE number 2243378 (Why is no real title available?)
• A POMDP framework for coordinated guidance of autonomous UAVs for multitarget tracking
• A first course in stochastic models.
• A new algorithm for stochastic discrete resource allocation optimization
• A survey of algorithmic methods for partially observed Markov decision processes
• Approximate Dynamic Programming
• Burst-level congestion control using hindsight optimization
• Computationally Feasible Bounds for Partially Observed Markov Decision Processes
• Constrained Markov decision processes with total cost criteria: Lagrangian approach and dual linear program
• Nonmyopic Multiaspect Sensing With Partially Observable Markov Decision Processes
• Nonmyopic sensor scheduling and its efficient implementation for target tracking applications
• On Constraint Sampling in the Linear Programming Approach to Approximate Dynamic Programming
• Parallel rollout for online solution of partially observable Markov decision processes
• Planning and acting in partially observable stochastic domains
• Rollout algorithms for stochastic scheduling problems
• Sensor management using an active sensing approach
• The Linear Programming Approach to Approximate Dynamic Programming
• The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
• Using Randomization to Break the Curse of Dimensionality

Cited in

(7)

• UTS-based foresight optimization of sensor scheduling for low interception risk tracking
• Partially observed Markov decision processes. From filtering to controlled sensing
• Sensor management using an active sensing approach
• Planning for multiple measurement channels in a continuous-state POMDP
• Optimal Sensor Querying: General Markovian and LQG Models With Controlled Observations
• Active sensing policies for stochastic systems
• scientific article; zbMATH DE number 2177605 (Why is no real title available?)

Describes a project that uses

Uses Software

• POMDPS
• MCQueue

This page was built for publication: Partially observable Markov decision process approximations for adaptive sensing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q977009)