Approximate dynamic programming with state aggregation applied to UAV perimeter patrol

DOI10.1002/rnc.1686zbMath1244.90237MaRDI QIDQ2903989

Kalyanam Krishnamoorthy, Phillip R. Chandler, Meir Pachter, Swaroop Darbha

Publication date: 4 August 2012

Published in: International Journal of Robust and Nonlinear Control (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1002/rnc.1686

zbMATH Keywords

approximate dynamic programming; state aggregation; controlled Markov chain; perimeter patrol

Mathematics Subject Classification ID

93C95: Application models in control theory

90C39: Dynamic programming

93E20: Optimal stochastic control

Related Items

State partitioning based linear program for stochastic dynamic programs: an invariance property, Cooperative control of autonomous systems, Approximate dynamic programming with state aggregation applied to UAV perimeter patrol

Cites Work

• Unnamed Item
• State aggregation in dynamic programming - an application to scheduling of independent jobs on parallel processors
• Generalized polynomial approximations in Markovian decision processes
• A modified dynamic programming method for Markovian decision problems
• Linear Programming and Sequential Decisions
• Approximate dynamic programming with state aggregation applied to UAV perimeter patrol
• Aggregation in Dynamic Programming
• Adaptive aggregation methods for infinite horizon dynamic programming
• Linear Programming and Markov Decision Chains
• An Iterative Aggregation Procedure for Markov Decision Processes
• Bounds and Transformations for Discounted Finite Markov Decision Chains
• Approximate Dynamic Programming
• Performance Loss Bounds for Approximate Value Iteration with State Aggregation