Practical solution techniques for first-order MDPs

DOI10.1016/J.ARTINT.2008.11.003MaRDI QIDQ835833zbMATH OpenOpenAlexFDO

Authors Scott Sanner, Craig Boutilier

Publication date 31 August 2009

Published in Artificial Intelligence (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.artint.2008.11.003

zbMATH Keywords

first-order logicMDPsplanning

Mathematics Subject Classification ID

Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.) (68T20) Markov and semi-Markov decision processes (90C40)

Recommendations

• First order decision diagrams for relational MDPS
• Approximate linear programming for first-order MDPs
• Probabilistic relational planning with first order decision diagrams
• Decision-theoretic planning with generalized first-order decision diagrams
• Flucap: a heuristic search planner for first-order MDPS

Cites work

• Abstraction and approximate decision-theoretic planning.
• Approximate linear programming for first-order MDPs
• Approximate policy iteration with a policy language bias: solving relational Markov decision processes
• Bucket elimination: A unifying framework for reasoning
• Feature-based methods for large scale dynamic programming
• First order decision diagrams for relational MDPS
• Flucap: a heuristic search planner for first-order MDPS
• Generalized polynomial approximations in Markovian decision processes
• GOLOG: A logic programming language for dynamic domains
• Graph kernels and Gaussian processes for relational reinforcement learning
• scientific article; zbMATH DE number 1809861 (Why is no real title available?)
• scientific article; zbMATH DE number 3126094 (Why is no real title available?)
• scientific article; zbMATH DE number 3148886 (Why is no real title available?)
• scientific article; zbMATH DE number 5547823 (Why is no real title available?)
• scientific article; zbMATH DE number 89002 (Why is no real title available?)
• scientific article; zbMATH DE number 1206370 (Why is no real title available?)
• scientific article; zbMATH DE number 1315585 (Why is no real title available?)
• scientific article; zbMATH DE number 1321699 (Why is no real title available?)
• scientific article; zbMATH DE number 700091 (Why is no real title available?)
• scientific article; zbMATH DE number 1149408 (Why is no real title available?)
• scientific article; zbMATH DE number 2000828 (Why is no real title available?)
• scientific article; zbMATH DE number 1820675 (Why is no real title available?)
• scientific article; zbMATH DE number 2243413 (Why is no real title available?)
• scientific article; zbMATH DE number 2243416 (Why is no real title available?)
• Influence of modeling structure in probabilistic sequential decision problems
• Integrating guidance into relational reinforcement learning
• Learning action strategies for planning domains
• Learning to take actions
• Practical solution techniques for first-order MDPs
• Reasoning about noisy sensors and effectors in the situation calculus
• Relational reinforcement learning
• Solving factored mdps with hybrid state and action variables
• Stochastic Games
• STRIPS: A new approach to the application of theorem proving to problem solving
• The factored policy-gradient planner
• The FF planning system: Fast plan generation through heuristic search
• The independent choice logic for modelling multiple agents under uncertainty
• The Linear Programming Approach to Approximate Dynamic Programming
• Using temporal logics to express search control knowledge for planning

Cited in

(23)

• Structured machine learning: the next ten years
• Discovering hidden structure in factored MDPs
• Lifted model checking for relational MDPs
• Weighted model counting without parameter variables
• Probabilistic relational planning with first order decision diagrams
• Bridging the gap between reinforcement learning and knowledge representation: a logical off- and on-policy framework
• Approximate policy iteration with a policy language bias: solving relational Markov decision processes
• Flucap: a heuristic search planner for first-order MDPS
• First order decision diagrams for relational MDPS
• Intensional dynamic programming. A rosetta stone for structured dynamic programming
• Decision-theoretic planning with generalized first-order decision diagrams
• scientific article; zbMATH DE number 2000828 (Why is no real title available?)
• Elaboration Tolerant Representation of Markov Decision Process via Decision-Theoretic Extension of Probabilistic Action Language +
• A Comprehensive Framework for Learning Declarative Action Models
• Relational linear programming
• Qualitative numeric planning: reductions and complexity
• Approximate linear programming for first-order MDPs
• Hierarchical decompositions and termination analysis for generalized planning
• Generalized planning as heuristic search: a new planning search-space that leverages pointers over objects
• A framework for belief-based programs and their verification
• The factored policy-gradient planner
• Practical solution techniques for first-order MDPs
• The complexity of reasoning with FODD and GFODD

Describes a project that uses

Uses Software

• GOLOG
• VAMPIRE
• Graphplan
• FODD-Planner
• FluCaP
• NMRDPP

This page was built for publication: Practical solution techniques for first-order MDPs

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q835833)