Flucap: a heuristic search planner for first-order MDPS We present a heuristic search algorithm for solving First-Order Markov Decision Processes (FOMDPs). Our approach combines first-order state abstraction that avoids evaluating states individually, and heuristic search that avoids evaluating all states. Firstly, in contrast to existing systems, which start with propositionalizing the FOMDP and then perform state abstraction on its propositionalized version we apply state abstraction directly on the FOMDP avoiding propositionalization. This kind of abstraction is referred to as first-order state abstraction. Secondly, guided by an admissible heuristic, the search is restricted to those states that are reachable from the initial state. We demonstrate the usefulness of the above techniques for solving FOMDPs with a system, referred to as FluCaP (formerly, FCPlanner), that entered the probabilistic track of the 2004 International Planning Competition (IPC’2004) and demonstrated an advantage over other planners on the problems represented in first-order terms.
Keywords for this software
References in zbMATH (referenced in 11 articles , 1 standard article )
Showing results 1 to 11 of 11.
- Artikis, Alexander; Makris, Evangelos; Paliouras, Georgios: A probabilistic interval-based event calculus for activity recognition (2021)
- Nitti, Davide; Belle, Vaishak; De Laet, Tinne; De Raedt, Luc: Planning in hybrid relational MDPs (2017)
- Hescott, Benjamin J.; Khardon, Roni: The complexity of reasoning with FODD and GFODD (2015)
- Skarlatidis, Anastasios; Paliouras, Georgios; Artikis, Alexander; Vouros, George A.: Probabilistic event calculus for event recognition (2015)
- Joshi, Saket; Kersting, Kristian; Khardon, Roni: Decision-theoretic planning with generalized first-order decision diagrams (2011)
- Joshi, S.; Khardon, R.: Probabilistic relational planning with first order decision diagrams (2011)
- Wu, Jia-Hong; Givan, Robert: Automatic induction of Bellman-error features for probabilistic planning (2010)
- Sanner, Scott; Boutilier, Craig: Practical solution techniques for first-order MDPs (2009)
- van Otterlo, Martijn: The logic of adaptive behavior. Knowledge representation and algorithms for adaptive sequential decision making under uncertainty in first-order and relational domains. (2009)
- Wang, C.; Joshi, S.; Khardon, R.: First order decision diagrams for relational MDPS (2008)
- Hoelldobler, S.; Karabaev, E.; Skvortsova, O.: Flucap: a heuristic search planner for first-order MDPS (2006)