Skip to main content
Top
Published in: Journal of Automated Reasoning 6/2021

16-06-2021

On the Importance of Domain Model Configuration for Automated Planning Engines

Authors: Mauro Vallati, Lukáš Chrpa, Thomas Leo McCluskey, Frank Hutter

Published in: Journal of Automated Reasoning | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The development of domain-independent planners within the AI planning community is leading to “off-the-shelf” technology that can be used in a wide range of applications. Moreover, it allows a modular approach—in which planners and domain knowledge are modules of larger software applications—that facilitates substitutions or improvements of individual modules without changing the rest of the system. This approach also supports the use of reformulation and configuration techniques, which transform how a model is represented in order to improve the efficiency of plan generation. In this article, we investigate how the performance of domain-independent planners is affected by domain model configuration, i.e. the order in which elements are ordered in the model, particularly in the light of planner comparisons. We then introduce techniques for the online and offline configuration of domain models, and we analyse the impact of domain model configuration on other reformulation approaches, such as macros.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
2
We found optimising for median performance to not be a good idea, since it can yield configurations that work very well on 51% of the instances but extremely poorly on others; in contrast, the mean is often quite dominated by the worst cases, and optimising it therefore also reduces the failure rate. Our performance metric m can also already penalise failures substantially, allowing us to use Eq. 1 to truly minimise the failure rate and only break ties by the average performance in non-failure cases.
 
3
This is due to their grounding, as macros tend to have many parameters derived from the encapsulated operators, and add to the increased branching factor of the search space.
 
Literature
1.
go back to reference Ai-Chang, M., Bresina, J., Charest, L., Chase, A., Hsu, J.C.-J., Jonsson, A., Kanefsky, B., Morris, P., Rajan, K., Yglesias, J., et al.: Mapgen: mixed-initiative planning and scheduling for the mars exploration rover mission. IEEE Intell. Syst. 19(1), 8–12 (2004)CrossRef Ai-Chang, M., Bresina, J., Charest, L., Chase, A., Hsu, J.C.-J., Jonsson, A., Kanefsky, B., Morris, P., Rajan, K., Yglesias, J., et al.: Mapgen: mixed-initiative planning and scheduling for the mars exploration rover mission. IEEE Intell. Syst. 19(1), 8–12 (2004)CrossRef
2.
go back to reference Ansótegui, C., Sellmann, M., Tierney, K.: A gender-based genetic algorithm for the automatic configuration of algorithms. In: Proceedings of the Principles and Practice of Constraint Programming (CP), pp. 142–157 (2009) Ansótegui, C., Sellmann, M., Tierney, K.: A gender-based genetic algorithm for the automatic configuration of algorithms. In: Proceedings of the Principles and Practice of Constraint Programming (CP), pp. 142–157 (2009)
3.
go back to reference Areces, C., Bustos, F., Dominguez, M.A., Hoffmann, J.: Optimizing planning domains by automatic action schema splitting. In: Proceedings of the Twenty-Fourth International Conference on Automated Planning and Scheduling, ICAPS (2014) Areces, C., Bustos, F., Dominguez, M.A., Hoffmann, J.: Optimizing planning domains by automatic action schema splitting. In: Proceedings of the Twenty-Fourth International Conference on Automated Planning and Scheduling, ICAPS (2014)
4.
go back to reference Balyo, T.: The freelunch planning system entering IPC 2014. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Balyo, T.: The freelunch planning system entering IPC 2014. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
5.
go back to reference Balyo, T.: Relaxing the relaxed exist-step parallel planning semantics. In: 2013 IEEE 25th International Conference on Tools with Artificial Intelligence, pp. 865–871 (2013) Balyo, T.: Relaxing the relaxed exist-step parallel planning semantics. In: 2013 IEEE 25th International Conference on Tools with Artificial Intelligence, pp. 865–871 (2013)
6.
go back to reference Botea, A., Enzenberger, M., Müller, M., Schaeffer, J.: Macro-FF: Improving AI planning with automatically learned macro-operators. J. Artif. Intell. Res. 24, 581–621 (2005)CrossRef Botea, A., Enzenberger, M., Müller, M., Schaeffer, J.: Macro-FF: Improving AI planning with automatically learned macro-operators. J. Artif. Intell. Res. 24, 581–621 (2005)CrossRef
8.
go back to reference Cenamor, I., de la Rosa, T., Fernández, F.: The ibacop planning system: instance-based configured portfolios. J. Artif. Intell. Res. 56, 657–691 (2016)MathSciNetCrossRef Cenamor, I., de la Rosa, T., Fernández, F.: The ibacop planning system: instance-based configured portfolios. J. Artif. Intell. Res. 56, 657–691 (2016)MathSciNetCrossRef
9.
go back to reference Cerutti, F., Vallati, M., Giacomin, M.: On the impact of configuration on abstract argumentation automated reasoning. Int. J. Approx. Reason. 92, 120 (2017)MathSciNetCrossRef Cerutti, F., Vallati, M., Giacomin, M.: On the impact of configuration on abstract argumentation automated reasoning. Int. J. Approx. Reason. 92, 120 (2017)MathSciNetCrossRef
10.
go back to reference Chrpa, L.: Generation of macro-operators via investigation of action dependencies in plans. Knowl. Eng. Rev. 25(3), 281–297 (2010)CrossRef Chrpa, L.: Generation of macro-operators via investigation of action dependencies in plans. Knowl. Eng. Rev. 25(3), 281–297 (2010)CrossRef
11.
go back to reference Chrpa, L., Barták, R.: Reformulating planning problems by eliminating unpromising actions. In: Symposium on Abstraction, Reformulation, and Approximation, SARA, pp. 50–57 (2009) Chrpa, L., Barták, R.: Reformulating planning problems by eliminating unpromising actions. In: Symposium on Abstraction, Reformulation, and Approximation, SARA, pp. 50–57 (2009)
12.
go back to reference Chrpa, L., McCluskey, T.L.: On exploiting structures of classical planning problems: generalizing entanglements. In: European Conference on Artificial Intelligence, ECAI, pp. 240–245 (2012) Chrpa, L., McCluskey, T.L.: On exploiting structures of classical planning problems: generalizing entanglements. In: European Conference on Artificial Intelligence, ECAI, pp. 240–245 (2012)
13.
go back to reference Chrpa, L., Vallati, M., McCluskey, T.L.: Mum: A technique for maximising the utility of macro-operators by constrained generation and use. In: Proceedings of the International Conference on Automated Planning and Scheduling, ICAPS, pp. 65–73 (2014) Chrpa, L., Vallati, M., McCluskey, T.L.: Mum: A technique for maximising the utility of macro-operators by constrained generation and use. In: Proceedings of the International Conference on Automated Planning and Scheduling, ICAPS, pp. 65–73 (2014)
14.
go back to reference Coles, A., Fox, M., Smith, A.: Online identification of useful macro-actions for planning. In: The International Conference on Automated Planning and Scheduling, ICAPS, pp. 97–104 (2007) Coles, A., Fox, M., Smith, A.: Online identification of useful macro-actions for planning. In: The International Conference on Automated Planning and Scheduling, ICAPS, pp. 97–104 (2007)
15.
go back to reference Fawcett, C., Helmert, M., Hoos, H.H., Karpas, E., Röger, G., Seipp, J.: Fd-autotune: domain-specific configuration using fast-downward. In: Workshop on Planning and Learning (PAL) (2011) Fawcett, C., Helmert, M., Hoos, H.H., Karpas, E., Röger, G., Seipp, J.: Fd-autotune: domain-specific configuration using fast-downward. In: Workshop on Planning and Learning (PAL) (2011)
16.
go back to reference Fox, M., Long, D.: PDDL2.1: an extension to PDDL for expressing temporal planning domains. J. Artif. Intell. Res. 20, 61–124 (2003)CrossRef Fox, M., Long, D.: PDDL2.1: an extension to PDDL for expressing temporal planning domains. J. Artif. Intell. Res. 20, 61–124 (2003)CrossRef
17.
go back to reference Gerevini, A.E., Saetti, A., Serina, I.: Planning through stochastic local search and temporal action graphs in LPG. J. Artif. Intell. Res. 20, 239–290 (2003)CrossRef Gerevini, A.E., Saetti, A., Serina, I.: Planning through stochastic local search and temporal action graphs in LPG. J. Artif. Intell. Res. 20, 239–290 (2003)CrossRef
18.
go back to reference Gerevini, A.E., Saetti, A., Vallati, M.: Planning through automatic portfolio configuration: the PBP approach. J. Artif. Intell. Res. 50, 639–696 (2014)CrossRef Gerevini, A.E., Saetti, A., Vallati, M.: Planning through automatic portfolio configuration: the PBP approach. J. Artif. Intell. Res. 50, 639–696 (2014)CrossRef
19.
go back to reference Ghallab, M., Knoblock Isi, C., Penberthy, S., Smith, D.E., Sun, Y., Weld, D.: Pddl—the planning domain definition language. Technical report (1998) Ghallab, M., Knoblock Isi, C., Penberthy, S., Smith, D.E., Sun, Y., Weld, D.: Pddl—the planning domain definition language. Technical report (1998)
20.
go back to reference Ghallab, M., Nau, D., Traverso, P.: Automated Planning, Theory and Practice. Morgan Kaufmann Publishers, Burlington (2004)MATH Ghallab, M., Nau, D., Traverso, P.: Automated Planning, Theory and Practice. Morgan Kaufmann Publishers, Burlington (2004)MATH
21.
go back to reference Helmert, M.: The fast downward planning system. J. Artif. Intell. Res. 26, 191–246 (2006)CrossRef Helmert, M.: The fast downward planning system. J. Artif. Intell. Res. 26, 191–246 (2006)CrossRef
22.
go back to reference Howe, A.E., Dahlman, E.: A critical assessment of benchmark comparison in planning. J. Artif. Intell. Res. 17, 1–33 (2002)CrossRef Howe, A.E., Dahlman, E.: A critical assessment of benchmark comparison in planning. J. Artif. Intell. Res. 17, 1–33 (2002)CrossRef
23.
go back to reference Hsu, C.-W., Wah, B.W.: The SGPlan planning system in IPC-6. In: The 6th International Planning Competition (IPC-6) (2008) Hsu, C.-W., Wah, B.W.: The SGPlan planning system in IPC-6. In: The 6th International Planning Competition (IPC-6) (2008)
24.
go back to reference Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Proceedings of the 5th Learning and Intelligent Optimization Conference (LION), pp. 507–523 (2011) Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Proceedings of the 5th Learning and Intelligent Optimization Conference (LION), pp. 507–523 (2011)
25.
go back to reference Hutter, F., Hoos, H.H., Leyton-Brown, K.: An efficient approach for assessing hyperparameter importance. In: Proceedings of the 31st International Conference on Machine Learning, pp. 754–762 (2014) Hutter, F., Hoos, H.H., Leyton-Brown, K.: An efficient approach for assessing hyperparameter importance. In: Proceedings of the 31st International Conference on Machine Learning, pp. 754–762 (2014)
26.
go back to reference Hutter, F., Hoos, H.H., Leyton-Brown, K., Stützle, T.: Paramils: an automatic algorithm configuration framework. J. Artif. Intell. Res. 36, 267–306 (2009)CrossRef Hutter, F., Hoos, H.H., Leyton-Brown, K., Stützle, T.: Paramils: an automatic algorithm configuration framework. J. Artif. Intell. Res. 36, 267–306 (2009)CrossRef
27.
go back to reference Hutter, F., Lindauer, M., Balint, A., Bayless, S., Hoos, H., Leyton-Brown, K.: The configurable sat solver challenge (CSSC). Artif. Intell. J. 243, 1–25 (2017)MathSciNetCrossRef Hutter, F., Lindauer, M., Balint, A., Bayless, S., Hoos, H., Leyton-Brown, K.: The configurable sat solver challenge (CSSC). Artif. Intell. J. 243, 1–25 (2017)MathSciNetCrossRef
28.
go back to reference Hutter, F., Xu, L., Hoos, H.H., Leyton-Brown, K.: Algorithm runtime prediction: methods & evaluation. Artif. Intell. 206, 79–111 (2014)MathSciNetCrossRef Hutter, F., Xu, L., Hoos, H.H., Leyton-Brown, K.: Algorithm runtime prediction: methods & evaluation. Artif. Intell. 206, 79–111 (2014)MathSciNetCrossRef
29.
go back to reference Katz, M., Hoffmann, J.: Mercury planner: pushing the limits of partial delete relaxation. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Katz, M., Hoffmann, J.: Mercury planner: pushing the limits of partial delete relaxation. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
31.
go back to reference Lipovetzky, N., Ramirez, M., Muise, C., Geffner, H.: Width and inference based planners: Siw, bfs(f), and probe. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Lipovetzky, N., Ramirez, M., Muise, C., Geffner, H.: Width and inference based planners: Siw, bfs(f), and probe. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
32.
go back to reference McCluskey, T.L., Porteous, J.M.: Engineering and compiling planning domain models to promote validity and efficiency. Artif. Intell. 95(1), 1–65 (1997)CrossRef McCluskey, T.L., Porteous, J.M.: Engineering and compiling planning domain models to promote validity and efficiency. Artif. Intell. 95(1), 1–65 (1997)CrossRef
33.
go back to reference McCluskey, T.L., Vallati, M.: Embedding automated planning within urban traffic management operations. In: Proceedings of the International Conference on Automated Planning and Scheduling ICAPS (2017) McCluskey, T.L., Vallati, M.: Embedding automated planning within urban traffic management operations. In: Proceedings of the International Conference on Automated Planning and Scheduling ICAPS (2017)
34.
go back to reference McCluskey, T.L., Vaquero, T.S., Vallati, M.: Engineering knowledge for automated planning: towards a notion of quality. In: Proceedings of the Knowledge Capture Conference, K-CAP (2017) McCluskey, T.L., Vaquero, T.S., Vallati, M.: Engineering knowledge for automated planning: towards a notion of quality. In: Proceedings of the Knowledge Capture Conference, K-CAP (2017)
35.
go back to reference Minton, S.: Quantitative results concerning the utility of explanation-based learning. In: AAAI, pp. 564–569 (1988) Minton, S.: Quantitative results concerning the utility of explanation-based learning. In: AAAI, pp. 564–569 (1988)
36.
go back to reference Newton, M.A.H., Levine, J., Fox, M., Long, D.: Learning macro-actions for arbitrary planners and domains. In: The International Conference on Automated Planning and Scheduling, ICAPS, pp. 256–263 (2007) Newton, M.A.H., Levine, J., Fox, M., Long, D.: Learning macro-actions for arbitrary planners and domains. In: The International Conference on Automated Planning and Scheduling, ICAPS, pp. 256–263 (2007)
37.
go back to reference Parkinson, S., Longstaff, A.P.: Multi-objective optimisation of machine tool error mapping using automated planning. Expert Syst. Appl. 42(6), 3005–3015 (2015)CrossRef Parkinson, S., Longstaff, A.P.: Multi-objective optimisation of machine tool error mapping using automated planning. Expert Syst. Appl. 42(6), 3005–3015 (2015)CrossRef
38.
go back to reference Riddle, P.J., Holte, R.C., Barley, M.W.: Does representation matter in the planning competition? In: Proceedings of the Ninth Symposium on Abstraction, Reformulation, and Approximation, SARA 2011, Parador de Cardona, Cardona, Catalonia, Spain (2011) Riddle, P.J., Holte, R.C., Barley, M.W.: Does representation matter in the planning competition? In: Proceedings of the Ninth Symposium on Abstraction, Reformulation, and Approximation, SARA 2011, Parador de Cardona, Cardona, Catalonia, Spain (2011)
39.
go back to reference Rintanen, J.: Madagascar: Scalable planning with SAT. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Rintanen, J.: Madagascar: Scalable planning with SAT. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
40.
go back to reference Sadraei, R., Ahmadi, A.: Use: the useful operator selection. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Sadraei, R., Ahmadi, A.: Use: the useful operator selection. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
41.
go back to reference Seipp, J., Sievers, S., Helmert, M., Hutter, F.: Automatic configuration of sequential planning portfolios. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 25–30 Jan 2015, Austin, Texas, USA, pp. 3364–3370 (2015) Seipp, J., Sievers, S., Helmert, M., Hutter, F.: Automatic configuration of sequential planning portfolios. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 25–30 Jan 2015, Austin, Texas, USA, pp. 3364–3370 (2015)
42.
go back to reference Thompson, S.K.: Simple random sampling. Sampling, Third Edition, pp. 9–37 (2012) Thompson, S.K.: Simple random sampling. Sampling, Third Edition, pp. 9–37 (2012)
43.
go back to reference Valenzano, R., Nakhost, H., Müller, M., Schaeffer, J.: Arvandherd 2014. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Valenzano, R., Nakhost, H., Müller, M., Schaeffer, J.: Arvandherd 2014. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
44.
go back to reference Valenzano, R., Schaeffer, J., Sturtevant, N., Xie, F.: A comparison of knowledge-based GBFS enhancements and knowledge-free exploration. In: Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS-2014), pp. 375–379 (2014) Valenzano, R., Schaeffer, J., Sturtevant, N., Xie, F.: A comparison of knowledge-based GBFS enhancements and knowledge-free exploration. In: Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS-2014), pp. 375–379 (2014)
45.
go back to reference Vallati, M., Fawcett, C., Gerevini, A.E., Hoos, H.H., Saetti, A.: Automatic generation of efficient domain-optimized planners from generic parametrized planners. In: Proceedings of the Sixth Annual Symposium on Combinatorial Search, SOCS (2013) Vallati, M., Fawcett, C., Gerevini, A.E., Hoos, H.H., Saetti, A.: Automatic generation of efficient domain-optimized planners from generic parametrized planners. In: Proceedings of the Sixth Annual Symposium on Combinatorial Search, SOCS (2013)
46.
go back to reference Vallati, M., Chrpa, L., Grzes, M., McCluskey, T.L., Roberts, M.: The 2014 international planning competition: progress and trends. AI Mag. 36(3), 90–98 (2015) Vallati, M., Chrpa, L., Grzes, M., McCluskey, T.L., Roberts, M.: The 2014 international planning competition: progress and trends. AI Mag. 36(3), 90–98 (2015)
47.
go back to reference Vallati, M., Chrpa, L., McCluskey, T.L.: Improving a planner’s performance through online heuristic configuration of domain models. In: Proceedings of the Tenth International Symposium on Combinatorial Search, pp. 171–172 (2017) Vallati, M., Chrpa, L., McCluskey, T.L.: Improving a planner’s performance through online heuristic configuration of domain models. In: Proceedings of the Tenth International Symposium on Combinatorial Search, pp. 171–172 (2017)
48.
go back to reference Vallati, M., Hutter, F., Chrpa, L., McCluskey, T.L.: On the effective configuration of planning domain models. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI, pp. 1704–1711 (2015) Vallati, M., Hutter, F., Chrpa, L., McCluskey, T.L.: On the effective configuration of planning domain models. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI, pp. 1704–1711 (2015)
49.
go back to reference Vallati, M., Maratea, M.: On the configuration of SAT formulae. In: AI*IA 2019—Advances in Artificial Intelligence—XVIIIth International Conference of the Italian Association for Artificial Intelligence, pp. 264–277 (2019) Vallati, M., Maratea, M.: On the configuration of SAT formulae. In: AI*IA 2019—Advances in Artificial Intelligence—XVIIIth International Conference of the Italian Association for Artificial Intelligence, pp. 264–277 (2019)
50.
go back to reference Vidal, V.: YAHSP3 and YAHSP3-MT in the 8th international planning competition. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Vidal, V.: YAHSP3 and YAHSP3-MT in the 8th international planning competition. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
51.
go back to reference Wilcoxon, F.: Individual comparisons by ranking methods. Biom. Bull. 1(6), 80–83 (1945)CrossRef Wilcoxon, F.: Individual comparisons by ranking methods. Biom. Bull. 1(6), 80–83 (1945)CrossRef
52.
go back to reference Xie, F., Müller, M., Holte, R.: Jasper: the art of exploration in greedy best first search. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014) Xie, F., Müller, M., Holte, R.: Jasper: the art of exploration in greedy best first search. In: Proceedings of the 8th International Planning Competition (IPC-2014) (2014)
53.
go back to reference Yuan, Z., Stützle, T., Birattari, M.: Mads/f-race: mesh adaptive direct search meets f-race. In: Proceedings of the 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems (IEA/AIE), pp. 41–50 (2010) Yuan, Z., Stützle, T., Birattari, M.: Mads/f-race: mesh adaptive direct search meets f-race. In: Proceedings of the 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems (IEA/AIE), pp. 41–50 (2010)
Metadata
Title
On the Importance of Domain Model Configuration for Automated Planning Engines
Authors
Mauro Vallati
Lukáš Chrpa
Thomas Leo McCluskey
Frank Hutter
Publication date
16-06-2021
Publisher
Springer Netherlands
Published in
Journal of Automated Reasoning / Issue 6/2021
Print ISSN: 0168-7433
Electronic ISSN: 1573-0670
DOI
https://doi.org/10.1007/s10817-021-09592-1

Premium Partner