Skip to main content
Top

2016 | OriginalPaper | Chapter

Hierarchical Task Networks as Domain-Specific Language for Planning Surgical Interventions

Authors : Andreas Bihlmaier, Luzie Schreiter, Jörg Raczkowsky, Heinz Wörn

Published in: Intelligent Autonomous Systems 13

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The following paper addresses the challenges of defining surgical workflows. Surgical workflows have to deal with medical and technical aspects on different levels of abstraction in order to ensure safety. We propose hierarchical task networks (HTN) as a unifying domain-specific language (DSL) for the definition of surgical workflows. The DSL describes relations and dependencies in state sequences and surgical actions for complex workflows on varying levels of detail. With an HTN planner we are able to decompose high-level steps into primitive actions and identify all possible workflows together with their paths through the intervention. This information can be used to identify missing or inaccurate information in literature and consequently improve the workflow and safety of the surgical intervention. By means of a case study we present a detailed HTN-based DSL for Laparoscopic Cholecystectomy to show the advantage of using our particular approach to workflow modeling.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The plan results were measured single-threaded using SBCL 1.0.55 running SHOP2 version 2.9.0 on an Intel i5 CPU with 3.30 GHz.
 
Literature
1.
go back to reference Seyed-Ahmad Ahmadi, Tobias Sielhorst, Ralf Stauder, Martin Horn, Hubertus Feussner, and Nassir Navab. Recovery of surgical workflow without explicit models. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2006, pages 420–428. Springer, Berlin Heidelberg, 2006. Seyed-Ahmad Ahmadi, Tobias Sielhorst, Ralf Stauder, Martin Horn, Hubertus Feussner, and Nassir Navab. Recovery of surgical workflow without explicit models. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2006, pages 420–428. Springer, Berlin Heidelberg, 2006.
2.
go back to reference E. De Momi, R. Perrone, L. Schreiter, J. Raczkowsky, F. Boriero, M. Capiluppi, and P. Fiorini. Eurosurge workflow: From ontology to surgical task execution. In 3rd Joint Workshop on New Technologies for Computer/Robot Assisted Surgery. Verona, 2013. E. De Momi, R. Perrone, L. Schreiter, J. Raczkowsky, F. Boriero, M. Capiluppi, and P. Fiorini. Eurosurge workflow: From ontology to surgical task execution. In 3rd Joint Workshop on New Technologies for Computer/Robot Assisted Surgery. Verona, 2013.
3.
go back to reference Malik Ghallab, Dana Nau, and Paolo Traverso. Automated planning: theory & practice. 2004. Malik Ghallab, Dana Nau, and Paolo Traverso. Automated planning: theory & practice. 2004.
4.
go back to reference Robert Goldman. A semantics for htn methods. In Proceedings of the Nineteenth International Conference on Automated Planning and Scheduling, pages 146–153, 2009. Robert Goldman. A semantics for htn methods. In Proceedings of the Nineteenth International Conference on Automated Planning and Scheduling, pages 146–153, 2009.
5.
go back to reference Ronny Hartanto. A Hybrid Deliberative Layer for Robotic Agents. Springer, Berlin Heidelberg, 2011. Ronny Hartanto. A Hybrid Deliberative Layer for Robotic Agents. Springer, Berlin Heidelberg, 2011.
6.
go back to reference A. Jovic, M. Prcela, and D. Gamberger. Ontologies in medical knowledge representation. In Information Technology Interfaces, 2007. ITI 2007. 29th International Conference on, pages 535–540, 2007. A. Jovic, M. Prcela, and D. Gamberger. Ontologies in medical knowledge representation. In Information Technology Interfaces, 2007. ITI 2007. 29th International Conference on, pages 535–540, 2007.
7.
go back to reference D Katić, Gunther Sudra, Stefanie Speidel, Gregor Castrillon-Oberndorfer, Georg Eggers, and Rüdiger Dillmann. Knowledge-based situation interpretation for context-aware augmented reality in dental implant surgery. In Medical Imaging and Augmented Reality, pages 531–540. Springer, 2010. D Katić, Gunther Sudra, Stefanie Speidel, Gregor Castrillon-Oberndorfer, Georg Eggers, and Rüdiger Dillmann. Knowledge-based situation interpretation for context-aware augmented reality in dental implant surgery. In Medical Imaging and Augmented Reality, pages 531–540. Springer, 2010.
8.
go back to reference Florent Lalys and Pierre Jannin. Surgical process modelling: a review. International Journal of Computer Assisted Radiology and Surgery, pages 1–17, 2013. Florent Lalys and Pierre Jannin. Surgical process modelling: a review. International Journal of Computer Assisted Radiology and Surgery, pages 1–17, 2013.
9.
go back to reference L. MacKenzie, J. A. Ibbotson, C. G. L. Cao, and A. J. Lomax. Hierarchical decomposition of laparoscopic surgery: a human factors approach to investigating the operating room environment. Minimally Invasive Therapy & Allied Technologies, 10(3):121–127, 2001. L. MacKenzie, J. A. Ibbotson, C. G. L. Cao, and A. J. Lomax. Hierarchical decomposition of laparoscopic surgery: a human factors approach to investigating the operating room environment. Minimally Invasive Therapy & Allied Technologies, 10(3):121–127, 2001.
10.
go back to reference Marjan Mernik, Jan Heering, and Anthony M. Sloane. When and how to develop domain-specific languages. ACM Comput. Surv., 37(4):316–344, December 2005. Marjan Mernik, Jan Heering, and Anthony M. Sloane. When and how to develop domain-specific languages. ACM Comput. Surv., 37(4):316–344, December 2005.
11.
go back to reference Holger Mönnich, Jörg Raczkowsky, and Heinz Wörn. Workflow controlled Robotic Surgery. In Tagungsband der 9. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie, 2010. Holger Mönnich, Jörg Raczkowsky, and Heinz Wörn. Workflow controlled Robotic Surgery. In Tagungsband der 9. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie, 2010.
12.
go back to reference J. Münchenberg, J. Brief, J. Raczkowsky, H. Wörn, S. Hassfeld, and J. Mühling. Operation planning of robot supported surgical interventions. In Intelligent Robots and Systems, 2000. (IROS 2000). Proceedings. 2000 IEEE/RSJ International Conference on, volume 1, pages 547–552, 2000. J. Münchenberg, J. Brief, J. Raczkowsky, H. Wörn, S. Hassfeld, and J. Mühling. Operation planning of robot supported surgical interventions. In Intelligent Robots and Systems, 2000. (IROS 2000). Proceedings. 2000 IEEE/RSJ International Conference on, volume 1, pages 547–552, 2000.
13.
go back to reference Dana Nau, T-C Au, Okhtay Ilghami, Ugur Kuter, Dan Wu, Fusun Yaman, Héctor Muñoz-Avila, and J William Murdock. Applications of SHOP and SHOP2. Intelligent Systems, IEEE, 20(2):34–41, 2005. Dana Nau, T-C Au, Okhtay Ilghami, Ugur Kuter, Dan Wu, Fusun Yaman, Héctor Muñoz-Avila, and J William Murdock. Applications of SHOP and SHOP2. Intelligent Systems, IEEE, 20(2):34–41, 2005.
14.
go back to reference Dana S. Nau, Tsz-Chiu Au, Okhtay Ilghami, Ugur Kuter, J. William Murdock, Dan Wu, and Fusun Yaman. SHOP2: An HTN planning system. J. Artif. Intell. Res. (JAIR), 20:379–404, 2003. Dana S. Nau, Tsz-Chiu Au, Okhtay Ilghami, Ugur Kuter, J. William Murdock, Dan Wu, and Fusun Yaman. SHOP2: An HTN planning system. J. Artif. Intell. Res. (JAIR), 20:379–404, 2003.
15.
go back to reference Bernd Neumann and Ralf Möller. On scene interpretation with description logics. Image and Vision Computing, 26(1):82–101, 2008. Bernd Neumann and Ralf Möller. On scene interpretation with description logics. Image and Vision Computing, 26(1):82–101, 2008.
16.
go back to reference Dayana Neumuth, Frank Loebe, Heinrich Herre, and Thomas Neumuth. Modeling surgical processes: A four-level translational approach. Artificial Intelligence in Medicine, 51(3):147–161, 2011. Dayana Neumuth, Frank Loebe, Heinrich Herre, and Thomas Neumuth. Modeling surgical processes: A four-level translational approach. Artificial Intelligence in Medicine, 51(3):147–161, 2011.
17.
go back to reference Alan Rector. Medical informatics. In Franz Baader, Diego Calvanese, Deborah L. McGuinness, Daniele Nardi, and Peter F. Patel-Schneider, editors, The Description Logic Handbook, pages 436–457, Cambridge, 2007. Cambridge Univeristy Press. Alan Rector. Medical informatics. In Franz Baader, Diego Calvanese, Deborah L. McGuinness, Daniele Nardi, and Peter F. Patel-Schneider, editors, The Description Logic Handbook, pages 436–457, Cambridge, 2007. Cambridge Univeristy Press.
18.
go back to reference Claudia Reuter, Peter Dadam, Stephan Rudolph, Wolfgang Deiters, and Simon Trillsch. Guarded process spaces (gps): A navigation system towards creation and dynamic change of healthcare processes from the end-users perspective. In Business Process Management Workshops, pages 237–248. Springer, Berlin Heidelberg, 2012. Claudia Reuter, Peter Dadam, Stephan Rudolph, Wolfgang Deiters, and Simon Trillsch. Guarded process spaces (gps): A navigation system towards creation and dynamic change of healthcare processes from the end-users perspective. In Business Process Management Workshops, pages 237–248. Springer, Berlin Heidelberg, 2012.
19.
go back to reference Nathaniel J Soper, Lee L Swanstrom, and Steve Eubanks. Mastery of Endoscopic and Laparoscopic Surgery: MELS. Wolters Kluwer Health, 2009. Nathaniel J Soper, Lee L Swanstrom, and Steve Eubanks. Mastery of Endoscopic and Laparoscopic Surgery: MELS. Wolters Kluwer Health, 2009.
20.
go back to reference Oliver Weede, Frank Dittrich, Heinz Wörn, Brian Jensen, Alois Knoll, Dirk Wilhelm, Michael Kranzfelder, Armin Schneider, and Hubertus Feussner. Workflow Analysis and Surgical Phase Recognition in Minimally Invasive Surgery. In 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO 2012), 2012, China, 2012. Oliver Weede, Frank Dittrich, Heinz Wörn, Brian Jensen, Alois Knoll, Dirk Wilhelm, Michael Kranzfelder, Armin Schneider, and Hubertus Feussner. Workflow Analysis and Surgical Phase Recognition in Minimally Invasive Surgery. In 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO 2012), 2012, China, 2012.
21.
go back to reference R. Zoliner, M. Pardowitz, S. Knoop, and R. Dillmann. Towards cognitive robots: Building hierarchical task representations of manipulations from human demonstration. In Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on, pages 1535–1540, 2005. R. Zoliner, M. Pardowitz, S. Knoop, and R. Dillmann. Towards cognitive robots: Building hierarchical task representations of manipulations from human demonstration. In Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on, pages 1535–1540, 2005.
Metadata
Title
Hierarchical Task Networks as Domain-Specific Language for Planning Surgical Interventions
Authors
Andreas Bihlmaier
Luzie Schreiter
Jörg Raczkowsky
Heinz Wörn
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-08338-4_79

Premium Partner