Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2015

01.09.2015 | Original Article

LapOntoSPM: an ontology for laparoscopic surgeries and its application to surgical phase recognition

verfasst von: Darko Katić, Chantal Julliard, Anna-Laura Wekerle, Hannes Kenngott, Beat Peter Müller-Stich, Rüdiger Dillmann, Stefanie Speidel, Pierre Jannin, Bernard Gibaud

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

The rise of intraoperative information threatens to outpace our abilities to process it. Context-aware systems, filtering information to automatically adapt to the current needs of the surgeon, are necessary to fully profit from computerized surgery. To attain context awareness, representation of medical knowledge is crucial. However, most existing systems do not represent knowledge in a reusable way, hindering also reuse of data. Our purpose is therefore to make our computational models of medical knowledge sharable, extensible and interoperational with established knowledge representations in the form of the LapOntoSPM ontology. To show its usefulness, we apply it to situation interpretation, i.e., the recognition of surgical phases based on surgical activities.

Methods

Considering best practices in ontology engineering and building on our ontology for laparoscopy, we formalized the workflow of laparoscopic adrenalectomies, cholecystectomies and pancreatic resections in the framework of OntoSPM, a new standard for surgical process models. Furthermore, we provide a rule-based situation interpretation algorithm based on SQWRL to recognize surgical phases using the ontology.

Results

The system was evaluated on ground-truth data from 19 manually annotated surgeries. The aim was to show that the phase recognition capabilities are equal to a specialized solution. The recognition rates of the new system were equal to the specialized one. However, the time needed to interpret a situation rose from 0.5 to 1.8 s on average which is still viable for practical application.

Conclusion

We successfully integrated medical knowledge for laparoscopic surgeries into OntoSPM, facilitating knowledge and data sharing. This is especially important for reproducibility of results and unbiased comparison of recognition algorithms. The associated recognition algorithm was adapted to the new representation without any loss of classification power. The work is an important step to standardized knowledge and data representation in the field on context awareness and thus toward unified benchmark data sets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36CrossRef Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36CrossRef
2.
Zurück zum Zitat Joyce JP, Lapinski GW (1983) A history and overview of the safety parameter display system concept. IEEE Nucl Sci 30:744–749CrossRef Joyce JP, Lapinski GW (1983) A history and overview of the safety parameter display system concept. IEEE Nucl Sci 30:744–749CrossRef
3.
Zurück zum Zitat Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688PubMedCrossRef Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688PubMedCrossRef
4.
Zurück zum Zitat Lemke HU, Ratib OM, Horii SC (2005) Workflow in the operating room: a summary review of the arrowhead 2004 seminar on imaging and informatics. Int Congr Ser 1281:862–867CrossRef Lemke HU, Ratib OM, Horii SC (2005) Workflow in the operating room: a summary review of the arrowhead 2004 seminar on imaging and informatics. Int Congr Ser 1281:862–867CrossRef
5.
Zurück zum Zitat Cleary K, Chung H, Mun S (2005) Or 2020: the operating room of the future. In: CARS 2005: computer assisted radiology and surgery, Proceedings of the 19th international congress and exhibition, International congress series, vol 1281, pp 832–838 Cleary K, Chung H, Mun S (2005) Or 2020: the operating room of the future. In: CARS 2005: computer assisted radiology and surgery, Proceedings of the 19th international congress and exhibition, International congress series, vol 1281, pp 832–838
7.
Zurück zum Zitat Blum T, Padoy N, Feussner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3(5):379–386CrossRef Blum T, Padoy N, Feussner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3(5):379–386CrossRef
8.
Zurück zum Zitat Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462PubMedCrossRef Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462PubMedCrossRef
9.
Zurück zum Zitat Ahmadi A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2007) Recovery of surgical workflow without explicit models. Med Image Comput Comput Assist Interv 9(Pt 1):420–428 Ahmadi A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2007) Recovery of surgical workflow without explicit models. Med Image Comput Comput Assist Interv 9(Pt 1):420–428
10.
Zurück zum Zitat Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) In: Random forests for phase detection in surgical workflow analysis the 5th international conference on information processing in computer-assisted interventions (IPCAI) Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) In: Random forests for phase detection in surgical workflow analysis the 5th international conference on information processing in computer-assisted interventions (IPCAI)
11.
Zurück zum Zitat Reiley C, Lin H, Varadarajan B, Vagolgyi B, Khudanpur S, Yuh D, Hager G (2008) Automatic recognition of surgical motions using statistical modeling for capturing variability. Stud Health Technol Inform 132:396–401 Reiley C, Lin H, Varadarajan B, Vagolgyi B, Khudanpur S, Yuh D, Hager G (2008) Automatic recognition of surgical motions using statistical modeling for capturing variability. Stud Health Technol Inform 132:396–401
12.
Zurück zum Zitat Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM. Med Comput Vis Recognit Tech Appl Med Imaging Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM. Med Comput Vis Recognit Tech Appl Med Imaging
13.
Zurück zum Zitat Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641PubMedCrossRef Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641PubMedCrossRef
14.
Zurück zum Zitat Blum T, Feussner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. Med Image Comput Comput Assist Interv Blum T, Feussner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. Med Image Comput Comput Assist Interv
15.
Zurück zum Zitat Suzuki T, Sakurai Y, Yoshimitsu K, Nambu K, Muragaki Y, Iseki H (2010) Intraoperative multichannel audio-visual information recording and automatic surgical phase and incident detection. In: 32nd annual international conference of the IEEE EMBS, 1190–1193 Suzuki T, Sakurai Y, Yoshimitsu K, Nambu K, Muragaki Y, Iseki H (2010) Intraoperative multichannel audio-visual information recording and automatic surgical phase and incident detection. In: 32nd annual international conference of the IEEE EMBS, 1190–1193
16.
Zurück zum Zitat Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2011) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71PubMedPubMedCentralCrossRef Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2011) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71PubMedPubMedCentralCrossRef
17.
Zurück zum Zitat Burgert O, Neumuth T, Lempp F, Mudunuri R, Meixensberger J, Strauss G, Dietz A, Jannin P, Lemke HU (2006) Linking top-level ontologies and surgical workflows. Int J Comput Assist Radiol Surg 1(1):437–438 Burgert O, Neumuth T, Lempp F, Mudunuri R, Meixensberger J, Strauss G, Dietz A, Jannin P, Lemke HU (2006) Linking top-level ontologies and surgical workflows. Int J Comput Assist Radiol Surg 1(1):437–438
18.
Zurück zum Zitat Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37(3):783–791PubMedCrossRef Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37(3):783–791PubMedCrossRef
19.
Zurück zum Zitat Neumuth T, Kaschek B, Neumuth D, Ceschia M, Meixensberger J, Strauss G, Burgert O (2010) An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behav Res Methods 42(4):1049–1058 Neumuth T, Kaschek B, Neumuth D, Ceschia M, Meixensberger J, Strauss G, Burgert O (2010) An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behav Res Methods 42(4):1049–1058
20.
Zurück zum Zitat Neumuth D, Loebe F, Herre H, Neumuth T (2011) Modeling surgical processes: a four-level translational approach. Artif Intell Med 51(3):147–161PubMedCrossRef Neumuth D, Loebe F, Herre H, Neumuth T (2011) Modeling surgical processes: a four-level translational approach. Artif Intell Med 51(3):147–161PubMedCrossRef
21.
Zurück zum Zitat Lalys F, Bouget B, Riffaud R, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg CARS 8:39–49CrossRef Lalys F, Bouget B, Riffaud R, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg CARS 8:39–49CrossRef
22.
Zurück zum Zitat Oropesa I, Snchez-Gonzlez P, Lamata P, Chmarra MK, Pagador JB, Snchez-Margallo JA, Snchez-Margallo FM, Gmez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171(1):81–95CrossRef Oropesa I, Snchez-Gonzlez P, Lamata P, Chmarra MK, Pagador JB, Snchez-Margallo JA, Snchez-Margallo FM, Gmez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171(1):81–95CrossRef
24.
Zurück zum Zitat Katic Katic, Wekerle AL, Grtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. Information processing in computer-assisted interventions, Lecture Notes in Computer Science, vol 8498, pp 158–167 Katic Katic, Wekerle AL, Grtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. Information processing in computer-assisted interventions, Lecture Notes in Computer Science, vol 8498, pp 158–167
25.
Zurück zum Zitat Gibaud B, Penet C, Pierre J (2014) OntoSPM: a core ontology of surgical procedure models, SURGETICA Gibaud B, Penet C, Pierre J (2014) OntoSPM: a core ontology of surgical procedure models, SURGETICA
26.
Zurück zum Zitat Grenon P, Smith B (2004) SNAP and SPAN: towards dynamic spatial ontology. Spat Cognit Compuat 1(4):69–103 Grenon P, Smith B (2004) SNAP and SPAN: towards dynamic spatial ontology. Spat Cognit Compuat 1(4):69–103
27.
Zurück zum Zitat Rosse C, Mejino JLV (2007) The foundational model of anatomy ontology. Anat Ontol Bioinf Princ Pract 6:59–117 Rosse C, Mejino JLV (2007) The foundational model of anatomy ontology. Anat Ontol Bioinf Princ Pract 6:59–117
30.
Zurück zum Zitat Speidel S, Benzko J, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences. SPIE Med Imaging 7261 Speidel S, Benzko J, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences. SPIE Med Imaging 7261
31.
Zurück zum Zitat Neumuth T, Strauss G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006 Neumuth T, Strauss G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006
33.
Zurück zum Zitat O’Connor MJ, Das A (2009) SQWRL: a query language for OWL OWL: experiences and directions (OWLED). In: 6th International Workshop O’Connor MJ, Das A (2009) SQWRL: a query language for OWL OWL: experiences and directions (OWLED). In: 6th International Workshop
34.
Zurück zum Zitat Shearer R, Motik B, Horrocks I (2008) HermiT: a highly-efficient OWL reasoner. In: 5th International workshop on OWL: experiences and directions Shearer R, Motik B, Horrocks I (2008) HermiT: a highly-efficient OWL reasoner. In: 5th International workshop on OWL: experiences and directions
35.
Zurück zum Zitat O’Connor MJ, Knublauch H, Tu SW, Grossof B, Dean M, Grosso WE, Musen MA (2005) Supporting Rule System Interoperability on the Semantic Web with SWRL. In: 4th International semantic web conference (ISWC) LNCS 3729:974–986 O’Connor MJ, Knublauch H, Tu SW, Grossof B, Dean M, Grosso WE, Musen MA (2005) Supporting Rule System Interoperability on the Semantic Web with SWRL. In: 4th International semantic web conference (ISWC) LNCS 3729:974–986
36.
Zurück zum Zitat Horridge M, Bechhofer S (2011) The OWL API: a Java API for OWL ontologies. Semanti Web J Spec Issue Semant Web Tools Syst 2(1):11–21 Horridge M, Bechhofer S (2011) The OWL API: a Java API for OWL ontologies. Semanti Web J Spec Issue Semant Web Tools Syst 2(1):11–21
38.
Zurück zum Zitat Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inform Assoc 16(1):72–80. doi:10.1197/jamia.M2748 PMCID: PMC2605601 Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inform Assoc 16(1):72–80. doi:10.​1197/​jamia.​M2748 PMCID: PMC2605601
Metadaten
Titel
LapOntoSPM: an ontology for laparoscopic surgeries and its application to surgical phase recognition
verfasst von
Darko Katić
Chantal Julliard
Anna-Laura Wekerle
Hannes Kenngott
Beat Peter Müller-Stich
Rüdiger Dillmann
Stefanie Speidel
Pierre Jannin
Bernard Gibaud
Publikationsdatum
01.09.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2015
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1222-1

Weitere Artikel der Ausgabe 9/2015

International Journal of Computer Assisted Radiology and Surgery 9/2015 Zur Ausgabe