Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 9/2015

01-09-2015 | Original Article

LapOntoSPM: an ontology for laparoscopic surgeries and its application to surgical phase recognition

Authors: Darko Katić, Chantal Julliard, Anna-Laura Wekerle, Hannes Kenngott, Beat Peter Müller-Stich, Rüdiger Dillmann, Stefanie Speidel, Pierre Jannin, Bernard Gibaud

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 9/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

The rise of intraoperative information threatens to outpace our abilities to process it. Context-aware systems, filtering information to automatically adapt to the current needs of the surgeon, are necessary to fully profit from computerized surgery. To attain context awareness, representation of medical knowledge is crucial. However, most existing systems do not represent knowledge in a reusable way, hindering also reuse of data. Our purpose is therefore to make our computational models of medical knowledge sharable, extensible and interoperational with established knowledge representations in the form of the LapOntoSPM ontology. To show its usefulness, we apply it to situation interpretation, i.e., the recognition of surgical phases based on surgical activities.

Methods

Considering best practices in ontology engineering and building on our ontology for laparoscopy, we formalized the workflow of laparoscopic adrenalectomies, cholecystectomies and pancreatic resections in the framework of OntoSPM, a new standard for surgical process models. Furthermore, we provide a rule-based situation interpretation algorithm based on SQWRL to recognize surgical phases using the ontology.

Results

The system was evaluated on ground-truth data from 19 manually annotated surgeries. The aim was to show that the phase recognition capabilities are equal to a specialized solution. The recognition rates of the new system were equal to the specialized one. However, the time needed to interpret a situation rose from 0.5 to 1.8 s on average which is still viable for practical application.

Conclusion

We successfully integrated medical knowledge for laparoscopic surgeries into OntoSPM, facilitating knowledge and data sharing. This is especially important for reproducibility of results and unbiased comparison of recognition algorithms. The associated recognition algorithm was adapted to the new representation without any loss of classification power. The work is an important step to standardized knowledge and data representation in the field on context awareness and thus toward unified benchmark data sets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36CrossRef Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36CrossRef
2.
go back to reference Joyce JP, Lapinski GW (1983) A history and overview of the safety parameter display system concept. IEEE Nucl Sci 30:744–749CrossRef Joyce JP, Lapinski GW (1983) A history and overview of the safety parameter display system concept. IEEE Nucl Sci 30:744–749CrossRef
3.
go back to reference Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688PubMedCrossRef Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688PubMedCrossRef
4.
go back to reference Lemke HU, Ratib OM, Horii SC (2005) Workflow in the operating room: a summary review of the arrowhead 2004 seminar on imaging and informatics. Int Congr Ser 1281:862–867CrossRef Lemke HU, Ratib OM, Horii SC (2005) Workflow in the operating room: a summary review of the arrowhead 2004 seminar on imaging and informatics. Int Congr Ser 1281:862–867CrossRef
5.
go back to reference Cleary K, Chung H, Mun S (2005) Or 2020: the operating room of the future. In: CARS 2005: computer assisted radiology and surgery, Proceedings of the 19th international congress and exhibition, International congress series, vol 1281, pp 832–838 Cleary K, Chung H, Mun S (2005) Or 2020: the operating room of the future. In: CARS 2005: computer assisted radiology and surgery, Proceedings of the 19th international congress and exhibition, International congress series, vol 1281, pp 832–838
7.
go back to reference Blum T, Padoy N, Feussner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3(5):379–386CrossRef Blum T, Padoy N, Feussner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3(5):379–386CrossRef
8.
go back to reference Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462PubMedCrossRef Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462PubMedCrossRef
9.
go back to reference Ahmadi A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2007) Recovery of surgical workflow without explicit models. Med Image Comput Comput Assist Interv 9(Pt 1):420–428 Ahmadi A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2007) Recovery of surgical workflow without explicit models. Med Image Comput Comput Assist Interv 9(Pt 1):420–428
10.
go back to reference Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) In: Random forests for phase detection in surgical workflow analysis the 5th international conference on information processing in computer-assisted interventions (IPCAI) Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) In: Random forests for phase detection in surgical workflow analysis the 5th international conference on information processing in computer-assisted interventions (IPCAI)
11.
go back to reference Reiley C, Lin H, Varadarajan B, Vagolgyi B, Khudanpur S, Yuh D, Hager G (2008) Automatic recognition of surgical motions using statistical modeling for capturing variability. Stud Health Technol Inform 132:396–401 Reiley C, Lin H, Varadarajan B, Vagolgyi B, Khudanpur S, Yuh D, Hager G (2008) Automatic recognition of surgical motions using statistical modeling for capturing variability. Stud Health Technol Inform 132:396–401
12.
go back to reference Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM. Med Comput Vis Recognit Tech Appl Med Imaging Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM. Med Comput Vis Recognit Tech Appl Med Imaging
13.
go back to reference Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641PubMedCrossRef Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641PubMedCrossRef
14.
go back to reference Blum T, Feussner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. Med Image Comput Comput Assist Interv Blum T, Feussner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. Med Image Comput Comput Assist Interv
15.
go back to reference Suzuki T, Sakurai Y, Yoshimitsu K, Nambu K, Muragaki Y, Iseki H (2010) Intraoperative multichannel audio-visual information recording and automatic surgical phase and incident detection. In: 32nd annual international conference of the IEEE EMBS, 1190–1193 Suzuki T, Sakurai Y, Yoshimitsu K, Nambu K, Muragaki Y, Iseki H (2010) Intraoperative multichannel audio-visual information recording and automatic surgical phase and incident detection. In: 32nd annual international conference of the IEEE EMBS, 1190–1193
16.
go back to reference Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2011) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71PubMedPubMedCentralCrossRef Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2011) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71PubMedPubMedCentralCrossRef
17.
go back to reference Burgert O, Neumuth T, Lempp F, Mudunuri R, Meixensberger J, Strauss G, Dietz A, Jannin P, Lemke HU (2006) Linking top-level ontologies and surgical workflows. Int J Comput Assist Radiol Surg 1(1):437–438 Burgert O, Neumuth T, Lempp F, Mudunuri R, Meixensberger J, Strauss G, Dietz A, Jannin P, Lemke HU (2006) Linking top-level ontologies and surgical workflows. Int J Comput Assist Radiol Surg 1(1):437–438
18.
go back to reference Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37(3):783–791PubMedCrossRef Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37(3):783–791PubMedCrossRef
19.
go back to reference Neumuth T, Kaschek B, Neumuth D, Ceschia M, Meixensberger J, Strauss G, Burgert O (2010) An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behav Res Methods 42(4):1049–1058 Neumuth T, Kaschek B, Neumuth D, Ceschia M, Meixensberger J, Strauss G, Burgert O (2010) An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions. Behav Res Methods 42(4):1049–1058
20.
go back to reference Neumuth D, Loebe F, Herre H, Neumuth T (2011) Modeling surgical processes: a four-level translational approach. Artif Intell Med 51(3):147–161PubMedCrossRef Neumuth D, Loebe F, Herre H, Neumuth T (2011) Modeling surgical processes: a four-level translational approach. Artif Intell Med 51(3):147–161PubMedCrossRef
21.
go back to reference Lalys F, Bouget B, Riffaud R, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg CARS 8:39–49CrossRef Lalys F, Bouget B, Riffaud R, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg CARS 8:39–49CrossRef
22.
go back to reference Oropesa I, Snchez-Gonzlez P, Lamata P, Chmarra MK, Pagador JB, Snchez-Margallo JA, Snchez-Margallo FM, Gmez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171(1):81–95CrossRef Oropesa I, Snchez-Gonzlez P, Lamata P, Chmarra MK, Pagador JB, Snchez-Margallo JA, Snchez-Margallo FM, Gmez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171(1):81–95CrossRef
24.
go back to reference Katic Katic, Wekerle AL, Grtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. Information processing in computer-assisted interventions, Lecture Notes in Computer Science, vol 8498, pp 158–167 Katic Katic, Wekerle AL, Grtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. Information processing in computer-assisted interventions, Lecture Notes in Computer Science, vol 8498, pp 158–167
25.
go back to reference Gibaud B, Penet C, Pierre J (2014) OntoSPM: a core ontology of surgical procedure models, SURGETICA Gibaud B, Penet C, Pierre J (2014) OntoSPM: a core ontology of surgical procedure models, SURGETICA
26.
go back to reference Grenon P, Smith B (2004) SNAP and SPAN: towards dynamic spatial ontology. Spat Cognit Compuat 1(4):69–103 Grenon P, Smith B (2004) SNAP and SPAN: towards dynamic spatial ontology. Spat Cognit Compuat 1(4):69–103
27.
go back to reference Rosse C, Mejino JLV (2007) The foundational model of anatomy ontology. Anat Ontol Bioinf Princ Pract 6:59–117 Rosse C, Mejino JLV (2007) The foundational model of anatomy ontology. Anat Ontol Bioinf Princ Pract 6:59–117
30.
go back to reference Speidel S, Benzko J, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences. SPIE Med Imaging 7261 Speidel S, Benzko J, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences. SPIE Med Imaging 7261
31.
go back to reference Neumuth T, Strauss G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006 Neumuth T, Strauss G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006
33.
go back to reference O’Connor MJ, Das A (2009) SQWRL: a query language for OWL OWL: experiences and directions (OWLED). In: 6th International Workshop O’Connor MJ, Das A (2009) SQWRL: a query language for OWL OWL: experiences and directions (OWLED). In: 6th International Workshop
34.
go back to reference Shearer R, Motik B, Horrocks I (2008) HermiT: a highly-efficient OWL reasoner. In: 5th International workshop on OWL: experiences and directions Shearer R, Motik B, Horrocks I (2008) HermiT: a highly-efficient OWL reasoner. In: 5th International workshop on OWL: experiences and directions
35.
go back to reference O’Connor MJ, Knublauch H, Tu SW, Grossof B, Dean M, Grosso WE, Musen MA (2005) Supporting Rule System Interoperability on the Semantic Web with SWRL. In: 4th International semantic web conference (ISWC) LNCS 3729:974–986 O’Connor MJ, Knublauch H, Tu SW, Grossof B, Dean M, Grosso WE, Musen MA (2005) Supporting Rule System Interoperability on the Semantic Web with SWRL. In: 4th International semantic web conference (ISWC) LNCS 3729:974–986
36.
go back to reference Horridge M, Bechhofer S (2011) The OWL API: a Java API for OWL ontologies. Semanti Web J Spec Issue Semant Web Tools Syst 2(1):11–21 Horridge M, Bechhofer S (2011) The OWL API: a Java API for OWL ontologies. Semanti Web J Spec Issue Semant Web Tools Syst 2(1):11–21
38.
go back to reference Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inform Assoc 16(1):72–80. doi:10.1197/jamia.M2748 PMCID: PMC2605601 Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inform Assoc 16(1):72–80. doi:10.​1197/​jamia.​M2748 PMCID: PMC2605601
Metadata
Title
LapOntoSPM: an ontology for laparoscopic surgeries and its application to surgical phase recognition
Authors
Darko Katić
Chantal Julliard
Anna-Laura Wekerle
Hannes Kenngott
Beat Peter Müller-Stich
Rüdiger Dillmann
Stefanie Speidel
Pierre Jannin
Bernard Gibaud
Publication date
01-09-2015
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 9/2015
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1222-1

Other articles of this Issue 9/2015

International Journal of Computer Assisted Radiology and Surgery 9/2015 Go to the issue

Premium Partner