Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 6/2015

01-06-2015 | Original Article

Automatic phase prediction from low-level surgical activities

Authors: Germain Forestier, Laurent Riffaud, Pierre Jannin

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 6/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Analyzing surgical activities has received a growing interest in recent years. Several methods have been proposed to identify surgical activities and surgical phases from data acquired in operating rooms. These context-aware systems have multiple applications including: supporting the surgical team during the intervention, improving the automatic monitoring, designing new teaching paradigms.

Methods

In this paper, we use low-level recordings of the activities that are performed by a surgeon to automatically predict the current (high-level) phase of the surgery. We augment a decision tree algorithm with the ability to consider the local context of the surgical activities and a hierarchical clustering algorithm.

Results

Experiments were performed on 22 surgeries of lumbar disk herniation. We obtained an overall precision of 0.843 in detecting phases of 51,489 single activities. We also assess the robustness of the method with regard to noise.

Conclusion

We show that using the local context allows us to improve the results compared with methods only considering single activity. Experiments show that the use of the local context makes our method very robust to noise and that clustering the input data first improves the predictions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bardram JE, Doryab A, Jensen RM, Lange PM, Nielsen KL, Petersen ST (2011) Phase recognition during surgical procedures using embedded and body-worn sensors. In: IEEE international conference on pervasive computing and communications, pp 45–53 Bardram JE, Doryab A, Jensen RM, Lange PM, Nielsen KL, Petersen ST (2011) Phase recognition during surgical procedures using embedded and body-worn sensors. In: IEEE international conference on pervasive computing and communications, pp 45–53
2.
go back to reference Blamoutier A (2013) Surgical discectomy for lumbar disc herniation: surgical techniques. Orthop Traumatol Surg Res 99(1):S187–S196CrossRefPubMed Blamoutier A (2013) Surgical discectomy for lumbar disc herniation: surgical techniques. Orthop Traumatol Surg Res 99(1):S187–S196CrossRefPubMed
3.
go back to reference Bouarfa L, Jonker PP, Dankelman J (2011) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462CrossRefPubMed Bouarfa L, Jonker PP, Dankelman J (2011) Discovery of high-level tasks in the operating room. J Biomed Inform 44(3):455–462CrossRefPubMed
4.
go back to reference Bricon-Souf N, Newman CR (2007) Context awareness in health care: a review. Int J Med Inform 76(1):2–12CrossRefPubMed Bricon-Souf N, Newman CR (2007) Context awareness in health care: a review. Int J Med Inform 76(1):2–12CrossRefPubMed
5.
go back to reference Forestier G, Lalys F, Riffaud L, Collins DL, Meixensberger J, Wassef SN, Neumuth T, Goulet B, Jannin P (2013) Multi-site study of surgical practice in neurosurgery based on surgical process models. J Biomed Inform 46(5):822–829 Forestier G, Lalys F, Riffaud L, Collins DL, Meixensberger J, Wassef SN, Neumuth T, Goulet B, Jannin P (2013) Multi-site study of surgical practice in neurosurgery based on surgical process models. J Biomed Inform 46(5):822–829
6.
go back to reference Forestier G, Lalys F, Riffaud L, Trelhu B, Jannin P (2012) Classification of surgical processes using dynamic time warping. J Biomed Inform 45(2):255–264 Forestier G, Lalys F, Riffaud L, Trelhu B, Jannin P (2012) Classification of surgical processes using dynamic time warping. J Biomed Inform 45(2):255–264
7.
go back to reference Forestier G, Petitjean F, Riffaud L, Jannin P (2014) Non-linear temporal scaling of surgical processes. Artif Intell Med 62(3):143–152CrossRefPubMed Forestier G, Petitjean F, Riffaud L, Jannin P (2014) Non-linear temporal scaling of surgical processes. Artif Intell Med 62(3):143–152CrossRefPubMed
8.
go back to reference Franke S, Meixensberger J, Neumuth T (2013) Intervention time prediction from surgical low-level tasks. J Biomed Inform 46(1):152–159CrossRefPubMed Franke S, Meixensberger J, Neumuth T (2013) Intervention time prediction from surgical low-level tasks. J Biomed Inform 46(1):152–159CrossRefPubMed
9.
go back to reference Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. ACM SIGKDD Explor Newsl 11(1):10–18CrossRef Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. ACM SIGKDD Explor Newsl 11(1):10–18CrossRef
10.
go back to reference Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49CrossRefPubMed Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49CrossRefPubMed
11.
go back to reference Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg 8(5):1–17 Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg 8(5):1–17
12.
go back to reference Lalys F, Riffaud L, Morandi X, Jannin P (2010) Automatic phases recognition in pituitary surgeries by microscope images classification. In: Information processing in computer-assisted interventions, vol 6135. Springer, pp 34–44 Lalys F, Riffaud L, Morandi X, Jannin P (2010) Automatic phases recognition in pituitary surgeries by microscope images classification. In: Information processing in computer-assisted interventions, vol 6135. Springer, pp 34–44
13.
go back to reference Mehta N, Haluck R, Frecker M, Snyder A (2002) Sequence and task analysis of instrument use in common laparoscopic procedures. Surg Endosc 16(2):280–285CrossRefPubMed Mehta N, Haluck R, Frecker M, Snyder A (2002) Sequence and task analysis of instrument use in common laparoscopic procedures. Surg Endosc 16(2):280–285CrossRefPubMed
14.
go back to reference Meißner C, Meixensberger J, Pretschner A, Neumuth T (2014) Sensor-based surgical activity recognition in unconstrained environments. Minimally Invasive Therapy & Allied Technologies Meißner C, Meixensberger J, Pretschner A, Neumuth T (2014) Sensor-based surgical activity recognition in unconstrained environments. Minimally Invasive Therapy & Allied Technologies
15.
go back to reference Padoy N, Blum T, Feussner H, Berger MO, Navab N (2008) On-line recognition of surgical activity for monitoring in the operating room. In: AAAI, pp 1718–1724 Padoy N, Blum T, Feussner H, Berger MO, Navab N (2008) On-line recognition of surgical activity for monitoring in the operating room. In: AAAI, pp 1718–1724
16.
go back to reference Padoy N, Mateus D, Weinland D, Berger MO, Navab N (2009) Workflow monitoring based on 3d motion features. In: IEEE international conference on computer vision workshops, pp 585–592 (2009) Padoy N, Mateus D, Weinland D, Berger MO, Navab N (2009) Workflow monitoring based on 3d motion features. In: IEEE international conference on computer vision workshops, pp 585–592 (2009)
17.
go back to reference Quinlan R (1993) C4.5: programs for machine learning. Morgan Kaufmann Publishers, San Mateo Quinlan R (1993) C4.5: programs for machine learning. Morgan Kaufmann Publishers, San Mateo
18.
go back to reference Riffaud L, Neumuth T, Morandi X, Trantakis C, Meixensberger J, Burgert O, Trelhu B, Jannin P (2010) Recording of surgical processes: a study comparing senior and junior neurosurgeons during lumbar disc herniation surgery. Neurosurgery 67:325–332CrossRefPubMed Riffaud L, Neumuth T, Morandi X, Trantakis C, Meixensberger J, Burgert O, Trelhu B, Jannin P (2010) Recording of surgical processes: a study comparing senior and junior neurosurgeons during lumbar disc herniation surgery. Neurosurgery 67:325–332CrossRefPubMed
19.
go back to reference Sebban M, NockO R, Chauchat J, Rakotomalala R (2000) Impact of learning set quality and size on decision tree performances. IJCSS 1(1):85 Sebban M, NockO R, Chauchat J, Rakotomalala R (2000) Impact of learning set quality and size on decision tree performances. IJCSS 1(1):85
20.
go back to reference Shi Y, Bobick A, Essa I (2006) Learning temporal sequence model from partially labeled data. In: 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 1631–1638 Shi Y, Bobick A, Essa I (2006) Learning temporal sequence model from partially labeled data. In: 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 1631–1638
21.
go back to reference Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) Random forests for phase detection in surgical workflow analysis. In: Information processing in computer-assisted interventions. Springer, pp 148–157 Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) Random forests for phase detection in surgical workflow analysis. In: Information processing in computer-assisted interventions. Springer, pp 148–157
22.
go back to reference Varadarajan B, Reiley C, Lin H, Khudanpur S, Hager G (2009) Data-derived models for segmentation with application to surgical assessment and training. In: Medical image computing and computer-assisted intervention-MICCAI 2009. Springer, pp 426–434 Varadarajan B, Reiley C, Lin H, Khudanpur S, Hager G (2009) Data-derived models for segmentation with application to surgical assessment and training. In: Medical image computing and computer-assisted intervention-MICCAI 2009. Springer, pp 426–434
23.
go back to reference Ženko B (2008) Learning predictive clustering rules. Informatica 32:95–96 Ženko B (2008) Learning predictive clustering rules. Informatica 32:95–96
Metadata
Title
Automatic phase prediction from low-level surgical activities
Authors
Germain Forestier
Laurent Riffaud
Pierre Jannin
Publication date
01-06-2015
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 6/2015
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1195-0

Other articles of this Issue 6/2015

International Journal of Computer Assisted Radiology and Surgery 6/2015 Go to the issue

Editorial

Preface

Premium Partner