Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 10/2017

10.07.2017 | Review Article

A survey of context recognition in surgery

verfasst von: Igor Pernek, Alois Ferscha

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 10/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the introduction of operating rooms of the future context awareness has gained importance in the surgical environment. This paper organizes and reviews different approaches for recognition of context in surgery. Major electronic research databases were queried to obtain relevant publications submitted between the years 2010 and 2015. Three different types of context were identified: (i) the surgical workflow context, (ii) surgeon’s cognitive and (iii) technical state context. A total of 52 relevant studies were identified and grouped based on the type of context detected and sensors used. Different approaches were summarized to provide recommendations for future research. There is still room for improvement in terms of methods used and evaluations performed. Machine learning should be used more extensively to uncover hidden relationships between different properties of the surgeon’s state, particularly when performing cognitive context recognition. Furthermore, validation protocols should be improved by performing more evaluations in situ and with a higher number of unique participants. The paper also provides a structured outline of recent context recognition methods to facilitate development of new generation context-aware surgical support systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abowd GD, Dey AK, Brown PJ, Davies N, Smith M, Steggles P (1999) Towards a better understanding of context and context-awareness. In: Proceedings of the 1st international symposium on handheld and ubiquitous computing, HUC ’99. Springer-Verlag, London, pp 304–307CrossRef Abowd GD, Dey AK, Brown PJ, Davies N, Smith M, Steggles P (1999) Towards a better understanding of context and context-awareness. In: Proceedings of the 1st international symposium on handheld and ubiquitous computing, HUC ’99. Springer-Verlag, London, pp 304–307CrossRef
2.
Zurück zum Zitat Ahmidi N, Gao Y, Béjar B, Vedula SS, Khudanpur S, Vidal R, Hager GD (2013) String motif-based description of tool motion for detecting skill and gestures in robotic surgery. In: medical image computing and computer-assisted intervention–MICCAI 2013, pp 26–33. Springer Ahmidi N, Gao Y, Béjar B, Vedula SS, Khudanpur S, Vidal R, Hager GD (2013) String motif-based description of tool motion for detecting skill and gestures in robotic surgery. In: medical image computing and computer-assisted intervention–MICCAI 2013, pp 26–33. Springer
3.
Zurück zum Zitat Ahmidi N, Hager GD, Ishii L, Fichtinger G, Gallia GL, Ishii M (2010) Surgical task and skill classification from eye tracking and tool motion in minimally invasive surgery. In: medical image computing and computer-assisted intervention–MICCAI 2010, pp 295–302. Springer Ahmidi N, Hager GD, Ishii L, Fichtinger G, Gallia GL, Ishii M (2010) Surgical task and skill classification from eye tracking and tool motion in minimally invasive surgery. In: medical image computing and computer-assisted intervention–MICCAI 2010, pp 295–302. Springer
4.
Zurück zum Zitat Andreatta PB, Hillard M, Krain LP (2010) The impact of stress factors in simulation-based laparoscopic training. Surgery 147(5):631–639CrossRefPubMed Andreatta PB, Hillard M, Krain LP (2010) The impact of stress factors in simulation-based laparoscopic training. Surgery 147(5):631–639CrossRefPubMed
5.
Zurück zum Zitat Arora S, Sevdalis N, Nestel D, Woloshynowych M, Darzi A, Kneebone R (2010) The impact of stress on surgical performance: a systematic review of the literature. Surgery 147(3):318–330.e6CrossRefPubMed Arora S, Sevdalis N, Nestel D, Woloshynowych M, Darzi A, Kneebone R (2010) The impact of stress on surgical performance: a systematic review of the literature. Surgery 147(3):318–330.e6CrossRefPubMed
6.
Zurück zum Zitat Bardram JE, Doryab A, Jensen RM, Lange PM, Nielsen KL, Petersen ST (2011) Phase recognition during surgical procedures using embedded and body-worn sensors. In: 2011 IEEE international conference on pervasive computing and communications (PerCom), pp 45–53. IEEE Bardram JE, Doryab A, Jensen RM, Lange PM, Nielsen KL, Petersen ST (2011) Phase recognition during surgical procedures using embedded and body-worn sensors. In: 2011 IEEE international conference on pervasive computing and communications (PerCom), pp 45–53. IEEE
7.
Zurück zum Zitat Berguer R, Smith WD, Chung YH (2001) Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surg Endosc 15:1204–1207CrossRefPubMed Berguer R, Smith WD, Chung YH (2001) Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surg Endosc 15:1204–1207CrossRefPubMed
8.
Zurück zum Zitat Bharathan R, Aggarwal R, Darzi A (2013) Operating room of the future. Best Pract Res Cl Ob 27 (3):311–322CrossRef Bharathan R, Aggarwal R, Darzi A (2013) Operating room of the future. Best Pract Res Cl Ob 27 (3):311–322CrossRef
9.
Zurück zum Zitat Bitterman N (2006) Technologies and solutions for data display in the operating room. J Clin Monitor Comp 20(3):165–173CrossRef Bitterman N (2006) Technologies and solutions for data display in the operating room. J Clin Monitor Comp 20(3):165–173CrossRef
10.
Zurück zum Zitat Blum T, Feußner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. In: medical image computing and computer-assisted intervention–MICCAI 2010, pp 400–407. Springer Blum T, Feußner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. In: medical image computing and computer-assisted intervention–MICCAI 2010, pp 400–407. Springer
11.
Zurück zum Zitat Bogner M (2003) Misadventures in health care: inside stories. Human Error and Safety Series. Taylor & Francis Bogner M (2003) Misadventures in health care: inside stories. Human Error and Safety Series. Taylor & Francis
12.
Zurück zum Zitat Bootsma M, Swenne CA, Van Bolhuis HH, Chang PC, Cats VM, Bruschke AV (1994) Heart rate and heart rate variability as indexes of sympathovagal balance. Am J Physiol Heart Circ Physiol 266(4):H1565–H1571 Bootsma M, Swenne CA, Van Bolhuis HH, Chang PC, Cats VM, Bruschke AV (1994) Heart rate and heart rate variability as indexes of sympathovagal balance. Am J Physiol Heart Circ Physiol 266(4):H1565–H1571
13.
Zurück zum Zitat Bricon-Souf N, Newman CR (2007) Context awareness in health care: a review. Int J Med Inform 76 (1):2–12CrossRefPubMed Bricon-Souf N, Newman CR (2007) Context awareness in health care: a review. Int J Med Inform 76 (1):2–12CrossRefPubMed
14.
Zurück zum Zitat Cao C, MacKenzie CL, Payandeh S (1996) Task and motion analyses in endoscopic surgery. In: Proceedings ASME dynamic systems and control division, pp 583–590 Cao C, MacKenzie CL, Payandeh S (1996) Task and motion analyses in endoscopic surgery. In: Proceedings ASME dynamic systems and control division, pp 583–590
15.
Zurück zum Zitat Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12(1):80–90CrossRefPubMed Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12(1):80–90CrossRefPubMed
16.
Zurück zum Zitat Cundy TP, Thangaraj E, Rafii-Tari H, Payne CJ, Azzie G, Sodergren MH, Yang GZ, Darzi A (2015) Force-sensing enhanced simulation environment (ForSense) for laparoscopic surgery training and assessment. Surgery 157(4):723–731CrossRefPubMed Cundy TP, Thangaraj E, Rafii-Tari H, Payne CJ, Azzie G, Sodergren MH, Yang GZ, Darzi A (2015) Force-sensing enhanced simulation environment (ForSense) for laparoscopic surgery training and assessment. Surgery 157(4):723–731CrossRefPubMed
17.
Zurück zum Zitat Cvach M (2012) Monitor alarm fatigue. Biomed Instrum Techn 46(4):268–277CrossRef Cvach M (2012) Monitor alarm fatigue. Biomed Instrum Techn 46(4):268–277CrossRef
18.
Zurück zum Zitat Di Stasi LL, McCamy MB, Macknik SL, Mankin JA, Hooft N, Catena A, Martinez-Conde S (2014) Saccadic eye movement metrics reflect surgical residents fatigue. Ann Surg 259(00):824–829CrossRefPubMed Di Stasi LL, McCamy MB, Macknik SL, Mankin JA, Hooft N, Catena A, Martinez-Conde S (2014) Saccadic eye movement metrics reflect surgical residents fatigue. Ann Surg 259(00):824–829CrossRefPubMed
19.
Zurück zum Zitat van Dooren M, de Vries JGJ, Janssen JH (2012) Emotional sweating across the body: comparing 16 different skin conductance measurement locations. Physiol Behav 106(2):298–304 van Dooren M, de Vries JGJ, Janssen JH (2012) Emotional sweating across the body: comparing 16 different skin conductance measurement locations. Physiol Behav 106(2):298–304
20.
Zurück zum Zitat Egi H, Okajima M, Kawahara T, Yoshimitsu M, Sumitani D, Tokunaga M, Takeda H, Itamoto T, Ohdan H (2010) Scientific assessment of endoscopic surgical skills. Minim Invasiv Ther 19(1):30–34CrossRef Egi H, Okajima M, Kawahara T, Yoshimitsu M, Sumitani D, Tokunaga M, Takeda H, Itamoto T, Ohdan H (2010) Scientific assessment of endoscopic surgical skills. Minim Invasiv Ther 19(1):30–34CrossRef
21.
Zurück zum Zitat El-Fakdi A, Gamero F, Meléndez J, Auffret V, Haigron P (2014) EXiTCDSS: A framework for a workflow-based CBR for interventional clinical decision support systems and its application to TAVI. Expert Syst Appl 41(2):284–294CrossRef El-Fakdi A, Gamero F, Meléndez J, Auffret V, Haigron P (2014) EXiTCDSS: A framework for a workflow-based CBR for interventional clinical decision support systems and its application to TAVI. Expert Syst Appl 41(2):284–294CrossRef
22.
Zurück zum Zitat Engert V, Vogel S, Efanov SI, Duchesne A, Corbo V, Ali N, Pruessner JC (2011) Investigation into the cross-correlation of salivary cortisol and alpha-amylase responses to psychological stress. Psychoneuroendocrino 36(9):1294–1302CrossRef Engert V, Vogel S, Efanov SI, Duchesne A, Corbo V, Ali N, Pruessner JC (2011) Investigation into the cross-correlation of salivary cortisol and alpha-amylase responses to psychological stress. Psychoneuroendocrino 36(9):1294–1302CrossRef
23.
Zurück zum Zitat Ericsson KA, Simon HA (1980) Verbal reports as data. Psychol Rev 87(3):215CrossRef Ericsson KA, Simon HA (1980) Verbal reports as data. Psychol Rev 87(3):215CrossRef
24.
Zurück zum Zitat Franke S, Meixensberger J, Neumuth T (2013) Intervention time prediction from surgical low-level tasks. J Biomed Inform 46(1):152–159CrossRefPubMed Franke S, Meixensberger J, Neumuth T (2013) Intervention time prediction from surgical low-level tasks. J Biomed Inform 46(1):152–159CrossRefPubMed
25.
Zurück zum Zitat Franke S, Meixensberger J, Neumuth T (2015) Multi-perspective workflow modeling for online surgical situation models. J Biomed Inform 54:158–166CrossRefPubMed Franke S, Meixensberger J, Neumuth T (2015) Multi-perspective workflow modeling for online surgical situation models. J Biomed Inform 54:158–166CrossRefPubMed
26.
Zurück zum Zitat Fritz T, Begel A, Müller SC, Yigit-Elliott S, Züger M (2014) Using psycho-physiological measures to assess task difficulty in software development. In: Proceedings of the 36th international conference on software engineering, pp 402–413. ACM Fritz T, Begel A, Müller SC, Yigit-Elliott S, Züger M (2014) Using psycho-physiological measures to assess task difficulty in software development. In: Proceedings of the 36th international conference on software engineering, pp 402–413. ACM
27.
Zurück zum Zitat Gaggioli A, Pallavicini F, Morganti L, Serino S, Scaratti C, Briguglio M, Crifaci G, Vetrano N, Giulintano A, Bernava G, Tartarisco G, Pioggia G, Raspelli S, Cipresso P, Vigna C, Grassi A, Baruffi M, Wiederhold B, Riva G (2014) Experiential virtual scenarios with real-time monitoring (interreality) for the management of psychological stress: a block randomized controlled trial. J Med Internet Res 16(7):e167CrossRefPubMedPubMedCentral Gaggioli A, Pallavicini F, Morganti L, Serino S, Scaratti C, Briguglio M, Crifaci G, Vetrano N, Giulintano A, Bernava G, Tartarisco G, Pioggia G, Raspelli S, Cipresso P, Vigna C, Grassi A, Baruffi M, Wiederhold B, Riva G (2014) Experiential virtual scenarios with real-time monitoring (interreality) for the management of psychological stress: a block randomized controlled trial. J Med Internet Res 16(7):e167CrossRefPubMedPubMedCentral
28.
Zurück zum Zitat Gallina S, Di Mauro M, D’Amico MA, D’Angelo E, Sablone A, Di Fonso A, Bascelli A, Izzicupo P, Di Baldassarre A (2011) Salivary chromogranin A, but not α-amylase, correlates with cardiovascular parameters during high-intensity exercise. Clin Endocrinol 75(6):747–752CrossRef Gallina S, Di Mauro M, D’Amico MA, D’Angelo E, Sablone A, Di Fonso A, Bascelli A, Izzicupo P, Di Baldassarre A (2011) Salivary chromogranin A, but not α-amylase, correlates with cardiovascular parameters during high-intensity exercise. Clin Endocrinol 75(6):747–752CrossRef
29.
Zurück zum Zitat Garbarino M, Lai M, Tognetti S, Picard R, Bender D (2014) Empatica E3 - a wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In: 4th international conference on wireless mobile communication and healthcare - transforming healthcare through innovations in mobile and wireless technologies Garbarino M, Lai M, Tognetti S, Picard R, Bender D (2014) Empatica E3 - a wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In: 4th international conference on wireless mobile communication and healthcare - transforming healthcare through innovations in mobile and wireless technologies
30.
Zurück zum Zitat Gibson JNA, Cowie JG, Iprenburg M (2012) Transforaminal endoscopic spinal surgery: the future ‘gold standard’ for discectomy?—a review. Surg J R Coll Surg E 10(5):290–296 Gibson JNA, Cowie JG, Iprenburg M (2012) Transforaminal endoscopic spinal surgery: the future ‘gold standard’ for discectomy?—a review. Surg J R Coll Surg E 10(5):290–296
31.
Zurück zum Zitat Glaser B, Dänzer S, Neumuth T (2015) Intra-operative surgical instrument usage detection on a multi-sensor table. Int J Comput Assist Radiol Surg 10(3):351–362CrossRefPubMed Glaser B, Dänzer S, Neumuth T (2015) Intra-operative surgical instrument usage detection on a multi-sensor table. Int J Comput Assist Radiol Surg 10(3):351–362CrossRefPubMed
32.
Zurück zum Zitat Groscurth P (2002) Anatomy of sweat glands. Hyperhidrosis and Botulinum Toxin in Dermatology 30 Groscurth P (2002) Anatomy of sweat glands. Hyperhidrosis and Botulinum Toxin in Dermatology 30
33.
Zurück zum Zitat Guru KA, Esfahani ET, Raza SJ, Bhat R, Wang K, Hammond Y, Wilding G, Peabody JO, Chowriappa AJ (2015) Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff. BJU Int 115(1):166–174CrossRefPubMed Guru KA, Esfahani ET, Raza SJ, Bhat R, Wang K, Hammond Y, Wilding G, Peabody JO, Chowriappa AJ (2015) Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff. BJU Int 115(1):166–174CrossRefPubMed
34.
Zurück zum Zitat Harada K, Minakawa Y, Baek Y, Kozuka Y, Sora S, Morita A, Sugita N, Mitsuishi M (2011) Microsurgical skill assessment: toward skill-based surgical robotic control. In: Engineering in medicine and biology society, EMBC, 2011 Annual international conference of the IEEE, pp 6700–6703. IEEE Harada K, Minakawa Y, Baek Y, Kozuka Y, Sora S, Morita A, Sugita N, Mitsuishi M (2011) Microsurgical skill assessment: toward skill-based surgical robotic control. In: Engineering in medicine and biology society, EMBC, 2011 Annual international conference of the IEEE, pp 6700–6703. IEEE
35.
Zurück zum Zitat Haro BB, Zappella L, Vidal R (2012) Surgical gesture classification from video data. In: Medical image computing and computer-assisted intervention–MICCAI 2012, pp 34–41. Springer Haro BB, Zappella L, Vidal R (2012) Surgical gesture classification from video data. In: Medical image computing and computer-assisted intervention–MICCAI 2012, pp 34–41. Springer
36.
Zurück zum Zitat Harvey A, Vickers JN, Snelgrove R, Scott MF, Morrison S (2014) Expert surgeon’s quiet eye and slowing down: expertise differences in performance and quiet eye duration during identification and dissection of the recurrent laryngeal nerve. Am J Surg 207(2):187–193CrossRefPubMed Harvey A, Vickers JN, Snelgrove R, Scott MF, Morrison S (2014) Expert surgeon’s quiet eye and slowing down: expertise differences in performance and quiet eye duration during identification and dissection of the recurrent laryngeal nerve. Am J Surg 207(2):187–193CrossRefPubMed
37.
Zurück zum Zitat Hofstad EF, Vå penstad C, Chmarra MK, Langø T, Kuhry E, Mårvik R (2013) A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance. Surg Endosc 27(3):854–863CrossRefPubMed Hofstad EF, Vå penstad C, Chmarra MK, Langø T, Kuhry E, Mårvik R (2013) A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance. Surg Endosc 27(3):854–863CrossRefPubMed
38.
Zurück zum Zitat Hong JY, Suh EH, Kim SJ (2009) Context-aware systems: a literature review and classification. Expert Syst Appl 36(4):8509–8522CrossRef Hong JY, Suh EH, Kim SJ (2009) Context-aware systems: a literature review and classification. Expert Syst Appl 36(4):8509–8522CrossRef
39.
Zurück zum Zitat Hsu KE, Man FY, Gizicki RA, Feldman LS, Fried GM (2008) Experienced surgeons can do more than one thing at a time: effect of distraction on performance of a simple laparoscopic and cognitive task by experienced and novice surgeons. Surg Endosc 22:196–201CrossRefPubMed Hsu KE, Man FY, Gizicki RA, Feldman LS, Fried GM (2008) Experienced surgeons can do more than one thing at a time: effect of distraction on performance of a simple laparoscopic and cognitive task by experienced and novice surgeons. Surg Endosc 22:196–201CrossRefPubMed
40.
Zurück zum Zitat Hughes-Hallett A, Mayer EK, Marcus HJ, Pratt P, Mason S, Darzi A, Vale JA (2015) Inattention blindness in surgery. Surg Endosc Hughes-Hallett A, Mayer EK, Marcus HJ, Pratt P, Mason S, Darzi A, Vale JA (2015) Inattention blindness in surgery. Surg Endosc
41.
Zurück zum Zitat Jiang X, Zheng B, Tien G, Atkins MS (2013) Pupil response to precision in surgical task execution. St Heal T 184:210–214 Jiang X, Zheng B, Tien G, Atkins MS (2013) Pupil response to precision in surgical task execution. St Heal T 184:210–214
42.
Zurück zum Zitat Jones KI, Amawi F, Bhalla A, Peacock O, Williams JP, Lund JN (2015) Assessing surgeon stress when operating using heart rate variability and the state trait anxiety inventory: will surgery be the death of us? Colorectal Dis 17(4):335–341CrossRefPubMed Jones KI, Amawi F, Bhalla A, Peacock O, Williams JP, Lund JN (2015) Assessing surgeon stress when operating using heart rate variability and the state trait anxiety inventory: will surgery be the death of us? Colorectal Dis 17(4):335–341CrossRefPubMed
43.
Zurück zum Zitat Kirby GS, Kwasnicki RM, Hargrove C, Rees JL, Sodergren MH, Yang GZ, Lo BP (2014) Wireless body sensor for objective assessment of surgical performance on a standardised fls task. In: Proceedings of the 9th international conference on body area networks, pp 147–153. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering) Kirby GS, Kwasnicki RM, Hargrove C, Rees JL, Sodergren MH, Yang GZ, Lo BP (2014) Wireless body sensor for objective assessment of surgical performance on a standardised fls task. In: Proceedings of the 9th international conference on body area networks, pp 147–153. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)
44.
Zurück zum Zitat Kuhn EW, Choi YH, Schönherr M, Liakopoulos OJ, Rahmanian PB, Choi CYU, Wittwer T, Wahlers T (2013) Intraoperative stress in cardiac surgery: attendings versus residents. J Surg Res 182(2):e43—9CrossRefPubMed Kuhn EW, Choi YH, Schönherr M, Liakopoulos OJ, Rahmanian PB, Choi CYU, Wittwer T, Wahlers T (2013) Intraoperative stress in cardiac surgery: attendings versus residents. J Surg Res 182(2):e43—9CrossRefPubMed
45.
Zurück zum Zitat Kurita Y, Tsuji T, Kawahara T (2013) Force-based automatic classification of basic manipulations with grasping forceps. Int J Life Sci Med Res 3(2):76–82CrossRef Kurita Y, Tsuji T, Kawahara T (2013) Force-based automatic classification of basic manipulations with grasping forceps. Int J Life Sci Med Res 3(2):76–82CrossRef
46.
Zurück zum Zitat Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49CrossRefPubMed Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49CrossRefPubMed
47.
Zurück zum Zitat Lalys F, Jannin P (2014) Surgical process modelling: a review. Int J Comput Assist Radiol Surg 9(3):495–511CrossRefPubMed Lalys F, Jannin P (2014) Surgical process modelling: a review. Int J Comput Assist Radiol Surg 9(3):495–511CrossRefPubMed
48.
Zurück zum Zitat Lalys F, Riffaud L, Bouget D, Jannin P (2011) An application-dependent framework for the recognition of high-level surgical tasks in the OR. In: Medical image computing and computer-assisted intervention–MICCAI 2011, pp 331–338. Springer Lalys F, Riffaud L, Bouget D, Jannin P (2011) An application-dependent framework for the recognition of high-level surgical tasks in the OR. In: Medical image computing and computer-assisted intervention–MICCAI 2011, pp 331–338. Springer
49.
Zurück zum Zitat Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining svm and hmm. In: Medical computer vision. Recognition Techniques and Applications in Medical Imaging, pp 54–62. Springer Lalys F, Riffaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining svm and hmm. In: Medical computer vision. Recognition Techniques and Applications in Medical Imaging, pp 54–62. Springer
50.
Zurück zum Zitat Lea C, Hager GD, Vidal R (2015) An improved model for segmentation and recognition of fine-grained activities with application to surgical training tasks. In: Applications of computer vision (WACV), 2015 IEEE winter conference on, pp 1123–1129. IEEE Lea C, Hager GD, Vidal R (2015) An improved model for segmentation and recognition of fine-grained activities with application to surgical training tasks. In: Applications of computer vision (WACV), 2015 IEEE winter conference on, pp 1123–1129. IEEE
51.
Zurück zum Zitat Loukas C, Georgiou E (2011) Multivariate autoregressive modeling of hand kinematics for laparoscopic skills assessment of surgical trainees. IEEE Trans Biomed Eng 58(11):3289– 3297CrossRefPubMed Loukas C, Georgiou E (2011) Multivariate autoregressive modeling of hand kinematics for laparoscopic skills assessment of surgical trainees. IEEE Trans Biomed Eng 58(11):3289– 3297CrossRefPubMed
52.
Zurück zum Zitat Loukas C, Georgiou E (2013) Surgical workflow analysis with Gaussian mixture multivariate autoregressive (GMMAR) models: a simulation study. Comput Aided Surg 18(3-4):47–62CrossRefPubMed Loukas C, Georgiou E (2013) Surgical workflow analysis with Gaussian mixture multivariate autoregressive (GMMAR) models: a simulation study. Comput Aided Surg 18(3-4):47–62CrossRefPubMed
53.
Zurück zum Zitat Loukas C, Rouseas C, Georgiou E (2013) The role of hand motion connectivity in the performance of laparoscopic procedures on a virtual reality simulator. Med Biol Eng Comput 51(8):911– 922CrossRefPubMed Loukas C, Rouseas C, Georgiou E (2013) The role of hand motion connectivity in the performance of laparoscopic procedures on a virtual reality simulator. Med Biol Eng Comput 51(8):911– 922CrossRefPubMed
54.
Zurück zum Zitat Meißner C, Meixensberger J, Pretschner A, Neumuth T (2014) Sensor-based surgical activity recognition in unconstrained environments. Minim Invasiv Ther 23(4):198–205CrossRef Meißner C, Meixensberger J, Pretschner A, Neumuth T (2014) Sensor-based surgical activity recognition in unconstrained environments. Minim Invasiv Ther 23(4):198–205CrossRef
55.
Zurück zum Zitat Muaremi A, Arnrich B, Tröster G (2013) Towards measuring stress with smartphones and wearable devices during workday and sleep. J Bionanosci 3(2):172–183CrossRef Muaremi A, Arnrich B, Tröster G (2013) Towards measuring stress with smartphones and wearable devices during workday and sleep. J Bionanosci 3(2):172–183CrossRef
56.
Zurück zum Zitat Neumuth T, Meißner C (2012) Online recognition of surgical instruments by information fusion. Int J Comput Assist Radiol Surg 7(2):297–304CrossRefPubMed Neumuth T, Meißner C (2012) Online recognition of surgical instruments by information fusion. Int J Comput Assist Radiol Surg 7(2):297–304CrossRefPubMed
57.
Zurück zum Zitat Overby DW, Watson RA (2014) Hand motion patterns of fundamentals of laparoscopic surgery certified and noncertified surgeons. Am J Surg 207(2):226–230CrossRefPubMed Overby DW, Watson RA (2014) Hand motion patterns of fundamentals of laparoscopic surgery certified and noncertified surgeons. Am J Surg 207(2):226–230CrossRefPubMed
58.
Zurück zum Zitat Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2012) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641CrossRefPubMed Padoy N, Blum T, Ahmadi SA, Feussner H, Berger MO, Navab N (2012) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632–641CrossRefPubMed
59.
Zurück zum Zitat Phitayakorn R, Minehart RD, Hemingway MW, Pian-Smith MCM, Petrusa E (2015) Relationship between physiologic and psychological measures of autonomic activation in operating room teams during a simulated airway emergency. Am J Surg 209(1):86–92CrossRefPubMed Phitayakorn R, Minehart RD, Hemingway MW, Pian-Smith MCM, Petrusa E (2015) Relationship between physiologic and psychological measures of autonomic activation in operating room teams during a simulated airway emergency. Am J Surg 209(1):86–92CrossRefPubMed
60.
Zurück zum Zitat Phitayakorn R, Minehart RD, Pian-Smith MCM, Hemingway MW, Petrusa ER (2015) Practicality of using galvanic skin response to measure intraoperative physiologic autonomic activation in operating room team members. Surgery 158(5):1415–20CrossRefPubMed Phitayakorn R, Minehart RD, Pian-Smith MCM, Hemingway MW, Petrusa ER (2015) Practicality of using galvanic skin response to measure intraoperative physiologic autonomic activation in operating room team members. Surgery 158(5):1415–20CrossRefPubMed
61.
Zurück zum Zitat Poddar P, Ahmidi N, Vedula SS, Ishii L, Hager GD (2014) Automated objective surgical skill assessment in the operating room using unstructured tool motion. Med Image Comput Comput Assist Interv Poddar P, Ahmidi N, Vedula SS, Ishii L, Hager GD (2014) Automated objective surgical skill assessment in the operating room using unstructured tool motion. Med Image Comput Comput Assist Interv
62.
Zurück zum Zitat Prichard RS, O’Neill CJ, Oucharek JJ, Holmes CYV, Colinda YH, Delbridge LW, Sywak MS (2012) A prospective study of heart rate variability in endocrine surgery: surgical training increases consultant’s mental strain. J Surg Educ 69(4):453–8CrossRefPubMed Prichard RS, O’Neill CJ, Oucharek JJ, Holmes CYV, Colinda YH, Delbridge LW, Sywak MS (2012) A prospective study of heart rate variability in endocrine surgery: surgical training increases consultant’s mental strain. J Surg Educ 69(4):453–8CrossRefPubMed
63.
Zurück zum Zitat Quellec G, Lamard M, Cochener B, Cazuguel G (2014) Real-time segmentation and recognition of surgical tasks in cataract surgery videos. IEEE T Med Imaging 33(12):2352–2360CrossRef Quellec G, Lamard M, Cochener B, Cazuguel G (2014) Real-time segmentation and recognition of surgical tasks in cataract surgery videos. IEEE T Med Imaging 33(12):2352–2360CrossRef
64.
Zurück zum Zitat Quellec G, Lamard M, Cochener B, Cazuguel G (2015) Real-time task recognition in cataract surgery videos using adaptive spatiotemporal polynomials. IEEE T Med Imaging 34(4):877– 887CrossRef Quellec G, Lamard M, Cochener B, Cazuguel G (2015) Real-time task recognition in cataract surgery videos using adaptive spatiotemporal polynomials. IEEE T Med Imaging 34(4):877– 887CrossRef
65.
Zurück zum Zitat Regehr G, MacRae H, Reznick RK, Szalay D (1998) Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 73(9):993–997CrossRefPubMed Regehr G, MacRae H, Reznick RK, Szalay D (1998) Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 73(9):993–997CrossRefPubMed
66.
Zurück zum Zitat Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR (2010) Eye metrics as an objective assessment of surgical skill. Ann Surg 252(1):177–182CrossRefPubMed Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR (2010) Eye metrics as an objective assessment of surgical skill. Ann Surg 252(1):177–182CrossRefPubMed
67.
Zurück zum Zitat Rieger A, Fenger S, Neubert S, Weippert M, Kreuzfeld S, Stoll R (2015) Psychophysical workload in the operating room: primary surgeon versus assistant. Surg Endosc 29(7):1990– 1998CrossRefPubMed Rieger A, Fenger S, Neubert S, Weippert M, Kreuzfeld S, Stoll R (2015) Psychophysical workload in the operating room: primary surgeon versus assistant. Surg Endosc 29(7):1990– 1998CrossRefPubMed
68.
Zurück zum Zitat Rieger A, Stoll R, Kreuzfeld S, Behrens K, Weippert M (2014) Heart rate and heart rate variability as indirect markers of surgeons’ intraoperative stress. Int Arch Occup Environ Health 87(2):165–174CrossRefPubMed Rieger A, Stoll R, Kreuzfeld S, Behrens K, Weippert M (2014) Heart rate and heart rate variability as indirect markers of surgeons’ intraoperative stress. Int Arch Occup Environ Health 87(2):165–174CrossRefPubMed
69.
Zurück zum Zitat Rutherford DN, D’Angelo ALD, Law KE, Pugh CM (2015) Advanced engineering technology for measuring performance. Surg Clin North Am 95(4):813–26CrossRefPubMed Rutherford DN, D’Angelo ALD, Law KE, Pugh CM (2015) Advanced engineering technology for measuring performance. Surg Clin North Am 95(4):813–26CrossRefPubMed
70.
Zurück zum Zitat Schulz CM, Schneider E, Fritz L, Vockeroth J, Hapfelmeier A, Wasmaier M, Kochs EF, Schneider G (2011) Eye tracking for assessment of workload: a pilot study in an anaesthesia simulator environment. Brit J Anaesth 106(October 2010):44–50CrossRefPubMed Schulz CM, Schneider E, Fritz L, Vockeroth J, Hapfelmeier A, Wasmaier M, Kochs EF, Schneider G (2011) Eye tracking for assessment of workload: a pilot study in an anaesthesia simulator environment. Brit J Anaesth 106(October 2010):44–50CrossRefPubMed
71.
Zurück zum Zitat Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) Random forests for phase detection in surgical workflow analysis. In: Information processing in computer-assisted interventions, pp 148–157. Springer Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) Random forests for phase detection in surgical workflow analysis. In: Information processing in computer-assisted interventions, pp 148–157. Springer
72.
Zurück zum Zitat Stefanidis D, Wang F, Korndorffer JR, Dunne JB, Scott DJ (2010) Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload. Surg Endosc 24:377–382CrossRefPubMed Stefanidis D, Wang F, Korndorffer JR, Dunne JB, Scott DJ (2010) Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload. Surg Endosc 24:377–382CrossRefPubMed
73.
Zurück zum Zitat Tao L, Elhamifar E, Khudanpur S, Hager GD, Vidal R (2012) Sparse hidden Markov models for surgical gesture classification and skill evaluation. In: Information processing in computer-assisted interventions, pp 167–177. Springer Tao L, Elhamifar E, Khudanpur S, Hager GD, Vidal R (2012) Sparse hidden Markov models for surgical gesture classification and skill evaluation. In: Information processing in computer-assisted interventions, pp 167–177. Springer
74.
Zurück zum Zitat Tao L, Zappella L, Hager GD, Vidal R (2013) Surgical gesture segmentation and recognition. In: Medical image computing and computer-assisted intervention–MICCAI 2013, pp 339–346. Springer Tao L, Zappella L, Hager GD, Vidal R (2013) Surgical gesture segmentation and recognition. In: Medical image computing and computer-assisted intervention–MICCAI 2013, pp 339–346. Springer
75.
Zurück zum Zitat Thiemjarus S, James A, Yang GZ (2012) An eye-hand data fusion framework for pervasive sensing of surgical activities. Pattern Recogn 45(8):2855–2867CrossRef Thiemjarus S, James A, Yang GZ (2012) An eye-hand data fusion framework for pervasive sensing of surgical activities. Pattern Recogn 45(8):2855–2867CrossRef
76.
Zurück zum Zitat Tien G, Zheng B, Atkins MS (2011) Quantifying surgeons’ vigilance during laparoscopic operations using eyegaze tracking. St Heal T 163:658–662 Tien G, Zheng B, Atkins MS (2011) Quantifying surgeons’ vigilance during laparoscopic operations using eyegaze tracking. St Heal T 163:658–662
77.
Zurück zum Zitat Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang GZ, Darzi A (2014) Differences in gaze behaviour of expert and junior surgeons performing open inguinal hernia repair. Surg Endosc 2: 405–413 Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang GZ, Darzi A (2014) Differences in gaze behaviour of expert and junior surgeons performing open inguinal hernia repair. Surg Endosc 2: 405–413
78.
Zurück zum Zitat Tomasko JM, Pauli EM, Kunselman AR, Haluck RS (2012) Sleep deprivation increases cognitive workload during simulated surgical tasks. Am J Surg 203(1):37–43CrossRefPubMed Tomasko JM, Pauli EM, Kunselman AR, Haluck RS (2012) Sleep deprivation increases cognitive workload during simulated surgical tasks. Am J Surg 203(1):37–43CrossRefPubMed
79.
Zurück zum Zitat Twinanda AP, Marescaux J, De Mathelin M, Padoy N (2014) Towards better laparoscopic video database organization by automatic surgery classification. In: Information processing in computer-assisted interventions, pp 186–195. Springer Twinanda AP, Marescaux J, De Mathelin M, Padoy N (2014) Towards better laparoscopic video database organization by automatic surgery classification. In: Information processing in computer-assisted interventions, pp 186–195. Springer
80.
Zurück zum Zitat Uemura M, Tomikawa M, Kumashiro R, Miao T, Souzaki R, Ieiri S, Ohuchida K, Lefor AT, Hashizume M (2014) Analysis of hand motion differentiates expert and novice surgeons. J Surg Resh 188(1):8–13CrossRef Uemura M, Tomikawa M, Kumashiro R, Miao T, Souzaki R, Ieiri S, Ohuchida K, Lefor AT, Hashizume M (2014) Analysis of hand motion differentiates expert and novice surgeons. J Surg Resh 188(1):8–13CrossRef
81.
Zurück zum Zitat Unger M, Chalopin C, Neumuth T (2014) Vision-based online recognition of surgical activities. Int J Comput Assist Radiol Surg 9:979–986CrossRefPubMed Unger M, Chalopin C, Neumuth T (2014) Vision-based online recognition of surgical activities. Int J Comput Assist Radiol Surg 9:979–986CrossRefPubMed
82.
Zurück zum Zitat Watson RA (2012) Computer-aided feedback of surgical knot tying using optical tracking. J Surg Educ 69 (3):306–310CrossRefPubMed Watson RA (2012) Computer-aided feedback of surgical knot tying using optical tracking. J Surg Educ 69 (3):306–310CrossRefPubMed
83.
Zurück zum Zitat Watson RA (2013) Quantification of surgical technique using an inertial measurement unit. Simul Healthc 8 (3):162–165CrossRefPubMed Watson RA (2013) Quantification of surgical technique using an inertial measurement unit. Simul Healthc 8 (3):162–165CrossRefPubMed
84.
Zurück zum Zitat Watson RA (2014) Use of a machine learning algorithm to classify expertise: analysis of hand motion patterns during a simulated surgical task. Acad Med 89(8):1–5CrossRef Watson RA (2014) Use of a machine learning algorithm to classify expertise: analysis of hand motion patterns during a simulated surgical task. Acad Med 89(8):1–5CrossRef
85.
Zurück zum Zitat Wilson M, McGrath J, Vine S, Brewer J, Defriend D, Masters R (2010) Psychomotor control in a virtual laparoscopic surgery training environment: gaze control parameters differentiate novices from experts. Surg Endosc 24(10):2458–2464CrossRefPubMedPubMedCentral Wilson M, McGrath J, Vine S, Brewer J, Defriend D, Masters R (2010) Psychomotor control in a virtual laparoscopic surgery training environment: gaze control parameters differentiate novices from experts. Surg Endosc 24(10):2458–2464CrossRefPubMedPubMedCentral
86.
Zurück zum Zitat Wilson MR, McGrath JS, Vine SJ, Brewer J, Defriend D, Masters RSW (2011) Perceptual impairment and psychomotor control in virtual laparoscopic surgery. Surg Endosc 25:2268–2274CrossRefPubMedPubMedCentral Wilson MR, McGrath JS, Vine SJ, Brewer J, Defriend D, Masters RSW (2011) Perceptual impairment and psychomotor control in virtual laparoscopic surgery. Surg Endosc 25:2268–2274CrossRefPubMedPubMedCentral
87.
Zurück zum Zitat Wilson MR, Poolton JM, Malhotra N, Ngo K, Bright E, Masters RSW (2011) Development and validation of a surgical workload measure: the surgery task load index (SURG-TLX). World J Surg 35(9):1961–1969CrossRefPubMedPubMedCentral Wilson MR, Poolton JM, Malhotra N, Ngo K, Bright E, Masters RSW (2011) Development and validation of a surgical workload measure: the surgery task load index (SURG-TLX). World J Surg 35(9):1961–1969CrossRefPubMedPubMedCentral
88.
Zurück zum Zitat Wilson MR, Vine SJ, Bright E, Masters RSW, Defriend D, McGrath JS (2011) Gaze training enhances laparoscopic technical skill acquisition and multi-tasking performance: a randomized, controlled study. Surg Endosc 25:3731–3739CrossRefPubMedPubMedCentral Wilson MR, Vine SJ, Bright E, Masters RSW, Defriend D, McGrath JS (2011) Gaze training enhances laparoscopic technical skill acquisition and multi-tasking performance: a randomized, controlled study. Surg Endosc 25:3731–3739CrossRefPubMedPubMedCentral
89.
Zurück zum Zitat Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D (2010) Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul Healthc 5(5):267–271CrossRefPubMed Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D (2010) Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul Healthc 5(5):267–271CrossRefPubMed
90.
Zurück zum Zitat Zheng B, Cassera MA, Martinec DV, Spaun GO, Swanström LL (2010) Measuring mental workload during the performance of advanced laparoscopic tasks. Surg Endosc 24:45–50CrossRefPubMed Zheng B, Cassera MA, Martinec DV, Spaun GO, Swanström LL (2010) Measuring mental workload during the performance of advanced laparoscopic tasks. Surg Endosc 24:45–50CrossRefPubMed
91.
Zurück zum Zitat Zheng B, Jiang X, Atkins MS (2015) Detection of changes in surgical difficulty: evidence from pupil responses. Surg Innov 22: 1–7CrossRef Zheng B, Jiang X, Atkins MS (2015) Detection of changes in surgical difficulty: evidence from pupil responses. Surg Innov 22: 1–7CrossRef
92.
Zurück zum Zitat Zheng B, Jiang X, Tien G, Meneghetti A, Panton ONM, Atkins MS (2012) Workload assessment of surgeons: correlation between NASA TLX and blinks. Surg Endosc 26:2746–2750CrossRefPubMed Zheng B, Jiang X, Tien G, Meneghetti A, Panton ONM, Atkins MS (2012) Workload assessment of surgeons: correlation between NASA TLX and blinks. Surg Endosc 26:2746–2750CrossRefPubMed
93.
Zurück zum Zitat Zheng B, Tien G, Atkins SM, Swindells C, Tanin H, Meneghetti A, Qayumi KA, Neely O, Panton M (2011) Surgeon’s vigilance in the operating room. Am J Surg 201(5):667–671CrossRef Zheng B, Tien G, Atkins SM, Swindells C, Tanin H, Meneghetti A, Qayumi KA, Neely O, Panton M (2011) Surgeon’s vigilance in the operating room. Am J Surg 201(5):667–671CrossRef
Metadaten
Titel
A survey of context recognition in surgery
verfasst von
Igor Pernek
Alois Ferscha
Publikationsdatum
10.07.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 10/2017
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-017-1670-6

Weitere Artikel der Ausgabe 10/2017

Medical & Biological Engineering & Computing 10/2017 Zur Ausgabe

Premium Partner