Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2017

24.01.2017 | Original Article

Comparison of gesture and conventional interaction techniques for interventional neuroradiology

verfasst von: Julian Hettig, Patrick Saalfeld, Maria Luz, Mathias Becker, Martin Skalej, Christian Hansen

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Interaction with radiological image data and volume renderings within a sterile environment is a challenging task. Clinically established methods such as joystick control and task delegation can be time-consuming and error-prone and interrupt the workflow. New touchless input modalities may have the potential to overcome these limitations, but their value compared to established methods is unclear.

Methods

We present a comparative evaluation to analyze the value of two gesture input modalities (Myo Gesture Control Armband and Leap Motion Controller) versus two clinically established methods (task delegation and joystick control). A user study was conducted with ten experienced radiologists by simulating a diagnostic neuroradiological vascular treatment with two frequently used interaction tasks in an experimental operating room. The input modalities were assessed using task completion time, perceived task difficulty, and subjective workload.

Results

Overall, the clinically established method of task delegation performed best under the study conditions. In general, gesture control failed to exceed the clinical input approach. However, the Myo Gesture Control Armband showed a potential for simple image selection task.

Conclusion

Novel input modalities have the potential to take over single tasks more efficiently than clinically established methods. The results of our user study show the relevance of task characteristics such as task complexity on performance with specific input modalities. Accordingly, future work should consider task characteristics to provide a useful gesture interface for a specific use case instead of an all-in-one solution.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ahmed K, Keeling AN, Khan RS, Ashrafian H, Arora S, Nagpal K, Burrill J, Darzi A, Athanasiou T, Hamady M (2010) What does competence entail in interventional radiology? Cardiovasc Interv Radiol 33(1):3–10CrossRef Ahmed K, Keeling AN, Khan RS, Ashrafian H, Arora S, Nagpal K, Burrill J, Darzi A, Athanasiou T, Hamady M (2010) What does competence entail in interventional radiology? Cardiovasc Interv Radiol 33(1):3–10CrossRef
2.
Zurück zum Zitat Bigdelou A, Schwarz L, Navab N (2012) An adaptive solution for intra-operative gesture-based human-machine interaction. In: Proceedings of the international conference on intelligent user interfaces, ACM, pp 75–84 Bigdelou A, Schwarz L, Navab N (2012) An adaptive solution for intra-operative gesture-based human-machine interaction. In: Proceedings of the international conference on intelligent user interfaces, ACM, pp 75–84
3.
Zurück zum Zitat Bizzotto N, Costanzo A, Bizzotto L, Regis D, Sandri A, Magnan B (2014) Leap motion gesture control with OsiriX in the operating room to control imaging first experiences during live surgery. Surg Innov 1:655–656CrossRef Bizzotto N, Costanzo A, Bizzotto L, Regis D, Sandri A, Magnan B (2014) Leap motion gesture control with OsiriX in the operating room to control imaging first experiences during live surgery. Surg Innov 1:655–656CrossRef
4.
Zurück zum Zitat Gallo L (2013) A study on the degrees of freedom in touchless interaction. In: SIGGRAPH Asia 2013 Technical briefs, ACM, p 28 Gallo L (2013) A study on the degrees of freedom in touchless interaction. In: SIGGRAPH Asia 2013 Technical briefs, ACM, p 28
5.
Zurück zum Zitat Göbel F, Klamka K, Siegel A, Vogt S, Stellmach S, Dachselt R (2013) Gaze-supported foot interaction in zoomable information spaces. In: Extended abstracts on human factors in computing systems (CHI EA ’13). ACM, New York, USA, pp 3059–3062. doi:10.1145/2468356.2479610 Göbel F, Klamka K, Siegel A, Vogt S, Stellmach S, Dachselt R (2013) Gaze-supported foot interaction in zoomable information spaces. In: Extended abstracts on human factors in computing systems (CHI EA ’13). ACM, New York, USA, pp 3059–3062. doi:10.​1145/​2468356.​2479610
7.
Zurück zum Zitat Hettig J, Mewes A, Riabikin O, Skalej M, Preim B, Hansen C (2015) Exploration of 3D medical image data for interventional radiology using myoelectric gesture control. In: Eurographics workshop on visual computing for biology and medicine, pp 177–185 Hettig J, Mewes A, Riabikin O, Skalej M, Preim B, Hansen C (2015) Exploration of 3D medical image data for interventional radiology using myoelectric gesture control. In: Eurographics workshop on visual computing for biology and medicine, pp 177–185
8.
Zurück zum Zitat Hübler A, Hansen C, Beuing O, Skalej M, Preim B (2014) Workflow analysis for interventional neuroradiology using frequent pattern mining. In: Proceedings of the annual meeting of the German society of computer- and robot-assisted surgery (CURAC), pp 165–168 Hübler A, Hansen C, Beuing O, Skalej M, Preim B (2014) Workflow analysis for interventional neuroradiology using frequent pattern mining. In: Proceedings of the annual meeting of the German society of computer- and robot-assisted surgery (CURAC), pp 165–168
9.
Zurück zum Zitat Jacob MG, Wachs JP (2014) Context-based hand gesture recognition for the operating room. Pattern Recognit Lett 36:196–203CrossRef Jacob MG, Wachs JP (2014) Context-based hand gesture recognition for the operating room. Pattern Recognit Lett 36:196–203CrossRef
10.
Zurück zum Zitat Mauser S, Burgert O (2014) Touch-free, gesture-based control of medical devices and software based on the leap motion controller. Stud Health Technol Inform 196:265–270PubMed Mauser S, Burgert O (2014) Touch-free, gesture-based control of medical devices and software based on the leap motion controller. Stud Health Technol Inform 196:265–270PubMed
11.
Zurück zum Zitat Meng M, Fallavollita P, Habert S, Weider S, Navab N (2016) Device and system independent personal touchless user interface for operating rooms. In: International conference on information processing in computer-assisted interventions (IPCAI) Meng M, Fallavollita P, Habert S, Weider S, Navab N (2016) Device and system independent personal touchless user interface for operating rooms. In: International conference on information processing in computer-assisted interventions (IPCAI)
12.
Zurück zum Zitat Mewes A, Hensen B, Wacker F, Hansen C (2016a) Touchless interaction with software in interventional radiology and surgery: a systematic literature review. Int J CARS 1–15. doi:10.1007/s11548-016-1480-6 Mewes A, Hensen B, Wacker F, Hansen C (2016a) Touchless interaction with software in interventional radiology and surgery: a systematic literature review. Int J CARS 1–15. doi:10.​1007/​s11548-016-1480-6
13.
Zurück zum Zitat Mewes A, Saalfeld P, Riabikin O, Skalej M, Hansen C (2016b) A gesture-controlled projection display for CT-guided interventions. Int J Comput Assist Radiol Surg 11(1):157–164CrossRefPubMed Mewes A, Saalfeld P, Riabikin O, Skalej M, Hansen C (2016b) A gesture-controlled projection display for CT-guided interventions. Int J Comput Assist Radiol Surg 11(1):157–164CrossRefPubMed
14.
Zurück zum Zitat Odisio BC, Wallace MJ (2014) Image-guided interventions in oncology. Surg Oncol Clin N Am 23(4):937–955CrossRefPubMed Odisio BC, Wallace MJ (2014) Image-guided interventions in oncology. Surg Oncol Clin N Am 23(4):937–955CrossRefPubMed
15.
Zurück zum Zitat O’Hara K, Gonzalez G, Sellen A, Penney G, Varnavas A, Mentis H, Criminisi A, Corish R, Rouncefield M, Dastur N, Carrell T (2014) Touchless interaction in surgery. Commun ACM 57(1):70–77CrossRef O’Hara K, Gonzalez G, Sellen A, Penney G, Varnavas A, Mentis H, Criminisi A, Corish R, Rouncefield M, Dastur N, Carrell T (2014) Touchless interaction in surgery. Commun ACM 57(1):70–77CrossRef
16.
Zurück zum Zitat Onceanu D, Stewart AJ (2011) Direct surgeon control of the computer in the operating room. In: Medical image computing and computer-assisted intervention—(MICCAI), pp 121–128 Onceanu D, Stewart AJ (2011) Direct surgeon control of the computer in the operating room. In: Medical image computing and computer-assisted intervention—(MICCAI), pp 121–128
17.
Zurück zum Zitat promolla A, Volpi V, Ingrosso A, Fabri S, Rapuano C, Passalacqua D, Medaglia CM (2015) A usability study of a gesture recognition system applied during the surgical procedures. In: Marcus A (eds) Design, User Experience, and Usability: Interactive Experience Design. DUXU 2015. Lecture Notes in Computer Science, vol 9188. Springer, Cham, pp 682–692. doi:10.1007/978-3-319-20889-3_63 promolla A, Volpi V, Ingrosso A, Fabri S, Rapuano C, Passalacqua D, Medaglia CM (2015) A usability study of a gesture recognition system applied during the surgical procedures. In: Marcus A (eds) Design, User Experience, and Usability: Interactive Experience Design. DUXU 2015. Lecture Notes in Computer Science, vol 9188. Springer, Cham, pp 682–692. doi:10.​1007/​978-3-319-20889-3_​63
18.
Zurück zum Zitat Park BJ, Jang T, Choi JW, Kim N (2016) Gesture-controlled interface for contactless control of various computer programs with a hooking-based keyboard and mouse-mapping technique in the operating room. Comput Math Methods Med 2016:5170379:1–5170379:7. doi:10.1155/2016/5170379 Park BJ, Jang T, Choi JW, Kim N (2016) Gesture-controlled interface for contactless control of various computer programs with a hooking-based keyboard and mouse-mapping technique in the operating room. Comput Math Methods Med 2016:5170379:1–5170379:7. doi:10.​1155/​2016/​5170379
19.
Zurück zum Zitat Robert G, Hockey J (1997) Compensatory control in the regulation of human performance under stress and high workload: a cognitive-energetical framework. Biol Psychol 45(1):73–93CrossRef Robert G, Hockey J (1997) Compensatory control in the regulation of human performance under stress and high workload: a cognitive-energetical framework. Biol Psychol 45(1):73–93CrossRef
20.
Zurück zum Zitat Rosa GM, Elizondo ML (2014) Use of a gesture user interface as a touchless image navigation system in dental surgery: case series report. Imag Sci Dent 44(2):155–160CrossRef Rosa GM, Elizondo ML (2014) Use of a gesture user interface as a touchless image navigation system in dental surgery: case series report. Imag Sci Dent 44(2):155–160CrossRef
21.
Zurück zum Zitat Rutala WA, White MS, Gergen MF, Weber DJ (2006) Bacterial contamination of keyboards: efficacy and functional impact of disinfectants. Infect Control 27(4):372–377 Rutala WA, White MS, Gergen MF, Weber DJ (2006) Bacterial contamination of keyboards: efficacy and functional impact of disinfectants. Infect Control 27(4):372–377
22.
Zurück zum Zitat Saalfeld P, Mewes A, Luz M, Preim B, Hansen C (2015) Comparative evaluation of gesture and touch input for medical software. In: Mensch und computer proceedings, pp 143–152 Saalfeld P, Mewes A, Luz M, Preim B, Hansen C (2015) Comparative evaluation of gesture and touch input for medical software. In: Mensch und computer proceedings, pp 143–152
23.
Zurück zum Zitat Schwarz LA, Bigdelou A, Navab N (2011) Learning gestures for customizable human-computer interaction in the operating room. In: Medical image computing and computer-assisted intervention–(MICCAI), pp 129–136 Schwarz LA, Bigdelou A, Navab N (2011) Learning gestures for customizable human-computer interaction in the operating room. In: Medical image computing and computer-assisted intervention–(MICCAI), pp 129–136
24.
Zurück zum Zitat Stevenson D, Gardner H, Neilson W, Beenen E, Gananadha S, Fergusson J, Jeans P, Mews P, Bandi H (2016) Evidence from the surgeons: gesture control of image data displayed during surgery. Behav Inform Technol 35(12):1063–1079. doi:10.1080/0144929X.2016.1203025 CrossRef Stevenson D, Gardner H, Neilson W, Beenen E, Gananadha S, Fergusson J, Jeans P, Mews P, Bandi H (2016) Evidence from the surgeons: gesture control of image data displayed during surgery. Behav Inform Technol 35(12):1063–1079. doi:10.​1080/​0144929X.​2016.​1203025 CrossRef
25.
Zurück zum Zitat Stevenson DR (2011) Tertiary-level telehealth: a media space application. Comput Support Coop Work (CSCW) 20(1):61–92CrossRef Stevenson DR (2011) Tertiary-level telehealth: a media space application. Comput Support Coop Work (CSCW) 20(1):61–92CrossRef
26.
Zurück zum Zitat Tedesco DP, Tullis TS (2006) A comparison of methods for eliciting post-task subjective ratings in usability testing. In: Usability Professionals Association (UPA), pp 1–9 Tedesco DP, Tullis TS (2006) A comparison of methods for eliciting post-task subjective ratings in usability testing. In: Usability Professionals Association (UPA), pp 1–9
27.
Zurück zum Zitat Wipfli R, Dubois-Ferrière V, Budry S, Hoffmeyer P, Lovis C (2016) Gesture-controlled image management for operating room: a randomized crossover study to compare interaction using gestures, mouse, and third person relaying. PloS One 11(4):e0153–596CrossRef Wipfli R, Dubois-Ferrière V, Budry S, Hoffmeyer P, Lovis C (2016) Gesture-controlled image management for operating room: a randomized crossover study to compare interaction using gestures, mouse, and third person relaying. PloS One 11(4):e0153–596CrossRef
Metadaten
Titel
Comparison of gesture and conventional interaction techniques for interventional neuroradiology
verfasst von
Julian Hettig
Patrick Saalfeld
Maria Luz
Mathias Becker
Martin Skalej
Christian Hansen
Publikationsdatum
24.01.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1523-7

Weitere Artikel der Ausgabe 9/2017

International Journal of Computer Assisted Radiology and Surgery 9/2017 Zur Ausgabe