Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 1/2016

01.01.2016 | Original Article

A gesture-controlled projection display for CT-guided interventions

verfasst von: A. Mewes, P. Saalfeld, O. Riabikin, M. Skalej, C. Hansen

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 1/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

The interaction with interventional imaging systems within a sterile environment is a challenging task for physicians. Direct physician–machine interaction during an intervention is rather limited because of sterility and workspace restrictions.

Methods

We present a gesture-controlled projection display that enables a direct and natural physician–machine interaction during computed tomography (CT)-based interventions. Therefore, a graphical user interface is projected on a radiation shield located in front of the physician. Hand gestures in front of this display are captured and classified using a leap motion controller. We propose a gesture set to control basic functions of intervention software such as gestures for 2D image exploration, 3D object manipulation and selection. Our methods were evaluated in a clinically oriented user study with 12 participants.

Results

The results of the performed user study confirm that the display and the underlying interaction concept are accepted by clinical users. The recognition of the gestures is robust, although there is potential for improvements. The gesture training times are less than 10 min, but vary heavily between the participants of the study. The developed gestures are connected logically to the intervention software and intuitive to use.

Conclusions

The proposed gesture-controlled projection display counters current thinking, namely it gives the radiologist complete control of the intervention software. It opens new possibilities for direct physician–machine interaction during CT-based interventions and is well suited to become an integral part of future interventional suites.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rutala WA, White MS, Gergen MF, Weber DJ (2006) Bacterial contamination of keyboards: efficacy and functional impact of disinfectants. Infect Control Hosp Epidemiol Off J Soc Hosp Epidemiol Am 27(4):372–377CrossRef Rutala WA, White MS, Gergen MF, Weber DJ (2006) Bacterial contamination of keyboards: efficacy and functional impact of disinfectants. Infect Control Hosp Epidemiol Off J Soc Hosp Epidemiol Am 27(4):372–377CrossRef
2.
Zurück zum Zitat Schultz M, Gill J, Zubairi S, Huber R, Gordin F (2003) Bacterial contamination of computer keyboards in a teaching hospital. Infect Control Hosp Epidemiol Off J Soc Hosp Epidemiol Am 24(4):302–303CrossRef Schultz M, Gill J, Zubairi S, Huber R, Gordin F (2003) Bacterial contamination of computer keyboards in a teaching hospital. Infect Control Hosp Epidemiol Off J Soc Hosp Epidemiol Am 24(4):302–303CrossRef
3.
Zurück zum Zitat Hübler A, Hansen C, Beuing O, Skalej M, Preim B (2014) Workflow analysis for interventional neuroradiology using frequent pattern mining. In: 13. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie (CURAC), pp 29–31 Hübler A, Hansen C, Beuing O, Skalej M, Preim B (2014) Workflow analysis for interventional neuroradiology using frequent pattern mining. In: 13. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie (CURAC), pp 29–31
4.
Zurück zum Zitat Preim B, Botha C (2014) Chapter 5—Human-computer interaction for medical visualization. In: Preim B, Botha C (eds) Visual computing for medicine, 2nd edn. Morgan Kaufmann, Boston, pp 177–225CrossRef Preim B, Botha C (2014) Chapter 5—Human-computer interaction for medical visualization. In: Preim B, Botha C (eds) Visual computing for medicine, 2nd edn. Morgan Kaufmann, Boston, pp 177–225CrossRef
5.
Zurück zum Zitat Wachs JP, Stern HI, Edan Y, Gillam M, Handler J, Feied C, Smith M (2008) A gesture-based tool for sterile browsing of radiology images. J Am Med Inform Assoc JAMIA 15(3):321–323CrossRefPubMed Wachs JP, Stern HI, Edan Y, Gillam M, Handler J, Feied C, Smith M (2008) A gesture-based tool for sterile browsing of radiology images. J Am Med Inform Assoc JAMIA 15(3):321–323CrossRefPubMed
6.
Zurück zum Zitat Ritter F, Hansen C, Wilkens K, Köhn A, Peitgen HO (2009) User interfaces for direct interaction with 3d planning data in the operation room. Journal of i-com (Zeitschrift für interaktive und kooperative Medien) 8(1):24–31 Ritter F, Hansen C, Wilkens K, Köhn A, Peitgen HO (2009) User interfaces for direct interaction with 3d planning data in the operation room. Journal of i-com (Zeitschrift für interaktive und kooperative Medien) 8(1):24–31
7.
Zurück zum Zitat Wigdor D, Wixon D (2011) Brave NUI world: designing natural user interfaces for touch and gesture, 1st. Morgan Kaufmann, San Francisco Wigdor D, Wixon D (2011) Brave NUI world: designing natural user interfaces for touch and gesture, 1st. Morgan Kaufmann, San Francisco
8.
Zurück zum Zitat Baer A, Hübler A, Saalfeld P, Cunningham D, Preim B (2014) A comparative user study of a 2D and an autostereoscopic 3D display for a tympanoplastic surgery. In: Proceedings of Eurographics workshop on visual computing for biology and medicine (EG VCBM), pp 181–190 Baer A, Hübler A, Saalfeld P, Cunningham D, Preim B (2014) A comparative user study of a 2D and an autostereoscopic 3D display for a tympanoplastic surgery. In: Proceedings of Eurographics workshop on visual computing for biology and medicine (EG VCBM), pp 181–190
9.
Zurück zum Zitat Soutschek S, Penne J, Hornegger J, Kornhuber J (2008) 3-D gesture-based scene navigation in medical imaging applications using time-of-flight cameras. In: Computer vision and pattern recognition workshops, 2008. CVPRW ‘08. IEEE computer society conference on, pp 1–6 Soutschek S, Penne J, Hornegger J, Kornhuber J (2008) 3-D gesture-based scene navigation in medical imaging applications using time-of-flight cameras. In: Computer vision and pattern recognition workshops, 2008. CVPRW ‘08. IEEE computer society conference on, pp 1–6
10.
Zurück zum Zitat Kollorz E, Penne J, Hornegger J, Barke A (2008) Gesture recognition with a time-of-flight camera. Int J Intell Syst Technol Appl 5(3):334–343 Kollorz E, Penne J, Hornegger J, Barke A (2008) Gesture recognition with a time-of-flight camera. Int J Intell Syst Technol Appl 5(3):334–343
11.
Zurück zum Zitat Ebert LC, Hatch G, Ampanozi G, Thali MJ, Ross S (2012) You can’t touch this: touch-free navigation through radiological images. Surg Innov 19(3):301–307CrossRefPubMed Ebert LC, Hatch G, Ampanozi G, Thali MJ, Ross S (2012) You can’t touch this: touch-free navigation through radiological images. Surg Innov 19(3):301–307CrossRefPubMed
12.
Zurück zum Zitat Gallo L, Placitelli AP, Ciampi M (2011) Controller-free exploration of medical image data: experiencing the Kinect. In: Computer-based medical systems (CBMS), 2011 24th international symposium on, pp 1–6 Gallo L, Placitelli AP, Ciampi M (2011) Controller-free exploration of medical image data: experiencing the Kinect. In: Computer-based medical systems (CBMS), 2011 24th international symposium on, pp 1–6
13.
Zurück zum Zitat Hötker AM, Pitton MB, Mildenberger P, Düber C (2013) Speech and motion control for interventional radiology: requirements and feasibility. Int J Comput Assist Radiol Surg 8(6):997–1002CrossRefPubMed Hötker AM, Pitton MB, Mildenberger P, Düber C (2013) Speech and motion control for interventional radiology: requirements and feasibility. Int J Comput Assist Radiol Surg 8(6):997–1002CrossRefPubMed
14.
Zurück zum Zitat Jacob MG, Wachs JP, Packer RA (2013) Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images. J Am Med Inform Assoc JAMIA 20(e1):e183–e186CrossRefPubMed Jacob MG, Wachs JP, Packer RA (2013) Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images. J Am Med Inform Assoc JAMIA 20(e1):e183–e186CrossRefPubMed
15.
Zurück zum Zitat Bizzotto N, Costanzo A, Bizzotto L, Regis D, Sandri A, Magnan B (2014) Leap motion gesture control with osirix in the operating room to control imaging: first experiences during live surgery. Surg Innov 21(6):655–656CrossRefPubMed Bizzotto N, Costanzo A, Bizzotto L, Regis D, Sandri A, Magnan B (2014) Leap motion gesture control with osirix in the operating room to control imaging: first experiences during live surgery. Surg Innov 21(6):655–656CrossRefPubMed
16.
Zurück zum Zitat Mauser S, Burgert O (2014) Touch-free, gesture-based control of medical devices and software based on the leap motion controller. Stud Health Technol Inform 196:265–270PubMed Mauser S, Burgert O (2014) Touch-free, gesture-based control of medical devices and software based on the leap motion controller. Stud Health Technol Inform 196:265–270PubMed
17.
Zurück zum Zitat Rosa GM, Elizondo ML (2014) Use of a gesture user interface as a touchless image navigation system in dental surgery: Case series report. Imaging Sci Dent 44(2):155–160PubMedCentralCrossRefPubMed Rosa GM, Elizondo ML (2014) Use of a gesture user interface as a touchless image navigation system in dental surgery: Case series report. Imaging Sci Dent 44(2):155–160PubMedCentralCrossRefPubMed
18.
Zurück zum Zitat Weichert F, Bachmann D, Rudak B, Fisseler D (2013) Analysis of the accuracy and robustness of the leap motion controller. Sensors (Basel, Switzerland) 13(5):6380–6393CrossRef Weichert F, Bachmann D, Rudak B, Fisseler D (2013) Analysis of the accuracy and robustness of the leap motion controller. Sensors (Basel, Switzerland) 13(5):6380–6393CrossRef
19.
Zurück zum Zitat Guna J, Jakus G, Pogačnik M, Tomažič S, Sodnik J (2014) An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors (Basel, Switzerland) 14(2):3702–3720CrossRef Guna J, Jakus G, Pogačnik M, Tomažič S, Sodnik J (2014) An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors (Basel, Switzerland) 14(2):3702–3720CrossRef
20.
Zurück zum Zitat Nielsen M, Störring M, Moeslund TB, Granum E (2004) A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Goos G, Hartmanis J, van Leeuwen J, Camurri A, Volpe G (eds) Gesture-based communication in human-computer interaction, vol 2915. Springer, Berlin, pp 409–420CrossRef Nielsen M, Störring M, Moeslund TB, Granum E (2004) A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Goos G, Hartmanis J, van Leeuwen J, Camurri A, Volpe G (eds) Gesture-based communication in human-computer interaction, vol 2915. Springer, Berlin, pp 409–420CrossRef
21.
Zurück zum Zitat Ericsson KA, Simon HA (1984) Protocol analysis. Verbal reports as data. MIT Press, Cambridge Ericsson KA, Simon HA (1984) Protocol analysis. Verbal reports as data. MIT Press, Cambridge
22.
Zurück zum Zitat Prümper J (1997) Der Benutzungsfragebogen ISONORM 9241/10: Ergebnisse zur Reliabilität und Validität. In: Software-Ergonomie’97. Springer, pp 253–262 Prümper J (1997) Der Benutzungsfragebogen ISONORM 9241/10: Ergebnisse zur Reliabilität und Validität. In: Software-Ergonomie’97. Springer, pp 253–262
Metadaten
Titel
A gesture-controlled projection display for CT-guided interventions
verfasst von
A. Mewes
P. Saalfeld
O. Riabikin
M. Skalej
C. Hansen
Publikationsdatum
01.01.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 1/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1215-0

Weitere Artikel der Ausgabe 1/2016

International Journal of Computer Assisted Radiology and Surgery 1/2016 Zur Ausgabe