Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2017

17.02.2017 | Original Article

Auditory feedback to support image-guided medical needle placement

verfasst von: David Black, Julian Hettig, Maria Luz, Christian Hansen, Ron Kikinis, Horst Hahn

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

During medical needle placement using image-guided navigation systems, the clinician must concentrate on a screen. To reduce the clinician’s visual reliance on the screen, this work proposes an auditory feedback method as a stand-alone method or to support visual feedback for placing the navigated medical instrument, in this case a needle.

Methods

An auditory synthesis model using pitch comparison and stereo panning parameter mapping was developed to augment or replace visual feedback for navigated needle placement. In contrast to existing approaches which augment but still require a visual display, this method allows view-free needle placement. An evaluation with 12 novice participants compared both auditory and combined audiovisual feedback against existing visual methods.

Results

Using combined audiovisual display, participants show similar task completion times and report similar subjective workload and accuracy while viewing the screen less compared to using the conventional visual method. The auditory feedback leads to higher task completion times and subjective workload compared to both combined and visual feedback.

Conclusion

Audiovisual feedback shows promising results and establishes a basis for applying auditory feedback as a supplement to visual information to other navigated interventions, especially those for which viewing a patient is beneficial or necessary.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arnolli MM, Hanumara NC, Franken M, Brouwer DM, Broeders IA (2015) An overview of systems for CT- and MRI-guided percutaneous needle placement in the thorax and abdomen. Med Robot Comput Assist Surg 11(4):458–475CrossRef Arnolli MM, Hanumara NC, Franken M, Brouwer DM, Broeders IA (2015) An overview of systems for CT- and MRI-guided percutaneous needle placement in the thorax and abdomen. Med Robot Comput Assist Surg 11(4):458–475CrossRef
2.
Zurück zum Zitat Beller S, Hünerbein M, Eulenstein S, Lange T, Schlag PM (2007) Feasibility of navigated resection of liver tumors using multiplanar visualization of intraoperative 3-dimensional ultrasound data. Ann Surg 246:288–294CrossRefPubMedPubMedCentral Beller S, Hünerbein M, Eulenstein S, Lange T, Schlag PM (2007) Feasibility of navigated resection of liver tumors using multiplanar visualization of intraoperative 3-dimensional ultrasound data. Ann Surg 246:288–294CrossRefPubMedPubMedCentral
3.
Zurück zum Zitat Black D, Kocev B, Meine H, Nabavi A, Kikinis R (2016) Towards uncertainty-aware auditory display for surgical navigation. In: Proceedings of gesellschaft für computer- und roboterassistierte chirurgie (CURAC), Bern, Switzerland Black D, Kocev B, Meine H, Nabavi A, Kikinis R (2016) Towards uncertainty-aware auditory display for surgical navigation. In: Proceedings of gesellschaft für computer- und roboterassistierte chirurgie (CURAC), Bern, Switzerland
4.
Zurück zum Zitat Cash DM, Miga MI, Glasgow SC, Dawant BM, Clements LW, Cao Z, Galloway RL, Chapman WC (2007) Concepts and preliminary data toward the realization of image-guided liver surgery. Gastroint Surg 11:844–859CrossRef Cash DM, Miga MI, Glasgow SC, Dawant BM, Clements LW, Cao Z, Galloway RL, Chapman WC (2007) Concepts and preliminary data toward the realization of image-guided liver surgery. Gastroint Surg 11:844–859CrossRef
5.
Zurück zum Zitat Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–28CrossRefPubMed Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–28CrossRefPubMed
6.
Zurück zum Zitat Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using realtime safe region monitoring for otologic surgery. Comput Assist Radiol Surg 8:395–405CrossRef Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using realtime safe region monitoring for otologic surgery. Comput Assist Radiol Surg 8:395–405CrossRef
7.
Zurück zum Zitat Dixon BJ, Chan H, Daly MJ, Vescan AD, Witterick IJ, Irish JC (2012) The effect of augmented real-time image guidance on task workload during endoscopic sinus surgery. Int Forum Allergy Rhinol 2:405–410CrossRefPubMed Dixon BJ, Chan H, Daly MJ, Vescan AD, Witterick IJ, Irish JC (2012) The effect of augmented real-time image guidance on task workload during endoscopic sinus surgery. Int Forum Allergy Rhinol 2:405–410CrossRefPubMed
8.
Zurück zum Zitat Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2013) Surgeons blinded by enhanced navigation: the effect of augmented reality on attention. Surg Endosc 27(2):454–461CrossRefPubMed Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2013) Surgeons blinded by enhanced navigation: the effect of augmented reality on attention. Surg Endosc 27(2):454–461CrossRefPubMed
9.
Zurück zum Zitat Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2014) Augmented real-time navigation with critical structure proximity alerts for endoscopic skull base surgery. Laryngoscope 124:853–859CrossRefPubMed Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2014) Augmented real-time navigation with critical structure proximity alerts for endoscopic skull base surgery. Laryngoscope 124:853–859CrossRefPubMed
10.
Zurück zum Zitat Fischbach F, Bunke J, Thormann M, Gaffke G, Jungnickel K, Smink J, Ricke J (2011) MR-guided freehand biopsy of liver lesions with fast continuous imaging using a 1.0-T open MRI scanner: experience in 50 patients. Cardiovasc Interv Radiol 34:188–192CrossRef Fischbach F, Bunke J, Thormann M, Gaffke G, Jungnickel K, Smink J, Ricke J (2011) MR-guided freehand biopsy of liver lesions with fast continuous imaging using a 1.0-T open MRI scanner: experience in 50 patients. Cardiovasc Interv Radiol 34:188–192CrossRef
11.
Zurück zum Zitat Haerle SK, Daly MJ, Chan H, Vescan AD, Witterick I, Gentili F, Zadeh G, Kucharczyk W, Irish JC (2015) Localized intraoperative virtual endoscopy (LIVE) for surgical guidance in 16 skull base patients. Otolaryngol Head Neck Surg 152:165–171CrossRefPubMed Haerle SK, Daly MJ, Chan H, Vescan AD, Witterick I, Gentili F, Zadeh G, Kucharczyk W, Irish JC (2015) Localized intraoperative virtual endoscopy (LIVE) for surgical guidance in 16 skull base patients. Otolaryngol Head Neck Surg 152:165–171CrossRefPubMed
12.
Zurück zum Zitat Hansen C, Black D, Lange C, Rieber F, Lamad W, Donati M, Oldhafer K, Hahn H (2013) Auditory support for resection guidance in navigated liver surgery. Med Robot Comput Assist Surg 9(1):36–43 Hansen C, Black D, Lange C, Rieber F, Lamad W, Donati M, Oldhafer K, Hahn H (2013) Auditory support for resection guidance in navigated liver surgery. Med Robot Comput Assist Surg 9(1):36–43
13.
Zurück zum Zitat Hansen C, Wieferich J, Ritter F, Rieder C, Peitgen HO (2013) Illustrative visualization of 3D planning models for augmented reality in liver surgery. Int J Comput Assist Radiol Surg 5(2):133–141CrossRef Hansen C, Wieferich J, Ritter F, Rieder C, Peitgen HO (2013) Illustrative visualization of 3D planning models for augmented reality in liver surgery. Int J Comput Assist Radiol Surg 5(2):133–141CrossRef
14.
Zurück zum Zitat Hansen C, Zidowitz S, Ritter F, Lange C, Oldhafer K, Hahn HK (2013) Risk maps for liver surgery. Int J Comput Assist Radiol Surg 8(3):419–428CrossRefPubMed Hansen C, Zidowitz S, Ritter F, Lange C, Oldhafer K, Hahn HK (2013) Risk maps for liver surgery. Int J Comput Assist Radiol Surg 8(3):419–428CrossRefPubMed
15.
Zurück zum Zitat Hart SG (2006) NASA-Task Load Index (NASA-TLX); 20 years later. In: Human Factors and Ergonomics Society 50th annual meeting. HFES, Santa Monica, pp 904–908 Hart SG (2006) NASA-Task Load Index (NASA-TLX); 20 years later. In: Human Factors and Ergonomics Society 50th annual meeting. HFES, Santa Monica, pp 904–908
16.
Zurück zum Zitat Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: 14th international conference on auditory display, Paris, France Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: 14th international conference on auditory display, Paris, France
17.
Zurück zum Zitat Kersten-Oertel C, Jannin P, Collins DL (2012) DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE TVCG 18(2):332–352PubMed Kersten-Oertel C, Jannin P, Collins DL (2012) DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE TVCG 18(2):332–352PubMed
18.
Zurück zum Zitat Luz M, Manzey D, Modemann S, Strauss G (2015) Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons. Ergonomics 58:383–393CrossRefPubMed Luz M, Manzey D, Modemann S, Strauss G (2015) Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons. Ergonomics 58:383–393CrossRefPubMed
19.
Zurück zum Zitat Marcus HJ, Pratt P, Hughes-Hallett A, Cundy TP, Marcus AP, Yang GZ, Darzi A, Nandi D (2015) Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. J Neurosurg 123(2):307–313CrossRefPubMedPubMedCentral Marcus HJ, Pratt P, Hughes-Hallett A, Cundy TP, Marcus AP, Yang GZ, Darzi A, Nandi D (2015) Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. J Neurosurg 123(2):307–313CrossRefPubMedPubMedCentral
20.
Zurück zum Zitat Peterhans M, Oliveira T, Banz V, Candinas D, Weber S (2012) Computer-assisted liver surgery: clinical applications and technological trends. Crit Rev Biomed Eng 40:199–220 Peterhans M, Oliveira T, Banz V, Candinas D, Weber S (2012) Computer-assisted liver surgery: clinical applications and technological trends. Crit Rev Biomed Eng 40:199–220
21.
Zurück zum Zitat Puckette, M (1996) Pure Data: another integrated computer music environment. In: Second intercollege computer music concerts, pp 37–41 Puckette, M (1996) Pure Data: another integrated computer music environment. In: Second intercollege computer music concerts, pp 37–41
22.
Zurück zum Zitat Voormolen EH, Woerdeman PA, van Stralen M, Noordmans HJ, Viergever MA, Regli L, van der Sprenkel JW (2012) Validation of exposure visualization and audible distance emission for navigated temporal bone drilling in phantoms. PLoS ONE 7:e41262CrossRefPubMedPubMedCentral Voormolen EH, Woerdeman PA, van Stralen M, Noordmans HJ, Viergever MA, Regli L, van der Sprenkel JW (2012) Validation of exposure visualization and audible distance emission for navigated temporal bone drilling in phantoms. PLoS ONE 7:e41262CrossRefPubMedPubMedCentral
23.
Zurück zum Zitat Walker BN, Nees MA (2011) Theory of sonification. In: Hermann T, Hunt A, Neuhoff J (eds) Handbook of sonification. Academic Press, New York Walker BN, Nees MA (2011) Theory of sonification. In: Hermann T, Hunt A, Neuhoff J (eds) Handbook of sonification. Academic Press, New York
24.
Zurück zum Zitat Wegner K, Karron D (1998) Audio-guided blind biopsy needle placement. Stud Health Technol Inform 50:90–95PubMed Wegner K, Karron D (1998) Audio-guided blind biopsy needle placement. Stud Health Technol Inform 50:90–95PubMed
25.
Zurück zum Zitat Willems PW, Noordmans HJ, van Overbeeke JJ, Viergever MA, Tulleken CA, van der Sprenkel JW (2005) The impact of auditory feedback on neuronavigation. Acta Neurochir (Wien) 147:167–173CrossRef Willems PW, Noordmans HJ, van Overbeeke JJ, Viergever MA, Tulleken CA, van der Sprenkel JW (2005) The impact of auditory feedback on neuronavigation. Acta Neurochir (Wien) 147:167–173CrossRef
26.
Zurück zum Zitat Woerdeman PA, Willems PW, Noordmans HJ, van der Sprenkel JW (2009) Auditory feedback during frameless image-guided surgery in a phantom model and initial clinical experience. Neurosurgery 110:257–262CrossRef Woerdeman PA, Willems PW, Noordmans HJ, van der Sprenkel JW (2009) Auditory feedback during frameless image-guided surgery in a phantom model and initial clinical experience. Neurosurgery 110:257–262CrossRef
27.
Zurück zum Zitat Wright M, Freed A (1997) Open sound control: a new protocol for communicating with sound synthesizers. In: Proceedings of the 1997 international computer music conference Wright M, Freed A (1997) Open sound control: a new protocol for communicating with sound synthesizers. In: Proceedings of the 1997 international computer music conference
28.
Zurück zum Zitat Wright M, Freed A, Momeni A (2003) OpenSound control: state of the art 2003 In: Proceedings of the 2003 conference on new interfaces for musical expression, pp 153–160 Wright M, Freed A, Momeni A (2003) OpenSound control: state of the art 2003 In: Proceedings of the 2003 conference on new interfaces for musical expression, pp 153–160
Metadaten
Titel
Auditory feedback to support image-guided medical needle placement
verfasst von
David Black
Julian Hettig
Maria Luz
Christian Hansen
Ron Kikinis
Horst Hahn
Publikationsdatum
17.02.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1537-1

Weitere Artikel der Ausgabe 9/2017

International Journal of Computer Assisted Radiology and Surgery 9/2017 Zur Ausgabe

Premium Partner