Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 9/2018

27-07-2018 | Original Article

Surgical soundtracks: automatic acoustic augmentation of surgical procedures

Authors: Sasan Matinfar, M. Ali Nasseri, Ulrich Eck, Michael Kowalsky, Hessam Roodaki, Navid Navab, Chris P. Lohmann, Mathias Maier, Nassir Navab

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 9/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Advances in sensing and digitalization enable us to acquire and present various heterogeneous datasets to enhance clinical decisions. Visual feedback is the dominant way of conveying such information. However, environments rich with many sources of information all presented through the same channel pose the risk of over stimulation and missing crucial information. The augmentation of the cognitive field by additional perceptual modalities such as sound is a workaround to this problem. A major challenge in auditory augmentation is the automatic generation of pleasant and ergonomic audio in complex routines, as opposed to overly simplistic feedback, to avoid alarm fatigue.

Methods

In this work, without loss of generality to other procedures, we propose a method for aural augmentation of medical procedures via automatic modification of musical pieces.

Results

Evaluations of this concept regarding recognizability of the conveyed information along with qualitative aesthetics show the potential of our method.

Conclusion

In this paper, we proposed a novel sonification method for automatic musical augmentation of tasks within surgical procedures. Our experimental results suggest that these augmentations are aesthetically pleasing and have the potential to successfully convey useful information. This work opens a path for advanced sonification techniques in the operating room, in order to complement traditional visual displays and convey information more efficiently.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Robineau F, Boy F, Orliaguet J-P, Demongeot J, Payan Y (2007) Guiding the surgical gesture using an electro-tactile stimulus array on the tongue: a feasibility study. IEEE Trans Biomed Eng 54(4):711–717CrossRefPubMed Robineau F, Boy F, Orliaguet J-P, Demongeot J, Payan Y (2007) Guiding the surgical gesture using an electro-tactile stimulus array on the tongue: a feasibility study. IEEE Trans Biomed Eng 54(4):711–717CrossRefPubMed
2.
go back to reference Bluteau J, Dubois M-D, Coquillart S, Gentaz E, Payan Y (2010) Vibrotactile guidance for trajectory following in computer aided surgery. In: Engineering in medicine and biology society (EMBC), 2010 annual international conference of the IEEE, pp 2085–2088. IEEE Bluteau J, Dubois M-D, Coquillart S, Gentaz E, Payan Y (2010) Vibrotactile guidance for trajectory following in computer aided surgery. In: Engineering in medicine and biology society (EMBC), 2010 annual international conference of the IEEE, pp 2085–2088. IEEE
3.
go back to reference Howard T, Szewczyk J (2016) Improving precision in navigating laparoscopic surgery instruments toward a planar target using haptic and visual feedback. Front Robot AI 3:37CrossRef Howard T, Szewczyk J (2016) Improving precision in navigating laparoscopic surgery instruments toward a planar target using haptic and visual feedback. Front Robot AI 3:37CrossRef
4.
go back to reference Howard T, Szewczyk J (2014) Visuo-haptic feedback for 1-d guidance in laparoscopic surgery. In: Biomedical robotics and biomechatronics, 2014 5th IEEE RAS & EMBS International Conference on, IEEE, pp 58–65 Howard T, Szewczyk J (2014) Visuo-haptic feedback for 1-d guidance in laparoscopic surgery. In: Biomedical robotics and biomechatronics, 2014 5th IEEE RAS & EMBS International Conference on, IEEE, pp 58–65
5.
go back to reference Kestin IG, Miller BR, Lockhart CH (1988) Auditory alarms during anesthesia monitoring. Anesthesiol J Am Soc Anesthesiol 69(1):106–108 Kestin IG, Miller BR, Lockhart CH (1988) Auditory alarms during anesthesia monitoring. Anesthesiol J Am Soc Anesthesiol 69(1):106–108
6.
go back to reference Matinfar S, Nasseri MA, Eck U, Roodaki H, Navab N, Lohmann CP, Maier M, Navab N (2017) Surgical Soundtracks: towards automatic musical augmentation of surgical procedures. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 673–681 Matinfar S, Nasseri MA, Eck U, Roodaki H, Navab N, Lohmann CP, Maier M, Navab N (2017) Surgical Soundtracks: towards automatic musical augmentation of surgical procedures. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 673–681
7.
go back to reference Hermann T, Hunt A (2011) The sonification handbook. In: Neuhoff JG (ed) Logos Verlag, Berlin Hermann T, Hunt A (2011) The sonification handbook. In: Neuhoff JG (ed) Logos Verlag, Berlin
8.
go back to reference Ullmann Y, Fodor L, Schwarzberg I, Carmi N, Ullmann A, Ramon Y (2008) The sounds of music in the operating room. Injury 39(5):592–597CrossRefPubMed Ullmann Y, Fodor L, Schwarzberg I, Carmi N, Ullmann A, Ramon Y (2008) The sounds of music in the operating room. Injury 39(5):592–597CrossRefPubMed
9.
go back to reference Wiseman MC (2013) The Mozart effect on task performance in a laparoscopic surgical simulator. Surg Innov 20(5):444–453CrossRefPubMed Wiseman MC (2013) The Mozart effect on task performance in a laparoscopic surgical simulator. Surg Innov 20(5):444–453CrossRefPubMed
10.
go back to reference Allen K, Blascovich J (1994) Effects of music on cardiovascular reactivity among surgeons (correction) Allen K, Blascovich J (1994) Effects of music on cardiovascular reactivity among surgeons (correction)
11.
go back to reference Wegner K (1998) Surgical navigation system and method using audio feedback. Georgia Institute of Technology Wegner K (1998) Surgical navigation system and method using audio feedback. Georgia Institute of Technology
12.
go back to reference Voormolen EHJ, Woerdeman PA, van Stralen M, Noordmans HJ, Viergever MA, Regli L, van der Sprenkel. JWB (2012) Validation of exposure visualization and audible distance emission for navigated temporal bone drilling in phantoms. PLoS ONE 7(7):e41262CrossRefPubMedPubMedCentral Voormolen EHJ, Woerdeman PA, van Stralen M, Noordmans HJ, Viergever MA, Regli L, van der Sprenkel. JWB (2012) Validation of exposure visualization and audible distance emission for navigated temporal bone drilling in phantoms. PLoS ONE 7(7):e41262CrossRefPubMedPubMedCentral
13.
go back to reference Dixon BJ, Daly MJ, Chan H, Vescan A, Witterick IJ, Irish JC (2014) Augmented realtime navigation with critical structure proximity alerts for endoscopic skull base surgery. Laryngoscope 124(4):853–859CrossRefPubMed Dixon BJ, Daly MJ, Chan H, Vescan A, Witterick IJ, Irish JC (2014) Augmented realtime navigation with critical structure proximity alerts for endoscopic skull base surgery. Laryngoscope 124(4):853–859CrossRefPubMed
14.
go back to reference Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using real-time safe region monitoring for otologic surgery. Int J Comput Assist Radiol Surg 8(3):395–405CrossRefPubMed Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using real-time safe region monitoring for otologic surgery. Int J Comput Assist Radiol Surg 8(3):395–405CrossRefPubMed
15.
go back to reference Hansen C, Black D, Lange C, Rieber F, Lamad W, Donati M, Oldhafer KJ, Hahn HK (2013) Auditory support for resection guidance in navigated liver surgery. Int J Med Robot Comput Assist Surg 9(1):36–43CrossRef Hansen C, Black D, Lange C, Rieber F, Lamad W, Donati M, Oldhafer KJ, Hahn HK (2013) Auditory support for resection guidance in navigated liver surgery. Int J Med Robot Comput Assist Surg 9(1):36–43CrossRef
16.
go back to reference Roodaki H, Navab N, Eslami A, Stapleton C, Navab N (2017) Sonifeye: sonification of visual information using physical modeling sound synthesis. IEEE Trans Vis Comput Graph 23(11):2366–2371CrossRefPubMed Roodaki H, Navab N, Eslami A, Stapleton C, Navab N (2017) Sonifeye: sonification of visual information using physical modeling sound synthesis. IEEE Trans Vis Comput Graph 23(11):2366–2371CrossRefPubMed
17.
go back to reference Eckel G, Iovino F, Causs R (1995) Sound synthesis by physical modelling with Modalys. In: Proceedings of the international symposium on musical acoustics, pp 479–482 Eckel G, Iovino F, Causs R (1995) Sound synthesis by physical modelling with Modalys. In: Proceedings of the international symposium on musical acoustics, pp 479–482
18.
go back to reference Verfaille V, Guastavino C, Traube C (2006) An interdisciplinary approach to audio effect classification. In Proceedings of the 9th international conference on digital audio effects Verfaille V, Guastavino C, Traube C (2006) An interdisciplinary approach to audio effect classification. In Proceedings of the 9th international conference on digital audio effects
19.
go back to reference Bello JP, Daudet L, Abdallah S, Duxbury C, Davies M, Sandler MB (2005) A tutorial on onset detection in music signals. IEEE Trans Speech Audio Process 13(5):1035–1047CrossRef Bello JP, Daudet L, Abdallah S, Duxbury C, Davies M, Sandler MB (2005) A tutorial on onset detection in music signals. IEEE Trans Speech Audio Process 13(5):1035–1047CrossRef
Metadata
Title
Surgical soundtracks: automatic acoustic augmentation of surgical procedures
Authors
Sasan Matinfar
M. Ali Nasseri
Ulrich Eck
Michael Kowalsky
Hessam Roodaki
Navid Navab
Chris P. Lohmann
Mathias Maier
Nassir Navab
Publication date
27-07-2018
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 9/2018
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1827-2

Other articles of this Issue 9/2018

International Journal of Computer Assisted Radiology and Surgery 9/2018 Go to the issue

Premium Partner