Tim Ziemer
ABSTRACT
Comparing sonification with visualization is like comparing apples and oranges. While visualizations are ubiquitous to the public and have established names, principles, application areas, and sophisticated designs, sonifications tend to be unique, self-made and completely new to users. In this study we developed a rudimentary visualization that is related closely to the principle of the sonification designs that we want to evaluate. In addition, we implemented a prototypical sonification that uses the most common mapping principles. Experiment results show that participants perform similarly well using the rudimentary visualization and the prototypical sonification, which is much better than chance but significantly worse than using our new sonification design. We therefore argue that both rudimentary visualization and prototypical sonifications can serve as a suitable benchmark to evaluate new sonifications designs against.
- Maxime Aubert, Rustan Lebe, Adhi Agus Oktaviana, Muhammad Tang, Basran Burhan, Hamrullah, Andi Jusdi, Abdullah, Budianto Hakim, Jian xin Zhao, I. Made Geria, Priyatno Hadi Sulistyarto, Ratno Sardi, and Adam Brumm. 2019. Earliest hunting scene in prehistoric art. Nature 576, 7787 (Dec. 2019), 442–445. https://doi.org/10.1038/s41586-019-1806-yGoogle Scholar
Cross Ref
- David Black, Julian Hettig, Maria Luz, Christian Hansen, Ron Kikinis, and Horst Hahn. 2017. Auditory feedback to support image-guided medical needle placement. International Journal of Computer Assisted Radiology and Surgery 12, 9(2017), 1655–1663. https://doi.org/10.1007/s11548-017-1537-1Google ScholarCross Ref
- Terri L. Bonebright and John H. Flowers. 2011. Evaluation of Auditory Display. In The Sonification Handbook, Thomas Hermann, Andy Hunt, and John G. Neuhoff (Eds.). COST and Logos, Berlin, 111–144. http://sonification.de/handbookGoogle Scholar
- Tifanie Bouchara, Brian F. G. Katz, Christian Jacquemin, and Catherine Guastavino. 2010. Audio-Visual Renderings for Multimedia Navigation. In 16th International Conference on Auditory Display (ICAD2010), Eoin Brazil (Ed.). Washington, DC, USA, 245–252. http://hdl.handle.net/1853/58425Google Scholar
- Nicholas J. Conrad, Maria Malina, and Susanne C. Münzel. 2009. New flutes document the earliest musical tradition in southwestern Germany. Nature 460, 7256 (Aug. 2009), 737–740. https://doi.org/10.1038/nature08169Google Scholar
- Gaël Dubus and Roberto Bresin. 2013. A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities. PLOS ONE 9, 4 (12 2013), e96018. https://doi.org/10.1371/journal.pone.0082491Google Scholar
- Gaël Dubus and Roberto Bresin. 2015. Exploration and evaluation of a system for interactive sonification of elite rowing. Sports Eng 18(2015), 29–41. https://doi.org/10.1007/s12193-011-0085-1Google ScholarCross Ref
- Gustav Theodor Fechner. 1860. Elemente der Psychophysik. Breitkopf und Härtel, Leipzig.Google Scholar
- Thomas Hermann. 2002. Sonification for Exploratory Data Analysis. Ph. D. Dissertation. Bielefeld University, Bielefeld. http://www.techfak.uni-bielefeld.de/ags/ami/publications/media/Hermann2002-SFE.pdfGoogle Scholar
- Takanori Komatsu and Seiji Yamada. 2016. Can Monaural Auditory Displays Convey Directional Information to Users?. In Proceedings of the 38th Annual Conference of the Cognitive Science Society, A. Papafragou, D. Grodner, D. Mirman, and J. C. Trueswell (Eds.). Cognitive Science Society, Austin, TX, 930–935. https://mindmodeling.org/cogsci2016/papers/0170/index.htmlGoogle Scholar
- Tapio Lokki and Matti Gröhn. 2005. Navigation with auditory cues in a virtual environment. IEEE MultiMedia 12, 2 (April 2005), 80–86. https://doi.org/10.1109/MMUL.2005.33Google ScholarDigital Library
- Frederik Nagel, Fabian-Robert Stöter, Noberto Degara, Stefan Balke, and David Worrall. 2014. Fast and Accurate Guidance – Response Times to Navigational Sounds. In ICAD. New York, NY, 5 pages. http://hdl.handle.net/1853/52058Google Scholar
- Gaëtan Parseihian, Charles Gondre, Mitsuko Aramaki, Sølvi Ystad, and Richard Kronland-Martinet. 2016. Comparison and Evaluation of Sonification Strategies for Guidance Tasks. IEEE Trans. Multimedia 18, 4 (April 2016), 674–686. https://doi.org/10.1109/TMM.2016.2531978Google ScholarDigital Library
- Albrecht Schneider. 2018. Fundamentals. In Springer Handbook of Systematic Musicology, Rolf Bader (Ed.). Springer, Berlin, Heidelberg, 559–603. https://doi.org/10.1007/978-3-662-55004-5_30Google Scholar
- Sebastian Schwarz and Tim Ziemer. 2019. A psychoacoustic sound design for pulse oximetry. In Proceedings of the 25th International Conference on Auditory Display (ICAD 2019). Newcastle. https://doi.org/10.21785/icad2019.024Google ScholarCross Ref
- Mariana Seiça, Licínio Roque, Pedro Martins, and F. Amílcar Cardoso. 2020. Contrasts and similarities between two audio research communities in evaluating auditory artefacts. In Proceedings of the 15th International Conference on Audio Mostly. New York, NY, USA, 183–190. https://doi.org/10.1145/3411109.3411146Google ScholarDigital Library
- Roger N. Shepard. 1964. Circularity in Judgments of Relative Pitch. The Journal of the Acoustical Society of America 36, 12 (1964), 2346–2353. https://doi.org/10.1121/1.1919362Google ScholarCross Ref
- Katharina Vogt. 2011. A Quantitative Evaluation Approach to Sonifications. In Pro. 17th International Conference on Auditory Display (ICAD2011). Budapest, Hungary, 7 pages. http://hdl.handle.net/1853/51571Google Scholar
- Bruce N. Walker and Jeff Lindsay. 2003. Effect of Beacon Sounds on Navigation Performance in a Virtual Reality Environment. In Proceedings of the 2003 International Conference on Auditory Display (ICAD2003). Boston, MA, 204–207.Google Scholar
- David Worrall. 2019. Sonification Design. Springer, Cham. https://doi.org/10.1007/978-3-030-01497-1Google Scholar
- Tim Ziemer. 2020. Psychoacoustic Music Sound Field Synthesis. Current Research in Systematic Musicology, Vol. 7. Springer, Cham. https://doi.org/10.1007/978-3-030-23033-3Google Scholar
- Tim Ziemer. 2022. Visualization vs. Sonification to Level a Table. In Proceedings of ISon 2022, 7th Interactive Sonification Workshop. Delmenhorst, Germany.Google Scholar
- Tim Ziemer, David Black, and Holger Schultheis. 2017. Psychoacoustic sonification design for navigation in surgical interventions. Proceedings of Meetings on Acoustics 30 (2017). https://doi.org/10.1121/2.0000557Google ScholarCross Ref
- Tim Ziemer, Nuttawut Nuchprayoon, and Holger Schultheis. 2020. Psychoacoustic Sonification as User Interface for Human-Machine Interaction. International Journal of Informatics Society 11, 3 (2020), 3–16. http://www.infsoc.org/journal/vol11/11-3Google Scholar
- Tim Ziemer and Holger Schultheis. 2018. A Psychoacoustic Auditory Display for Navigation. In 24th International Conference on Auditory Displays (ICAD2018). Houghton, MI, 136–144. https://doi.org/10.21785/icad2018.007Google ScholarCross Ref
- Tim Ziemer and Holger Schultheis. 2019. Psychoacoustic auditory display for navigation: an auditory assistance system for spatial orientation tasks. J Multimodal User Interfaces 13 (2019), 205–218. https://doi.org/10.1007/s12193-018-0282-2Google ScholarCross Ref
- Tim Ziemer and Holger Schultheis. 2019. Psychoacoustical Signal Processing for Three-Dimensional Sonification. In 25th International Conference on Auditory Displays (ICAD2019). Newcastle, 277–284. https://doi.org/10.21785/icad2019.018Google Scholar
- Tim Ziemer and Holger Schultheis. 2021. The CURAT Sonification Game: Gamification for Remote Sonification Evaluation. In 26th International Conference on Auditory Display (ICAD2021). Virtual conference, 233–240. https://doi.org/10.21785/icad2021.026Google Scholar
- Tim Ziemer, Holger Schultheis, David Black, and Ron Kikinis. 2018. Psychoacoustical Interactive Sonification for Short Range Navigation. Acta Acustica united with Acustica 104, 6 (2018), 1075–1093. https://doi.org/10.3813/AAA.919273Google Scholar
Index Terms
- Both Rudimentary Visualization and Prototypical Sonification can Serve as a Benchmark to Evaluate New Sonification Designs
Recommendations
Sonification for Conveying Data and Emotion
AM '21: Proceedings of the 16th International Audio Mostly ConferenceIn the present study a sonification of running data was evaluated. The aim of the sonification was to both convey information about the data and convey a specific emotion. The sonification was evaluated in three parts, firstly as an auditory graph, ...
Data Sonification: Do You See What I Hear?
Using sound to complement graphics and to present data is becoming increasingly popular. Sound can potentially reveal patterns and anomalies in data that are difficult to perceive visually. Moreover, psychological studies show that some types of data ...
Aesthetic strategies in sonification
Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as ...
Comments