Skip to main content
Erschienen in: The Computer Games Journal 3-4/2019

04.10.2019 | Research

An Introduction to Spatial Sound Rendering in Virtual Environments and Games

verfasst von: Mirza Beig, Bill Kapralos, Karen Collins, Pejman Mirza-Babaei

Erschienen in: The Computer Games Journal | Ausgabe 3-4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the rise of consumer-level virtual and augmented reality, there has been renewed interest in spatial sound. While this interest has been exciting for sound researchers, for newcomers to spatial sound the field can be fraught with technical terminology and a wide range of tools. This paper presents an introduction to spatial sound rendering in virtual environments (VEs: including games, augmented and virtual reality). We introduce a short overview of spatial sound, explore the aspects necessary to recreate spatial (virtual or 3D) sound, and present an overview of the common tools used in today’s major game development engines to create spatial sound in VEs.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Allen, J. B., & Berkley, D. A. (1979). Image method for efficiently simulating small-room acoustics. Journal of the Acoustical Society of America, 65(4), 943–950.CrossRef Allen, J. B., & Berkley, D. A. (1979). Image method for efficiently simulating small-room acoustics. Journal of the Acoustical Society of America, 65(4), 943–950.CrossRef
Zurück zum Zitat Batteau, D. W. (1967). The role of the pinna in human localization. Proceedings of the Royal Society B: Biological Sciences,168, 158–180.CrossRef Batteau, D. W. (1967). The role of the pinna in human localization. Proceedings of the Royal Society B: Biological Sciences,168, 158–180.CrossRef
Zurück zum Zitat Begault, D. (1999). Auditory and non-auditory factors that potentially influence virtual acoustic imagery. In Proceedings of the AES 16th international conference on spatial sound reproduction, Rovaniemi, Finland. Begault, D. (1999). Auditory and non-auditory factors that potentially influence virtual acoustic imagery. In Proceedings of the AES 16th international conference on spatial sound reproduction, Rovaniemi, Finland.
Zurück zum Zitat Beig, M., Kapralos, B., Collins, K., & Mirza-Babaei, P. (2019). G-SpAR: GPU-based voxel graph pathfinding for spatial audio rendering in games and VR. In Proceedings of the IEEE conference on games, London, UK. Beig, M., Kapralos, B., Collins, K., & Mirza-Babaei, P. (2019). G-SpAR: GPU-based voxel graph pathfinding for spatial audio rendering in games and VR. In Proceedings of the IEEE conference on games, London, UK.
Zurück zum Zitat Blauert, J. (1996). The psychophysics of human sound localization (revised edition). Cambridge, MA: MIT Press. Blauert, J. (1996). The psychophysics of human sound localization (revised edition). Cambridge, MA: MIT Press.
Zurück zum Zitat Broderick, J., Duggan, J., & Redfern, S. (2018). The importance of spatial audio in modern games and virtual environments. In Proceedings of the IEEE games, entertainment, media conference (GEM), Galway, Ireland. Broderick, J., Duggan, J., & Redfern, S. (2018). The importance of spatial audio in modern games and virtual environments. In Proceedings of the IEEE games, entertainment, media conference (GEM), Galway, Ireland.
Zurück zum Zitat Brown, D., Stecker, G. C., & Tollin, D. J. (2015). The precedence effect in sound localization. Journal of the Association for Research in Otolaryngology,16(1), 1–28.CrossRef Brown, D., Stecker, G. C., & Tollin, D. J. (2015). The precedence effect in sound localization. Journal of the Association for Research in Otolaryngology,16(1), 1–28.CrossRef
Zurück zum Zitat Brungart, D. S. (1999). Auditory Parallax Effects in the HRTF for nearby sources. In Proceedings of the 1999 IEEE workshop on applications of signal processing to audio and acoustics (WASPAA’99), New York, USA. Brungart, D. S. (1999). Auditory Parallax Effects in the HRTF for nearby sources. In Proceedings of the 1999 IEEE workshop on applications of signal processing to audio and acoustics (WASPAA’99), New York, USA.
Zurück zum Zitat Cowan, B., & Kapralos, B. (2010). GPU-based real-time acoustical occlusion modeling. Virtual Reality,14(3), 183–196.CrossRef Cowan, B., & Kapralos, B. (2010). GPU-based real-time acoustical occlusion modeling. Virtual Reality,14(3), 183–196.CrossRef
Zurück zum Zitat Cowan, B., & Kapralos, B. (2011). GPU-based acoustical occlusion modeling with acoustical texture maps. In Proceedings of the 6th ACM audio mostly conference, Coimbra, Portugal. Cowan, B., & Kapralos, B. (2011). GPU-based acoustical occlusion modeling with acoustical texture maps. In Proceedings of the 6th ACM audio mostly conference, Coimbra, Portugal.
Zurück zum Zitat Cowan, B., & Kapralos, B. (2015). Interactive rate acoustical occlusion/diffraction modeling for 2D virtual environments & games. In Proceedings of the 2015 6th international conference on information, intelligence, systems and applications (IISA), Corfu, Greece. Cowan, B., & Kapralos, B. (2015). Interactive rate acoustical occlusion/diffraction modeling for 2D virtual environments & games. In Proceedings of the 2015 6th international conference on information, intelligence, systems and applications (IISA), Corfu, Greece.
Zurück zum Zitat Funkhouser, T., Carlbom, I., Elko, G., Pingali, G., Sondhi, M., & West, J. (1998). A beam tracing approach to acoustic modeling for interactive virtual environments. In Proceedings of the 25th annual conference on computer graphics and interactive techniques (SIGGRAPH ‘98), New York, USA. Funkhouser, T., Carlbom, I., Elko, G., Pingali, G., Sondhi, M., & West, J. (1998). A beam tracing approach to acoustic modeling for interactive virtual environments. In Proceedings of the 25th annual conference on computer graphics and interactive techniques (SIGGRAPH ‘98), New York, USA.
Zurück zum Zitat Funkhouser, T., Tsingos, N., Carlbom, I., Elko, G., Sondhi, M., West, J. E., et al. (2004). A beam tracing method for interactive architectural acoustics. Journal of the Acoustical Society of America, 115(2), 739–756.CrossRef Funkhouser, T., Tsingos, N., Carlbom, I., Elko, G., Sondhi, M., West, J. E., et al. (2004). A beam tracing method for interactive architectural acoustics. Journal of the Acoustical Society of America, 115(2), 739–756.CrossRef
Zurück zum Zitat Guay, J. F. (2012). Real-time sound propagation in video games. Game Developers Conference (GDC) Vault (pp. 5–9). Guay, J. F. (2012). Real-time sound propagation in video games. Game Developers Conference (GDC) Vault (pp. 5–9).
Zurück zum Zitat Hamidi, F., & Kapralos, K. (2009). A review of spatial sound for virtual environments and games with graphics processing units. The Open Virtual Reality Journal,1, 8–17.CrossRef Hamidi, F., & Kapralos, K. (2009). A review of spatial sound for virtual environments and games with graphics processing units. The Open Virtual Reality Journal,1, 8–17.CrossRef
Zurück zum Zitat Huang, H., Solah, M., Li, D., & Yu, L. F. (2019). Audible panorama: Automatic spatial audio generation for panorama imagery. In Proceedings of the 2019 CHI conference on human factors in computing systems, Glasgow, Scotland, UK. Paper No. 621. Huang, H., Solah, M., Li, D., & Yu, L. F. (2019). Audible panorama: Automatic spatial audio generation for panorama imagery. In Proceedings of the 2019 CHI conference on human factors in computing systems, Glasgow, Scotland, UK. Paper No. 621.
Zurück zum Zitat Kapralos, B., Jenkin, M., & Milios, E. (2008). Virtual audio systems. Presence: Teleoperators and Virtual Environments,17(6), 527–549.CrossRef Kapralos, B., Jenkin, M., & Milios, E. (2008). Virtual audio systems. Presence: Teleoperators and Virtual Environments,17(6), 527–549.CrossRef
Zurück zum Zitat Kapralos, B., Moussa, F., Collins, K., & Dubrowski, A. (2017). Levels of fidelity and multimodal interactions. In P. Wouters & H. van Oostendorp (Eds.), Techniques to improve the effectiveness of serious games, springer advances in game-based learning book series (pp. 79–101). Berlin: Springer. Kapralos, B., Moussa, F., Collins, K., & Dubrowski, A. (2017). Levels of fidelity and multimodal interactions. In P. Wouters & H. van Oostendorp (Eds.), Techniques to improve the effectiveness of serious games, springer advances in game-based learning book series (pp. 79–101). Berlin: Springer.
Zurück zum Zitat Kouyoumjian, R. G., & Pathak, P. H. (1974). A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface. Proceedings of the IEEE,62(11), 1448–1461.CrossRef Kouyoumjian, R. G., & Pathak, P. H. (1974). A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface. Proceedings of the IEEE,62(11), 1448–1461.CrossRef
Zurück zum Zitat Krokstad, A., Strom, S., & Sorsdal, S. (1968). Calculating the acoustical room response by the use of a ray tracing technique. Journal of Sound and Vibration, 8(1), 118–125.CrossRef Krokstad, A., Strom, S., & Sorsdal, S. (1968). Calculating the acoustical room response by the use of a ray tracing technique. Journal of Sound and Vibration, 8(1), 118–125.CrossRef
Zurück zum Zitat Lehnert, H. (1993). Systematic errors of the ray-tracing algorithm. Applied Acoustics,38(2), 207–221.CrossRef Lehnert, H. (1993). Systematic errors of the ray-tracing algorithm. Applied Acoustics,38(2), 207–221.CrossRef
Zurück zum Zitat Mehra, R., Rungta, A., Golas, A., Lin, M., & Manocha, D. (2015). WAVE: Interactive wave-based sound propagation for virtual environments. Proceedings of the IEEE Transactions on Visualization and Computer Graphics,21(4), 434–442.CrossRef Mehra, R., Rungta, A., Golas, A., Lin, M., & Manocha, D. (2015). WAVE: Interactive wave-based sound propagation for virtual environments. Proceedings of the IEEE Transactions on Visualization and Computer Graphics,21(4), 434–442.CrossRef
Zurück zum Zitat Moustakas, N., Floros, A., Rovithis, E., & Vogklis, K. (2019). Augmented audio-only games: A new generation of immersive acoustic environments through advanced mixing. Proceedings of the audio engineering society 146th international convention, Dublin, Ireland. Moustakas, N., Floros, A., Rovithis, E., & Vogklis, K. (2019). Augmented audio-only games: A new generation of immersive acoustic environments through advanced mixing. Proceedings of the audio engineering society 146th international convention, Dublin, Ireland.
Zurück zum Zitat Plack, C. J. (2018). The sense of hearing (3rd ed.). London: Routledge.CrossRef Plack, C. J. (2018). The sense of hearing (3rd ed.). London: Routledge.CrossRef
Zurück zum Zitat Raghuvanshi, N., Galoppo, N., & Lin, M. C. (2008). Accelerated wave-based acoustics simulation. In Proceedings of the 2008 ACM symposium on solid and physical modeling (SPM ‘08), New York, USA. Raghuvanshi, N., Galoppo, N., & Lin, M. C. (2008). Accelerated wave-based acoustics simulation. In Proceedings of the 2008 ACM symposium on solid and physical modeling (SPM ‘08), New York, USA.
Zurück zum Zitat Raghuvanshi, N., Snyder, J., Mehra, R., Lin, M., & Govindaraju, N. (2010). Precomputed wave simulation for real-time sound propagation of dynamic sources in complex scenes. In Proceedings of the ACM SIGGRAPH 2010 papers (SIGGRAPH ‘10), Los Angeles, USA. Raghuvanshi, N., Snyder, J., Mehra, R., Lin, M., & Govindaraju, N. (2010). Precomputed wave simulation for real-time sound propagation of dynamic sources in complex scenes. In Proceedings of the ACM SIGGRAPH 2010 papers (SIGGRAPH ‘10), Los Angeles, USA.
Zurück zum Zitat Savioja, L., & Svensonn, U. P. (2015). Overview of geometrical room acoustic modeling techniques. Journal of the Acoustical Society of America,138(2), 708.CrossRef Savioja, L., & Svensonn, U. P. (2015). Overview of geometrical room acoustic modeling techniques. Journal of the Acoustical Society of America,138(2), 708.CrossRef
Zurück zum Zitat Serafin, S., Geronazzo, M., Erkut, C., Nilsson, N. C., & Nordahl, R. (2018). Sonic interactions in virtual reality: State of the art, current challenges, and future directions. IEEE Computer Graphics and Applications,38(2), 31–43.CrossRef Serafin, S., Geronazzo, M., Erkut, C., Nilsson, N. C., & Nordahl, R. (2018). Sonic interactions in virtual reality: State of the art, current challenges, and future directions. IEEE Computer Graphics and Applications,38(2), 31–43.CrossRef
Zurück zum Zitat Tsingos, N., Funkhouser, T., Ngan, A., & Carlbom, I. (2001). Modeling acoustics in virtual environments using the uniform theory of diffraction. In Proceedings of the 28th annual conference on computer graphics and interactive techniques (SIGGRAPH ‘01), New York, USA. Tsingos, N., Funkhouser, T., Ngan, A., & Carlbom, I. (2001). Modeling acoustics in virtual environments using the uniform theory of diffraction. In Proceedings of the 28th annual conference on computer graphics and interactive techniques (SIGGRAPH ‘01), New York, USA.
Metadaten
Titel
An Introduction to Spatial Sound Rendering in Virtual Environments and Games
verfasst von
Mirza Beig
Bill Kapralos
Karen Collins
Pejman Mirza-Babaei
Publikationsdatum
04.10.2019
Verlag
Springer New York
Erschienen in
The Computer Games Journal / Ausgabe 3-4/2019
Elektronische ISSN: 2052-773X
DOI
https://doi.org/10.1007/s40869-019-00086-0

Weitere Artikel der Ausgabe 3-4/2019

The Computer Games Journal 3-4/2019 Zur Ausgabe