Patrick Ng
ABSTRACT
The importance of sound is quite well known in video games. Although frequently in the past sound was simply used to increase the immersion of the player. Now there is a growing interest in using sound as a means for providing the player with additional information.
While the use of sound for displaying information has been a topic of research for a number of years, research into the area of informative sound design for games hasn't been widely investigated as such. As a result proper guidelines for game developers to follow when attempting to design informative sound for a game haven't been broadly established. In addition, there has been almost no work done in considering specific genres such as Real Time Strategy and First-Person Shooter games and how sounds can be best used to provide players with information in these types of games. In this work we review previous approaches to sound design including the use of patterns. We then review these approaches in relation to sound design for both FPS and RTS games. Finally we present some key design patterns in relation to these genres.
- Alexander, C. (1979). The Timeless Way of Building. New York: Oxford University Press.Google Scholar
- Alexander, C., Ishikawa, S., Silverstein, M., Jacobson, M., Fiksdahl-King, I., and Angel, S. (1977). A Pattern Language: Towns, Buildings, Construction. New York: Oxford University Press.Google Scholar
- Alves, V., and Roque, L. (2010). A pattern language for sound design in games. Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound, Pitea, Sweden. Google ScholarDigital Library
- Alves, V. and Roque, L. (2011). A deck for sound design in games: enhancements based on a design exercise. Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. Article No. 34. Google ScholarDigital Library
- Blattner, M. M., Sumikawa, D. A., & Greenberg, R. M. (1989). Earcons and icons: their structure and common design principles. Human Computer Interactive, 4(1), 11--14. doi: 10.1207/s15327051hci0401_1 Google ScholarDigital Library
- Barrass, S. (2003). Sonification Design Patterns. Proceedings of the 2003 International Conference on Auditory Display, 170--175. Boston, MA, USA.Google Scholar
- Blizzard Entertainment, (2002). WarCraft III: Reign of ChaosGoogle Scholar
- Blizzard Entertainment, (2010). StarCraft II: Wings of LibertyGoogle Scholar
- EA Digital Illusions. (2011). Battlefield 3Google Scholar
- Edman, T. R. (1982). Human Factors Guidelines for the Use of Synthetic Speech Devices. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 26(3), 212--216. doi: 10.1177/154193128202600304Google ScholarCross Ref
- El-Nasr, M. S., & Yan, S. (2006). Visual attention in 3D video games. Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology, Hollywood, California. Google ScholarDigital Library
- Gamma, E., Helm, R., Johnson, R., & Vlissides, J. (1994). Design Patterns: Elements of Reusable Object-Oriented Software: Addison-Wesley. Google ScholarDigital Library
- Gärdenfors, D. (2001). Auditory Interfaces: A Design Platform.Google Scholar
- Gärdenfors, D. (2003). Designing sound-based computer games. Digital Creativity, 14(2), 111--114. doi: 10.1076/digc.14.2.111.27863Google ScholarCross Ref
- Gaver, W. W. (1986). Auditory Icons: using sound in computer Interfaces. Human Computer Interaction 2: 167--177. Google ScholarDigital Library
- Goldstein, E. B. (1989). Sensation and Perception. Brooks/Cole Publishing Company.Google Scholar
- Holloway, A., DeArmond, R., Francoeur, M., Seagal, D., Zuill, A., Kurniawan, S. (2011). Visualizing Audio in a First-Person Shooter With Directional Sound Display. 1st Workshop on Game Accessibility: Xtreme Interaction Design (GAXID'11) at Foundations of Digital Games, Bordeaux, France.Google Scholar
- Infinity Ward & Sledgehammer Games (2011). Call of Duty: Modern Warfare 3Google Scholar
- Jørgensen, K. (2006). On The Functional Aspects of Computer Game Audio. Proceedings of the Audio Mostly Conference - A Conference of Sound in Games, Piteå, Sweden.Google Scholar
- Jørgensen, K. (2008). Left in the Dark: Playing Computer Games with the Sound Turned Off, Aldershot, Ashgate.Google Scholar
- Kramer, G. (1994). An Introduction to Auditory Display. Auditory Display: Sonification, Audification and Auditory Interfaces. G. Kramer (ed), Addison-Wesley Publishing Company. XVIII: 1--78.Google Scholar
- McGookin, D. K., & Brewster, S. A. (2004). Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition. ACM Transactions on Applied Perception (TAP), 1(2), 130--155. Google ScholarDigital Library
- McGee, M. R., P. D. Gray, et al. (2000). Communicating with feeling. First Workshop on Haptic Human-Computer Interaction.Google Scholar
- Mountford, S. A., and Gaver, W. (1990). Talking and listening to computers. In The Art of Human-Computer Interface Design, 319--334.Google Scholar
- Nacke, L. E., Grimshaw, M. N., & Lindley, C. A. (2010). More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game. Interacting with Computers, 22(5), 336--343. doi: 10.1016/j.intcom.2010.04.005 Google ScholarDigital Library
- Nesbitt, K. and Chang, D. (2013). Designing Multi-Sensory Displays for Mobile Devices, Handbook on Mobile and Ubiquitous Computing: Innovations and Perspectives, Yang, L. T. Syukur, E. and Loke, S. W. (eds.), CRC Press, Taylor & Francis Group. USAGoogle Scholar
- Pao, L. Y. and D. A. Lawrence (1998). Synergistic Visual/Haptic Computer Interfaces. Japan/USE/Vietnam Workshop on Research and Education in Systems, Computation and Control Engineering.Google Scholar
- Parker, J. R., & Heerema, J. (2007). Musical interaction in computer games. Proceedings of the 2007 conference on Future Play, Toronto, Canada. Google ScholarDigital Library
- Patterson, R. D (1982). Guidelines for auditory warning systems on civil aircraft. CAA Paper 82017, Civil Aviation Authority, London.Google Scholar
- Röber, N. and Masuch, M. (2005), Leaving the Screen, New Perspectives in Audio-only Gaming. Proceedings of the 11th ICAD: Limerick, Ireland.Google Scholar
- Stuart, R. (1996) The Design of Virtual Environments. McGraw-Hill, New York. ISBN 0-07-063299-5 Google ScholarDigital Library
- Tan, S., Baxa, J., & Spackman, M. P. (2010). Effects of Built-in Audio versus Unrelated Background Music on Performance in an Adventure Role-Playing Game. International Journal of Gaming and Computer-Mediated Simulations (IJGCMS), 2(3), 1--23. Doi: 10.4018/jgcms.2010070101 Google ScholarDigital Library
- Taito Corporation (1978). Space InvadersGoogle Scholar
- Treyarch. (2012). Call of Duty: Black Ops IIGoogle Scholar
- Welch, R. B. and Warren, D. H. (1980). Immediate Perceptual Response to Intersensory Discrepancy. Psychological Bulletin 88(3): 638--667.Google ScholarCross Ref
- Valve Corporation. (2011). Dota 2Google Scholar
- Wickens, C. D. and Baker, P. (1995). Cognitive Issues in Virtual Reality. Virtual Environments and Advanced Interface Design. B. W. and F. T. A. New York, Oxford University Press: 514--541. Google ScholarDigital Library
Index Terms
- Informative sound design in video games
Recommendations
Lyricon Lyrics + Earcons Improves Identification of Auditory Cues
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187Auditory researchers have developed various non-speech cues in designing auditory user interfaces. A preliminary study of "lyricons" lyricsï ź+ï źearcons [1] has provided a novel approach to devising auditory cues in electronic products, by combining ...
Sound Design Impacts User Experience and Attention in Serious Game
Serious GamesAbstractWe study the impact of sound design – soundscape, sound effects, and auditory notifications, namely earcons – on the player’s experience of serious games. Three sound design versions for the game Venci’s Adventures have been developed: 1) no sound;...
A sound design for acoustic feedback in elite sports
CMMR/ICAD'09: Proceedings of the 6th international conference on Auditory DisplaySound (acoustic information) is the naturally evocative, audible result of kinetic events. Humans interact with the world by the everyday experience of listening to perceive and interpret the environment. Elite athletes, especially, rely on sport ...
Comments