Skip to main content

2018 | OriginalPaper | Buchkapitel

12. Sonification and HCI

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter investigates the second and third wave HCI design processes for an auditory display design and proposes a multifaceted framework. The purpose of using such a framework in a participatory context is to provide the possibility to create shared design knowledge in sonification and building new sonification designs on top of the prior work. From the early stages of the project involving the domain scientists in the process seemed to be an obvious choice. The process works in the sense that we gathered a diverse set of data analysis problems, solutions, and methods that work for data scientists within a sonification framework.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
As stated by HCI pioneer Douglas Engelbart: If ease of use was the only valid criterion, people would stick to tricycles and never try bicycles.
 
Literatur
Zurück zum Zitat Alais D, Burr D (2004) The ventriloquist effect results from near optimal bimodal integration. Curr Biol 14(3):257–262CrossRef Alais D, Burr D (2004) The ventriloquist effect results from near optimal bimodal integration. Curr Biol 14(3):257–262CrossRef
Zurück zum Zitat Alexander RL, O’Modhrain S, Roberts DA et al (2014) The bird’s ear view of space physics: audification as a tool for the spectral analysis of time series data. J Geophys Res Space Phys 119(7):5259–5271CrossRef Alexander RL, O’Modhrain S, Roberts DA et al (2014) The bird’s ear view of space physics: audification as a tool for the spectral analysis of time series data. J Geophys Res Space Phys 119(7):5259–5271CrossRef
Zurück zum Zitat Anderson RJ (1994) Representations and requirements: the value of ethnography in system design. Human Comput Interact 9(3):151–182CrossRef Anderson RJ (1994) Representations and requirements: the value of ethnography in system design. Human Comput Interact 9(3):151–182CrossRef
Zurück zum Zitat Barrass S (1996) Tada! Demonstrations of auditory information design. Unpublished PhD thesis Barrass S (1996) Tada! Demonstrations of auditory information design. Unpublished PhD thesis
Zurück zum Zitat Barrass S (2003) Sonification design patterns. In: Proceedings of International conference on auditory display, Boston Barrass S (2003) Sonification design patterns. In: Proceedings of International conference on auditory display, Boston
Zurück zum Zitat Ben-Tal O, Berger J, Cook B et al (2002) The sonification application research toolbox. In: Proceedings of International conference on auditory display, Kyoto Ben-Tal O, Berger J, Cook B et al (2002) The sonification application research toolbox. In: Proceedings of International conference on auditory display, Kyoto
Zurück zum Zitat Bieusheuvel S (1947) Psychological tests and their application to non-European peoples. In: Yearbook of education. Evans, London, pp 185–207 Bieusheuvel S (1947) Psychological tests and their application to non-European peoples. In: Yearbook of education. Evans, London, pp 185–207
Zurück zum Zitat Bregman AS (1994) Auditory scene analysis: the perceptual organization of sound. MIT Press, Cambridge Bregman AS (1994) Auditory scene analysis: the perceptual organization of sound. MIT Press, Cambridge
Zurück zum Zitat Brewster S (1994) Providing a structured method for integrating non-speech audio into human-computer interfaces. Unpublished PhD thesis Brewster S (1994) Providing a structured method for integrating non-speech audio into human-computer interfaces. Unpublished PhD thesis
Zurück zum Zitat Candey RM, Schertenleib AM, Merced WL (2006) Xsonify sonification tool for space physics. In: Proceedings of International conference on auditory display, London Candey RM, Schertenleib AM, Merced WL (2006) Xsonify sonification tool for space physics. In: Proceedings of International conference on auditory display, London
Zurück zum Zitat Carroll JM, Chin G, Rosson MB, et al (2000) The development of cooperation: five years of participatory design in the virtual school. In: Proceedings on designing interactive systems: processes, practices, methods, and techniques. Association for Computing Machinery, New York, pp 239–251 Carroll JM, Chin G, Rosson MB, et al (2000) The development of cooperation: five years of participatory design in the virtual school. In: Proceedings on designing interactive systems: processes, practices, methods, and techniques. Association for Computing Machinery, New York, pp 239–251
Zurück zum Zitat Dahl L, Herrera J, Wilkerson C (2011) Tweetdreams: making music with the audience and the world using real-time twitter data. In: Jensenius AR, Tveit A, Godøy RI et al (eds) Proceedings of the international conference on new interfaces for musical expression (NIME) Oslo, pp 272–275 Dahl L, Herrera J, Wilkerson C (2011) Tweetdreams: making music with the audience and the world using real-time twitter data. In: Jensenius AR, Tveit A, Godøy RI et al (eds) Proceedings of the international conference on new interfaces for musical expression (NIME) Oslo, pp 272–275
Zurück zum Zitat de Campo A (2007). A data sonification design space map. In: Proceedings of the 2nd International workshop on interactive sonification, York de Campo A (2007). A data sonification design space map. In: Proceedings of the 2nd International workshop on interactive sonification, York
Zurück zum Zitat de Campo A, Daye C, Frauenberger C et al (2006) Sonification as an interdisciplinary working process. In: Proceedings of International conference on auditory display, London de Campo A, Daye C, Frauenberger C et al (2006) Sonification as an interdisciplinary working process. In: Proceedings of International conference on auditory display, London
Zurück zum Zitat Dombois F (2001) Using audification in planetary seismology. In: Hiipakka J, Zacharov N, Takala T (eds) Proceedings of the 7th International conference on auditory display, Espoo, pp 227–230 Dombois F (2001) Using audification in planetary seismology. In: Hiipakka J, Zacharov N, Takala T (eds) Proceedings of the 7th International conference on auditory display, Espoo, pp 227–230
Zurück zum Zitat Droumeva M, Wakkary R (2006). The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence audio display. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the international conference on auditory display, London, pp 36–43 Droumeva M, Wakkary R (2006). The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence audio display. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the international conference on auditory display, London, pp 36–43
Zurück zum Zitat Fischer G (1993) Beyond human computer interaction: designing useful and usable computational environments. In: People and computers VIII: proceedings of the HCI’93 conference (Loughborough, England), Cambridge University Press, Cambridge, UK, pp 17–31 Fischer G (1993) Beyond human computer interaction: designing useful and usable computational environments. In: People and computers VIII: proceedings of the HCI’93 conference (Loughborough, England), Cambridge University Press, Cambridge, UK, pp 17–31
Zurück zum Zitat Fischer G (1994) Putting the owners of problems in charge with domain-oriented design environments. In: Gilmore D, Winder R, Detienne F (eds) User-centered requirements for software engineering environments. Springer, Heidelberg, pp 297–306CrossRef Fischer G (1994) Putting the owners of problems in charge with domain-oriented design environments. In: Gilmore D, Winder R, Detienne F (eds) User-centered requirements for software engineering environments. Springer, Heidelberg, pp 297–306CrossRef
Zurück zum Zitat Fischer G, Giaccardi E (2006) Meta-design: a framework for the future of end-user development. In: Lieberman H, Paternò F, Wulf V (eds) End user development. Springer, Dordrecht, pp 427–457CrossRef Fischer G, Giaccardi E (2006) Meta-design: a framework for the future of end-user development. In: Lieberman H, Paternò F, Wulf V (eds) End user development. Springer, Dordrecht, pp 427–457CrossRef
Zurück zum Zitat Flowers JH (2005) Thirteen years of reflection on auditory graphing: promises, pitfalls, and potential new directions. In: Brazil E (ed) Proceedings of International conference on auditory display, Limerick Flowers JH (2005) Thirteen years of reflection on auditory graphing: promises, pitfalls, and potential new directions. In: Brazil E (ed) Proceedings of International conference on auditory display, Limerick
Zurück zum Zitat Flowers JH, Turnage KD, Buhman DC (2005) Desktop data sonification: comments on flowers et al ICAD 1996. ACM Trans Appl Percept 2(4):473–476CrossRef Flowers JH, Turnage KD, Buhman DC (2005) Desktop data sonification: comments on flowers et al ICAD 1996. ACM Trans Appl Percept 2(4):473–476CrossRef
Zurück zum Zitat Frauenberger C, Stockman T (2009) Auditory display design—an investigation of a design pattern approach. Int J Hum Comput Stud 67(11):907–922CrossRef Frauenberger C, Stockman T (2009) Auditory display design—an investigation of a design pattern approach. Int J Hum Comput Stud 67(11):907–922CrossRef
Zurück zum Zitat Gaver W (1993) How in the world do we hear? Explorations in ecological acoustics. Ecol Psychol 5:283–313 Gaver W (1993) How in the world do we hear? Explorations in ecological acoustics. Ecol Psychol 5:283–313
Zurück zum Zitat Gaver W (1994) Using and creating auditory icons. In: Kramer G (ed) Auditory display: sonification, audification and auditory interfaces. Addison-Wesley Publishing, Reading, pp 417–446 Gaver W (1994) Using and creating auditory icons. In: Kramer G (ed) Auditory display: sonification, audification and auditory interfaces. Addison-Wesley Publishing, Reading, pp 417–446
Zurück zum Zitat Gaver W, Smith RB, O’Shea T (1991) Effective sounds in complex systems: the ARKola simulation. In: Robertson S, Olson G, Olson JS (eds) Proceedings of the SIGCHI conference on human factors in computing systems, New Orleans, pp 85–90 Gaver W, Smith RB, O’Shea T (1991) Effective sounds in complex systems: the ARKola simulation. In: Robertson S, Olson G, Olson JS (eds) Proceedings of the SIGCHI conference on human factors in computing systems, New Orleans, pp 85–90
Zurück zum Zitat Giaccardi E, Fischer G (2008) Creativity and evolution: a metadesign perspective. Digital Creativity 19(1):19–32CrossRef Giaccardi E, Fischer G (2008) Creativity and evolution: a metadesign perspective. Digital Creativity 19(1):19–32CrossRef
Zurück zum Zitat Gregory J (2003) Scandinavian approaches to participatory design. Int J Eng Educ 19(1):62–74MathSciNet Gregory J (2003) Scandinavian approaches to participatory design. Int J Eng Educ 19(1):62–74MathSciNet
Zurück zum Zitat Grinstein G, Smith S (1990) The perceptualization of scientific data. In: Proceedings of the SPIE/SPSE conference on electronic imaging, pp 190–199 Grinstein G, Smith S (1990) The perceptualization of scientific data. In: Proceedings of the SPIE/SPSE conference on electronic imaging, pp 190–199
Zurück zum Zitat Harrison S, Tatar D, Sengers P (2007) The three paradigms of HCI. In: Alt. Chi. Session at the SIGCHI Conference on human factors in computing systems, San Jose, California, USA, pp 1–18 Harrison S, Tatar D, Sengers P (2007) The three paradigms of HCI. In: Alt. Chi. Session at the SIGCHI Conference on human factors in computing systems, San Jose, California, USA, pp 1–18
Zurück zum Zitat Henneman RH, Long ER (1954) A comparison of the visual and auditory senses as channels for data presentation. In: Technical report 54(363). Wright Air Development Center, Dayton Henneman RH, Long ER (1954) A comparison of the visual and auditory senses as channels for data presentation. In: Technical report 54(363). Wright Air Development Center, Dayton
Zurück zum Zitat Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Universität Bielefeld Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Universität Bielefeld
Zurück zum Zitat Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: Susini OW (ed) Proceedings of the 14th International conference on auditory display, Paris Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: Susini OW (ed) Proceedings of the 14th International conference on auditory display, Paris
Zurück zum Zitat Hermann T, Baier G, Stephani U, et al (2006) Vocal Sonification of pathologic EEG features. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the 12th International conference on auditory display, London Hermann T, Baier G, Stephani U, et al (2006) Vocal Sonification of pathologic EEG features. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the 12th International conference on auditory display, London
Zurück zum Zitat Hermann T, Nehls AV, Eitel F et al (2012) Tweetscapes: Real-time sonification of twitter data streams for radio broadcasting. In: Nees MA, Walker BN, Freeman J (eds) Proceedings of ICAD, Atlanta Hermann T, Nehls AV, Eitel F et al (2012) Tweetscapes: Real-time sonification of twitter data streams for radio broadcasting. In: Nees MA, Walker BN, Freeman J (eds) Proceedings of ICAD, Atlanta
Zurück zum Zitat Holmquist LE (2008) Bootlegging: multidisciplinary brainstorming with cut-ups. In: Simonsen J, Roberston T (eds) Proceedings of the tenth anniversary conference on participatory design. Indiana University, pp 158–161 Holmquist LE (2008) Bootlegging: multidisciplinary brainstorming with cut-ups. In: Simonsen J, Roberston T (eds) Proceedings of the tenth anniversary conference on participatory design. Indiana University, pp 158–161
Zurück zum Zitat Janata P, Childs E (2004) MarketBuzz: a Sonification of real-time financial data. In: Barrass S, Vickers P (eds) Proceedings of the tenth international conference on auditory display, Sydney Janata P, Childs E (2004) MarketBuzz: a Sonification of real-time financial data. In: Barrass S, Vickers P (eds) Proceedings of the tenth international conference on auditory display, Sydney
Zurück zum Zitat Kim R, Peters MA, Shams L (2012) 0+ 1> 1 how adding non-informative sound improves performance on a visual task. Psychol Sci 23(1):6–12CrossRef Kim R, Peters MA, Shams L (2012) 0+ 1> 1 how adding non-informative sound improves performance on a visual task. Psychol Sci 23(1):6–12CrossRef
Zurück zum Zitat Lennox PP, Myatt T, Vaughan JM (1999) From surround to true 3-d. In: 16th International Audio Engineering Society conference on spatial sound reproduction, Rovaniemi, Finland Lennox PP, Myatt T, Vaughan JM (1999) From surround to true 3-d. In: 16th International Audio Engineering Society conference on spatial sound reproduction, Rovaniemi, Finland
Zurück zum Zitat Mackay WE (2002) Video to support interaction design, DVD. ACM, New York. ISBN: 1-58113-516-5 Mackay WE (2002) Video to support interaction design, DVD. ACM, New York. ISBN: 1-58113-516-5
Zurück zum Zitat Mynatt ED (1997) Auditory icons. In: Hearst MA (ed) Dissonance on audio interfaces. IEEE Intelligent Systems, vol 12, pp 10–16 Mynatt ED (1997) Auditory icons. In: Hearst MA (ed) Dissonance on audio interfaces. IEEE Intelligent Systems, vol 12, pp 10–16
Zurück zum Zitat Norman DA, Draper SW (1986) User centered system design. L. Erlbaum Associates, Hillsdale Norman DA, Draper SW (1986) User centered system design. L. Erlbaum Associates, Hillsdale
Zurück zum Zitat Numa K, Toriumi K, Tanaka K et al (2008) Knowledge-based intelligent information and engineering systems. Springer, Berlin, pp 823–830CrossRef Numa K, Toriumi K, Tanaka K et al (2008) Knowledge-based intelligent information and engineering systems. Springer, Berlin, pp 823–830CrossRef
Zurück zum Zitat Oulasvirta A, Kurvinen E, Kankainen T (2003) Understanding contexts by being there: case studies in bodystorming. Pers Ubiquit Comput 7(2):125–134CrossRef Oulasvirta A, Kurvinen E, Kankainen T (2003) Understanding contexts by being there: case studies in bodystorming. Pers Ubiquit Comput 7(2):125–134CrossRef
Zurück zum Zitat Perrott DR, Saberi K, Brown K et al (1990) Auditory psychomotor coordination and visual search performance. Percept Psychophys 48(3):214–226CrossRef Perrott DR, Saberi K, Brown K et al (1990) Auditory psychomotor coordination and visual search performance. Percept Psychophys 48(3):214–226CrossRef
Zurück zum Zitat Rogers Y, Preece J, Sharp H (2002) Interaction design: beyond human-computer interaction. Wiley, New York Rogers Y, Preece J, Sharp H (2002) Interaction design: beyond human-computer interaction. Wiley, New York
Zurück zum Zitat Sanderson P, Anderson J, Watson M (2000) Extending ecological interface design to auditory displays. In: Proceedings of the 10th Australasian conference on computer-human interaction, Sydney Sanderson P, Anderson J, Watson M (2000) Extending ecological interface design to auditory displays. In: Proceedings of the 10th Australasian conference on computer-human interaction, Sydney
Zurück zum Zitat Schoon A, Dombois F (2009) Sonification in music. In: International conference on auditory display, Copenhagen Schoon A, Dombois F (2009) Sonification in music. In: International conference on auditory display, Copenhagen
Zurück zum Zitat Schuler D, Namioka A (1993) Participatory design: principles and practices. L. Erlbaum Associates, Hillsdale Schuler D, Namioka A (1993) Participatory design: principles and practices. L. Erlbaum Associates, Hillsdale
Zurück zum Zitat Soto-Faraco S, Spence C, Kingstone A (2004) Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. J Exp Psychol Hum Percept Perform 30:330–345CrossRef Soto-Faraco S, Spence C, Kingstone A (2004) Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. J Exp Psychol Hum Percept Perform 30:330–345CrossRef
Zurück zum Zitat Spinuzzi C (2005) The methodology of participatory design. Tech Commun 52(2):163–174 Spinuzzi C (2005) The methodology of participatory design. Tech Commun 52(2):163–174
Zurück zum Zitat Svanaes, D, Seland G (2004) Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. In Proceedings of the SIGCHI conference on Human factors in computing systems, Vienna Svanaes, D, Seland G (2004) Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. In Proceedings of the SIGCHI conference on Human factors in computing systems, Vienna
Zurück zum Zitat Taxén G (2004) Introducing participatory design in museums. In: Proceedings of the eighth conference on participatory design: artful integration: interweaving media, materials and practices, Toronto Taxén G (2004) Introducing participatory design in museums. In: Proceedings of the eighth conference on participatory design: artful integration: interweaving media, materials and practices, Toronto
Zurück zum Zitat Walker BN, Cothran JT (2003) Sonification sandbox: a graphical toolkit for auditory graphs. In: Proceedings of International conference on auditory display, Boston Walker BN, Cothran JT (2003) Sonification sandbox: a graphical toolkit for auditory graphs. In: Proceedings of International conference on auditory display, Boston
Zurück zum Zitat Ware C (2000) Information visualization: perception for design. Morgan Kaufman, San Francisco Ware C (2000) Information visualization: perception for design. Morgan Kaufman, San Francisco
Zurück zum Zitat Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638CrossRef Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638CrossRef
Zurück zum Zitat Worrall D (2009) The use of sonic articulation in identifying correlation in capital market trading data. In: Proceedings of the 15th International conference on auditory display, Copenhagen Worrall D (2009) The use of sonic articulation in identifying correlation in capital market trading data. In: Proceedings of the 15th International conference on auditory display, Copenhagen
Zurück zum Zitat Worrall D (2015) Realtime sonification and visualisation of network metadata. In Proceedings of the 21st International conference on auditory display, Graz Worrall D (2015) Realtime sonification and visualisation of network metadata. In Proceedings of the 21st International conference on auditory display, Graz
Zurück zum Zitat Worrall D, Bylstra M, Barrass S et al (2007) The design of an extendable software framework for sonification research and auditory display. In: Proceedings of International conference on auditory display, Montreal Worrall D, Bylstra M, Barrass S et al (2007) The design of an extendable software framework for sonification research and auditory display. In: Proceedings of International conference on auditory display, Montreal
Zurück zum Zitat Yamauchi Y, Swanson EB (2010) Local assimilation of an enterprise system: situated learning by means of familiarity pockets. Inf Organ 20(3–4):187–206CrossRef Yamauchi Y, Swanson EB (2010) Local assimilation of an enterprise system: situated learning by means of familiarity pockets. Inf Organ 20(3–4):187–206CrossRef
Metadaten
Titel
Sonification and HCI
verfasst von
Visda Goudarzi
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-73356-2_12

Neuer Inhalt