Skip to main content

2021 | OriginalPaper | Buchkapitel

Exploring a Taxonomy of Interaction in Interactive Sonification Systems

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper explores a variety of existing interactive sonification systems in the context of interactive sound art. In design of interactive sonification from technological standpoint, the stress is put on studying the usability and functionality of the systems. We explore the focus towards creative aspects of interaction in both technology development and sound creation stages. In some artistic sonifications, the control is in the hand of the technology creators, in some others in the hand of the artists, and sometimes in the hand of the performers or the audience members. The numerous relations and interactions between performers, composers, technologists, data domain scientists, environment and audiences make it difficult to classify the complex phenomenon of interactive sonification. Some challenges in such systems are the ownership of technical and aesthetic components, balancing engagement and interaction among different stakeholders (domain scientist, designer, composer, spectator, etc.) and encouraging audience engagement.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Antle, A.N., Corness, G., Bevans, A.: Springboard: designing image schema based embodied interaction for an abstract domain. In: Whole Body Interaction, pp. 7–18. Springer, London (2011) Antle, A.N., Corness, G., Bevans, A.: Springboard: designing image schema based embodied interaction for an abstract domain. In: Whole Body Interaction, pp. 7–18. Springer, London (2011)
2.
Zurück zum Zitat Bau, O., Tanaka, A., Mackay, W.E.: The A20: musical metaphors for interface design. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME (2008) Bau, O., Tanaka, A., Mackay, W.E.: The A20: musical metaphors for interface design. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME (2008)
3.
Zurück zum Zitat Bilda, Z., Edmonds, E., Candy, L.: Designing for creative engagement. Des. Stud. 29(6), 525–540 (2008)CrossRef Bilda, Z., Edmonds, E., Candy, L.: Designing for creative engagement. Des. Stud. 29(6), 525–540 (2008)CrossRef
4.
Zurück zum Zitat Bott, J.N., Crowley, J.G., LaViola, J.J., Jr.: One man band: a 3D gestural interface for collaborative music creation. In: Proceedings of the Virtual Reality Conference, VR 2009, pp. 273–274 (2009) Bott, J.N., Crowley, J.G., LaViola, J.J., Jr.: One man band: a 3D gestural interface for collaborative music creation. In: Proceedings of the Virtual Reality Conference, VR 2009, pp. 273–274 (2009)
5.
Zurück zum Zitat Bryan-Kinns, N., Hamilton, F.: Identifying mutual engagement. Behav. Inf. Technol. 31(2), 101–125 (2009)CrossRef Bryan-Kinns, N., Hamilton, F.: Identifying mutual engagement. Behav. Inf. Technol. 31(2), 101–125 (2009)CrossRef
6.
Zurück zum Zitat Cope, D.: Computer models of musical creativity. MIT Press, Cambridge (2005) Cope, D.: Computer models of musical creativity. MIT Press, Cambridge (2005)
7.
Zurück zum Zitat Coughlan, T., Johnson, P.: Interaction in creative tasks: ideation, representation and evaluation in composition. In: Proceedings of the ACM Human Factors in Computing Systems, CHI 2006 (2006) Coughlan, T., Johnson, P.: Interaction in creative tasks: ideation, representation and evaluation in composition. In: Proceedings of the ACM Human Factors in Computing Systems, CHI 2006 (2006)
8.
Zurück zum Zitat Dahl, L., Herrera, J., Wilkerson, C.: Tweetdreams: making music with the audience and the world using real- time twitter data. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2011, pp. 272–275 (2011) Dahl, L., Herrera, J., Wilkerson, C.: Tweetdreams: making music with the audience and the world using real- time twitter data. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2011, pp. 272–275 (2011)
9.
Zurück zum Zitat Dixon, S.: Digital Performance: A History of New Media in Theater, Dance, Performance Art, and Installation. MIT Press, Cambridge (2007)CrossRef Dixon, S.: Digital Performance: A History of New Media in Theater, Dance, Performance Art, and Installation. MIT Press, Cambridge (2007)CrossRef
10.
Zurück zum Zitat Fiebrink, R., Trueman, D.: End-user machine learning in music composition and performance, Present. In: CHI 2012 Work. End-User Interact. with Intell. Auton. Syst. Austin, Texas, 6 May 2012, pp. 14–17 (2012) Fiebrink, R., Trueman, D.: End-user machine learning in music composition and performance, Present. In: CHI 2012 Work. End-User Interact. with Intell. Auton. Syst. Austin, Texas, 6 May 2012, pp. 14–17 (2012)
11.
Zurück zum Zitat Freeman, J., Godfrey, M.: Creative collaboration between audiences and musicians in Flock. Digital Creat. 21(2), 85–99 (2010)CrossRef Freeman, J., Godfrey, M.: Creative collaboration between audiences and musicians in Flock. Digital Creat. 21(2), 85–99 (2010)CrossRef
12.
Zurück zum Zitat Goudarzi, V.: Designing an interactive audio interface for climate science. IEEE Multimedia 22(1), 41–47 (2015)CrossRef Goudarzi, V.: Designing an interactive audio interface for climate science. IEEE Multimedia 22(1), 41–47 (2015)CrossRef
13.
Zurück zum Zitat Hermann, T., Hunt, A.: The discipline of interactive sonification. In: Proceedings of the International Workshop on Interactive Sonification, pp. 1–9, January 2004 Hermann, T., Hunt, A.: The discipline of interactive sonification. In: Proceedings of the International Workshop on Interactive Sonification, pp. 1–9, January 2004
14.
Zurück zum Zitat Hermann, T., Nehls, A.V., Eitel, F., Barri, T., Gammel, M.: Tweetscapes - real-time sonification of twitter data streams for radio broadcasting. In: Proceedings of the International Conference on Auditory Display, ICAD 2012 Hermann, T., Nehls, A.V., Eitel, F., Barri, T., Gammel, M.: Tweetscapes - real-time sonification of twitter data streams for radio broadcasting. In: Proceedings of the International Conference on Auditory Display, ICAD 2012
15.
Zurück zum Zitat Hermann, T., Ritter, H.: Sound and meaning in auditory data display. Proc. IEEE 92(4), 730–741 (2004)CrossRef Hermann, T., Ritter, H.: Sound and meaning in auditory data display. Proc. IEEE 92(4), 730–741 (2004)CrossRef
16.
Zurück zum Zitat Hogg, B., Vickers, P.: Sonification abstraite/sonification concrete: An’aesthetic persepective space’for classifying auditory displays in the ars musica domain. In: Proceedings of the 12th International Conference on Auditory Display, London, UK (2006) Hogg, B., Vickers, P.: Sonification abstraite/sonification concrete: An’aesthetic persepective space’for classifying auditory displays in the ars musica domain. In: Proceedings of the 12th International Conference on Auditory Display, London, UK (2006)
17.
Zurück zum Zitat Jordà, S.: Multi-user instruments: models, examples and promises. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2005, pp. 23–26 (2005) Jordà, S.: Multi-user instruments: models, examples and promises. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2005, pp. 23–26 (2005)
18.
Zurück zum Zitat Leplaitre, G., McGregor, I.: How to tackle auditory interface aesthetics? Discussion and case study. In: Proceedings of the 10th Meeting of the International Conference on Auditory Display, Sydney, Australia (2004) Leplaitre, G., McGregor, I.: How to tackle auditory interface aesthetics? Discussion and case study. In: Proceedings of the 10th Meeting of the International Conference on Auditory Display, Sydney, Australia (2004)
19.
21.
Zurück zum Zitat Pressing, J.: Cybernetic issues in interactive performance systems. Comput. Music J. 14(1), 12–25 (1990)CrossRef Pressing, J.: Cybernetic issues in interactive performance systems. Comput. Music J. 14(1), 12–25 (1990)CrossRef
22.
Zurück zum Zitat Roddy, S., Furlong, D.: Embodied aesthetics in auditory display. Organ. Sound 19(01), 70–77 (2014)CrossRef Roddy, S., Furlong, D.: Embodied aesthetics in auditory display. Organ. Sound 19(01), 70–77 (2014)CrossRef
23.
Zurück zum Zitat Salter, C.L., Baalman, M.A., Moody-Grigsby, D.: Between mapping, sonification and composition: responsive audio environments in live performance. In: International Symposium on Computer Music Modeling and Retrieval, pp. 246–262. Springer Berlin Heidelberg, August 2007 Salter, C.L., Baalman, M.A., Moody-Grigsby, D.: Between mapping, sonification and composition: responsive audio environments in live performance. In: International Symposium on Computer Music Modeling and Retrieval, pp. 246–262. Springer Berlin Heidelberg, August 2007
24.
Zurück zum Zitat Stowell, D., Plumbley, M.D., Bryan-Kinns, N.: Discourse analysis evaluation method for expressive musical interfaces. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2008 (2008) Stowell, D., Plumbley, M.D., Bryan-Kinns, N.: Discourse analysis evaluation method for expressive musical interfaces. In: Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2008 (2008)
25.
Zurück zum Zitat Suchman, L.A.: Plans and Situated Actions: The Problem of Human-machine Communication. Cambridge University Press, Cambridge (1987) Suchman, L.A.: Plans and Situated Actions: The Problem of Human-machine Communication. Cambridge University Press, Cambridge (1987)
26.
Zurück zum Zitat Vickers, P., Barrass, S.: Sonification design and aesthetics. In: Hermann, T., Hunt, A., Neuhoff, J.G. (eds.) The Sonification Handbook. Logos Verlag, Berlin (2011) Vickers, P., Barrass, S.: Sonification design and aesthetics. In: Hermann, T., Hunt, A., Neuhoff, J.G. (eds.) The Sonification Handbook. Logos Verlag, Berlin (2011)
27.
Zurück zum Zitat Wanderley, M.M., Orio, N.: Evaluation of input devices for musical expression: borrowing tools from HCI. Comput. Music J. 26(3), 62–76 (2002)CrossRef Wanderley, M.M., Orio, N.: Evaluation of input devices for musical expression: borrowing tools from HCI. Comput. Music J. 26(3), 62–76 (2002)CrossRef
28.
Zurück zum Zitat Wolf, K.E., Oda, R.: MALLOMARCH: a live sonified performance with user interaction. In: Proceedings of the International Conference on Auditory Display, ICAD 2016 (2016) Wolf, K.E., Oda, R.: MALLOMARCH: a live sonified performance with user interaction. In: Proceedings of the International Conference on Auditory Display, ICAD 2016 (2016)
Metadaten
Titel
Exploring a Taxonomy of Interaction in Interactive Sonification Systems
verfasst von
Visda Goudarzi
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-55307-4_22