Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Automatic Recognition of Sound Categories from Their Vocal Imitation Using Audio Primitives Automatically Found by SI-PLCA and HMM Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Toward Augmented Familiarity of the Audience with Digital Musical Instruments

Authors : Olivier Capra, Florent Berthaut, Laurent Grisoni

Published in: Music Technology with Swing

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The diversity and complexity of Digital Musical Instruments often lead to a reduced appreciation of live performances by the audience. This can be linked to the lack of familiarity they have with the instruments. We propose to increase this familiarity thanks to a transdisciplinary approach in which signals from both the musician and the audience are extracted, familiarity analyzed, and augmentations dynamically added to the instruments. We introduce a new decomposition of familiarity and the concept of correspondences between musical gestures and results. This paper is both a review of research that paves the way for the realization of a pipeline for augmented familiarity, and a call for future research on the identified challenges that remain before it can be implemented.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Augmenting Virtuality with a Synchronized Dynamic Musical Instrument: A User Evaluation of a Mixed Reality MIDI Keyboard
next chapter Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction
Literature
1.
Armitage, J.: Revealing timelines: live coding and its gestures. In: Proceedings of ICLC (2016)
2.
Barbosa, J., Calegario, F., Teichrieb, V., Ramalho, G., McGlynn, P.: Considering Audience’s view towards an evaluation methodology for digital musical instruments. In: Proceedings of NIME (2012)
3.
4.
Baytas, M.A., Göksun, T., Özcan, O.: The perception of live-sequenced electronic music via hearing and sight. In: Proceedings of NIME (2016)
5.
Bellotti, V., Back, M., Edwards, W.K., Grinter, R.E., Henderson, A., Lopes, C.: Making sense of sensing systems: five questions for designers and researchers. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 415–422. ACM (2002)
6.
Berners-Lee, T., Hendler, J., Lassila, O., et al.: The semantic web. Sci. Am. 284(5), 28–37 (2001)CrossRef
7.
Berthaut, F., Coyle, D., Moore, J., Limerick, H.: Liveness through the lens of agency and causality. In: Proceedings of NIME (2015)
8.
Berthaut, F., Marshall, M.T., Subramanian, S., Hachet, M.: Rouages: revealing the mechanisms of digital musical instruments to the audience. In: Proceedings of NIME (2013)
9.
10.
Bin, S.A., Bryan-Kinns, N., McPherson, A.P.: Skip the pre-concert demo: how technical familiarity and musical style affect audience response. In: Proceedings of NIME (2016)
11.
Bin, S.A., Bryan-Kinns, N., McPherson, A., et al.: Hands where we can see them! investigating the impact of gesture size on audience perception. International Computer Music Conference (2017)
12.
Astrid Bin, S.M., Morreale, F., Bryan-Kinns, N., McPherson, A.P.: In-the-moment and beyond: combining post-hoc and real-time data for the study of audience perception of electronic music performance. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10513, pp. 263–281. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-67744-6_​18CrossRef
13.
Cadoz, C., Wanderley, M.M.: Gesture-music (2000)
14.
Calvo-Merino, B., Glaser, D.E., Grèzes, J., Passingham, R.E., Haggard, P.: Action observation and acquired motor skills: an fmRI study with expert dancers. Cereb. Cortex 15(8), 1243–1249 (2005)CrossRef
15.
Chanel, G., Bétrancourt, M., Pun, T., Cereghetti, D., Molinari, G.: Assessment of computer-supported collaborative processes using interpersonal physiological and eye-movement coupling. In: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), pp. 116–122. IEEE (2013)
16.
Fels, S., Gadd, A., Mulder, A.: Mapping transparency through metaphor: towards more expressive musical instruments. Organ. Sound 7(2), 109–126 (2002)CrossRef
17.
18.
19.
20.
Godøy, R.I., et al.: Classifying music-related actions (2012)
21.
22.
Jensenius, A.R., Wanderley, M.M., Godøy, R.I., Leman, M.: Musical gestures. In: Musical Gestures: Sound, Movement, and Meaning, December 2009
23.
Kim, J., André, E.: Emotion recognition based on physiological changes in music listening. IEEE Trans. Pattern Anal. Mach. Intell. 30(12), 2067–2083 (2008)CrossRef
24.
Koelstra, S., et al.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)CrossRef
25.
26.
Lai, C.H., Bovermann, T.: Audience experience in sound performance. In: Proceedings of NIME (2013)
27.
28.
Leman, M., Maes, P.J.: The role of embodiment in the perception of music. Empir. Music. Rev. 9(3–4), 236–246 (2014)
29.
Loftus, E.F., Palmer, J.C.: Reconstruction of automobile destruction: an example of the interaction between language and memory. J. Verbal Learn. Verbal Behav. 13(5), 585–589 (1974)CrossRef
30.
Molnar-Szakacs, I., Overy, K.: Music and mirror neurons: from motion to ‘e’motion. Soc. Cogn. Affect. Neurosci. 1(3), 235–241 (2006)CrossRef
31.
Murray-Browne, T., Mainstone, D., Bryan-Kinns, N., Plumbley, M.D.: The medium is the message: composing instruments and performing mappings. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 56–59 (2011)
32.
Paulus, J., Müller, M., Klapuri, A.: State of the art report: audio-based music structure analysis. In: Proceedings of ISMIR (2010)
33.
34.
Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)CrossRef
35.
Ringeval, F., Sonderegger, A., Sauer, J., Lalanne, D.: Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), pp. 1–8. IEEE (2013)
36.
Sammler, D., Grigutsch, M., Fritz, T., Koelsch, S.: Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. Psychophysiology 44(2), 293–304 (2007)CrossRef
37.
38.
Schubert, E., Ferguson, S., Farrar, N., Taylor, D., McPherson, G.E.: The six emotion-face clock as a tool for continuously rating discrete emotional responses to music. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 1–18. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-41248-6_​1CrossRef
39.
Sequeira, H., Hot, P., Silvert, L., Delplanque, S.: Electrical autonomic correlates of emotion. Int. J. Psychophysiol. 71(1), 50–56 (2009)CrossRef
40.
Snoek, C.G., Worring, M.: Multimodal video indexing: a review of the state-of-the-art. Multimed. Tools Appl. 25(1), 5–35 (2005)CrossRef
41.
Swan, M.: The quantified self: fundamental disruption in big data science and biological discovery. Big Data 1(2), 85–99 (2013)CrossRef
42.
Vines, B.W., Krumhansl, C.L., Wanderley, M.M., Dalca, I.M., Levitin, D.J.: Music to my eyes: cross-modal interactions in the perception of emotions in musical performance. Cognition 118(2), 157–170 (2011)CrossRef
43.
Wegner, D.M., Wheatley, T.: Apparent mental causation: sources of the experience of will. Am. Psychol. 54(7), 480 (1999)CrossRef
44.
Wu, J.C., Huberth, M., Yeh, Y.H., Wright, M.: Evaluating the audience’s perception of real-time gestural control and mapping mechanisms in electroacoustic vocal performance. In: Proceedings NIME (2016)
Metadata
Title
Toward Augmented Familiarity of the Audience with Digital Musical Instruments
Authors
Olivier Capra
Florent Berthaut
Laurent Grisoni
Copyright Year
2018
Book
Music Technology with Swing

Print ISBN: 978-3-030-01691-3

Electronic ISBN: 978-3-030-01692-0

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-030-01692-0_37