Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Introduction Read chapter Read first chapter

2017 | OriginalPaper | Chapter

Machine Learning as Meta-Instrument: Human-Machine Partnerships Shaping Expressive Instrumental Creation

Author : Rebecca Fiebrink

Published in: Musical Instruments in the 21st Century

Publisher: Springer Singapore

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this chapter, I describe how supervised learning algorithms can be used to build new digital musical instruments. Rather than merely serving as methods for inferring mathematical relationships from data, I show how these algorithms can be understood as valuable design tools that support embodied, real-time, creative practices. Through this discussion, I argue that the relationship between instrument builders and instrument creation tools warrants closer consideration: the affordances of a creation tool shape the musical potential of the instruments that are built, as well as the experiences and even the creative aims of the human builder. Understanding creation tools as “instruments” themselves invites us to examine them from perspectives informed by past work on performer-instrument interactions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now
previous chapter Instrumentality, Time and Perseverance
next chapter Interfacing Sound: Visual Representation of Sound in Musical Software Instruments
Footnotes
1
In this chapter, I use the word “composer” to refer to people who build new musical instruments and create customized controller mappings, rather than referring to them as instrument builders or musicians. This word choice reflects an understanding of instrument building as an act of musical composition (cf. Schnell and Battier 2002, discussed above). It also accommodates the fact that there may not be a clear or consistent distinction between the notions of instrument, “preset” or mapping, and composition. For instance, at least two of the composers discussed here (Dan Trueman and Laetitia Sonami) have used the same controllers or sensors to play different musical pieces, but designed a different gesture-to-sound mapping for each piece.
 
Literature
Bencina, R. (2005). The metasurface: Applying natural neighbour interpolation to two-to-many mapping. In Proceedings of the International Conference on New Interfaces for Musical Expression (pp. 101–104).
Bevilacqua, F., Müller, R., & Schnell, N. (2005). MnM: A Max/MSP mapping toolbox. In Proceedings of the International Conference on New Interfaces for Musical Expression (pp. 85–88).
Buxton, B. (2010). Sketching user experiences: Getting the design right and the right design. Morgan Kaufmann.
Chadabe, J. (1997). Electric sound: The past and promise of electronic music. Upper Saddle River, New Jersey: Prentice Hall.
Chadabe, J. (2002). The limitations of mapping as a structural descriptive in electronic instruments. In Proceedings of the International Conference on New Interfaces for Musical Expression .
Drummond, J. (2009). Understanding interactive systems. Organised Sound, 14(2), 124–133.CrossRef
Fails, J. A., & Olsen Jr, D. R. (2003). Interactive machine learning. In Proceedings of the International Conference on Intelligent User Interfaces (pp. 39–45).
Fels, S. S., & Hinton, G. E. (1995). Glove-TalkII: An adaptive gesture-to-formant interface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 456–463).
Fiebrink, R. A., & Cook, P. R. (2011). Real-time human interaction with supervised learning algorithms for music composition and performance (doctoral dissertation). Princeton University, Princeton, NJ.
Fiebrink, R., Cook, P. R., & Trueman, D. (2011). Human model evaluation in interactive supervised learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 147–156).
Fiebrink, R., Trueman, D., Britt, C., Nagai, M., Kaczmarek, K., et al. (2010). Toward understanding human-computer interaction in composing the instrument. In Proceedings of the International Computer Music Conference.
Fiebrink, R., Trueman, D., & Cook, P. R. (2009). A meta-instrument for interactive, on-the-fly machine learning. In Proceedings of the International Conference on New Interfaces for Musical Expression.
Garnett, G., & Goudeseune, C. (1999). Performance factors in control of high-dimensional spaces. In Proceedings of the International Computer Music Conference (pp. 268–271).
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009). The Weka data mining software: An update. ACM SIGKDD Explorations Newsletter, 11(1), 10–18.CrossRef
Hunt, A. & Kirk, R. (2000). Mapping strategies for musical performance. In M. M. Wanderley & M. Battier (Eds.). Trends in Gestural Control of Music. IRCAM—Centre Pompidou.
Hunt, A., & Wanderley, M. M. (2002). Mapping performer parameters to synthesis engines. Organised Sound, 7(2), 97–108.CrossRef
Hunt, A., Wanderley, M. M., & Paradis, M. (2002). The importance of parameter mapping in electronic instrument design. In Proceedings of the International Conference on New Interfaces for Musical Expression.
Katan, S., Grierson, M., & Fiebrink, R. (2015). Using interactive machine learning to support interface development through workshops with disabled people. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 251–254).
Lee, M., Freed, A., & Wessel, D. (1991). Real-time neural network processing of gestural and acoustic signals. In Proceedings of the International Computer Music Conference (pp. 277–277).
Moon, B. (1997). Score following and real-time signal processing strategies in open-form compositions. Information Processing Society of Japan, SIG Notes, 97(122), 12–19.
Morris, D., & Fiebrink, R. (2013). Using machine learning to support pedagogy in the arts. Personal and Ubiquitous Computing, 17(8), 1631–1635.CrossRef
Resnick, M., Myers, B., Nakakoji, K., Shneiderman, B., Pausch, R., Selker, T., et al. (2005). Design principles for tools to support creative thinking. In Report of Workshop on Creativity Support Tools. Washington, DC, USA.
Rittel, H. W. (1972). On the planning crisis: Systems analysis of the ‘first and second generations’. Bedriftsøkonomen, 8, 390–396.
Rowe, R., Garton, B., Desain, P., Honing, H., Dannenberg, R., Jacobs, D., et al. (1993). Editor’s notes: Putting Max in perspective. Computer Music Journal, 17(2), 3–11.CrossRef
Schnell, N., & Battier, M. (2002). Introducing composed instruments, technical and musicological implications. In Proceedings of the International Conference on New Interfaces for Musical Expression.
Sonami, L. (2016). Lecture on machine learning, within online class “Machine Learning for Musicians and Artists” by R. Fiebrink, produced by Kadenze, Inc.
Wanderley, M. M., & Depalle, P. (2004). Gestural control of sound synthesis. Proceedings of the IEEE, 92(4), 632–644.CrossRef
Wessel, D. (2006). An enactive approach to computer music performance. In Y. Orlarey (Ed.), Le Feedback dans la Creation Musical (pp. 93–98). Lyon, France: Studio Gramme.
Wright, M., & Freed, A. (1997). Open Sound Control: A new protocol for communicating with sound synthesizers. In Proceedings of the International Computer Music Conference.
Metadata
Title
Machine Learning as Meta-Instrument: Human-Machine Partnerships Shaping Expressive Instrumental Creation
Author
Rebecca Fiebrink
Copyright Year
2017
Publisher
Springer Singapore
Book
Musical Instruments in the 21st Century

Print ISBN: 978-981-10-2950-9

Electronic ISBN: 978-981-10-2951-6

Copyright Year: 2017

DOI
https://doi.org/10.1007/978-981-10-2951-6_10

Premium Partners

    Image Credits