ABSTRACT
The Modular Musical Objects (MO) are an ensemble of tangible interfaces and software modules for creating novel musical instruments or for augmenting objects with sound. In particular, the MOs allow for designing action-sound relationships and behaviors based on the interaction with tangible objects or free body movements.
Such interaction scenarios can be inspired by the affordances of particular objects (e.g. a ball, a table), by interaction metaphors based on the playing techniques of musical instruments or games. We describe specific examples of action-sound relationships that are made possible by the MO software modules and which take advantage of machine learning techniques.
- Bevilacqua, F., Schnell, N., Rasamimanana, N., Zamborlin, B., and Guédy, F. Online gesture analysis and control of audio processing, musical robots and interactive multimodal systems. In Musical Robots and Interactive Multimodal Systems: Springer Tracts in Advanced Robotics Vol 74, J. Solis and K. C. Ng, Eds. Springer Verlag, 2011, 127--142.Google ScholarCross Ref
- Fiebrink, R., Cook, P. R., and Trueman, D. Human model evaluation in interactive supervised learning. In Proceedings of the 2011 annual conference on Human factors in computing systems, CHI '11 (New York, NY, USA, 2011), 147--156. Google ScholarDigital Library
- Gillian, N., Knapp, R. B., and O'Modhrain, S. A machine learning toolbox for musician computer interaction. In Proc. of NIME '11 (2011).Google Scholar
- Godøy, R. I., and Leman, M., Eds. Musical Gestures: Sound, Movement, and Meaning. Routledge, 2009.Google Scholar
- Rasamimanana, N., Bevilacqua, F., Bloit, J., Schnell, N., Fety, E. and Cera, A., Petrevski, U., and J.-L., F. The urban musical game: using sport balls as musical interfaces. In CHI EA '12 Proceedings (2012). Google ScholarDigital Library
- Rasamimanana, N., Bevilacqua, F., Schnell, N., Guedy, F., Come Maestracci, E. F., Zamborlin, B., and Uros Petrevsky, J.-l. F. Modular musical objects towards embodied control of digital music. In Proc. of TEI'11 (2011). Google ScholarDigital Library
- Schnell, N., Bevilacqua, F., Rasamimanana, N., Bloit, J., Guedy, F., and Flety, E. Playing the mo - gestural control and re-embodiment of recorded sound and music. In Proc. of NIME '11 (2011).Google Scholar
- Schnell, N., Röbel, A., Schwarz, D., Peeters, G., and Borghesi, R. Mubu and friends: Assembling tools for content based real-time interactive audio processing in max/msp. In Proceedings of the International Computer Music Conference (ICMC) (Montreal, Canada, August 2009).Google Scholar
- Schnell, N., Suárez Cifuentes, M. A., and Lambert, J.-P. First steps in relaxed real-time typo-morphological audio analysis/synthesis. In Proc of the Sound and Music Computing conference (2010).Google Scholar
Index Terms
- De-Mo: designing action-sound relationships with the mo interfaces
Recommendations
Modular musical objects towards embodied control of digital music
TEI '11: Proceedings of the fifth international conference on Tangible, embedded, and embodied interactionWe present an ensemble of tangible objects and software modules designed for musical interaction and performance. The tangible interfaces form an ensemble of connected objects communicating wirelessly. A central concept is to let users determine the ...
Introduction to Creating Musical Interfaces
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsThis course provides a general, gentle, and fun introduction to the theory and practice of interface design for creating and performing music. Participants will learn key aspects of the theory and practice of musical interface design by studying case ...
“Writing with music”: Exploring the use of auditory feedback in gesture interfaces
We investigate the use of auditory feedback in pen-gesture interfaces in a series of informal and formal experiments. Initial iterative exploration showed that gaining performance advantage with auditory feedback was possible using absolute cues and ...
Comments