Alfonso Perez Carrillo
Marcelo M. Wanderley
ABSTRACT
Acquisition of instrumental gestures in musical performances is an important task used in different fields ranging from acoustics and sound synthesis to motor learning or electroacoustic performances. The most common approach for acquiring gestures is by means of a sensing system. The direct measurement involves the use of usually expensive sensors with some degree of intrusivity and generally entails complex setups. Indirect acquisition is based on the processing of the audio signal and it is usually informed on acoustical or physical properties of the sound or sound production mechanism. In this paper we present an indirect acquisition method of violin controls from an audio signal based on learning of empirical data that is previously collected with a highly accurate sensing system. The learning consists of training of statistical models with a database of multimodal data from violin performances. The database includes audio spectral features and instrumental controls (bow tilt, bow force, bow velocity, bowing distance to the bridge and played string) and is designed to sample most part of the violin performance control space. We expect that once the indirect acquisition system is trained, no sensors should be required, so the indirect acquisition becomes a low-cost and non-intrusive acquisition method.
- J. Abeßer. Automatic string detection for bass guitar and electric guitar. In Proc. 9th International Symposium on Computer Music Modelling and Retrieval, London, June 2012.Google Scholar
- J. Abeßer, H. Lukashevich, and G. Schuller. Feature-based extraction of plucking and expression styles of the electric bass guitar. In Proc. ICASSP, 2010.Google ScholarCross Ref
- I. Barbancho, C. de la Bandera, A. Barbancho, and L. Tardon. Transcription and expressiveness detection system for violin music. In IEEE International Conference on Acoustics, Speech and Signal Processing, pages 189--192, april 2009. Google ScholarDigital Library
- L. Cremer. Physics of the Violin. The MIT Press, November 1984.Google Scholar
- E. Guaus, J. Bonada, E. Maestre, A. Perez, and M. Blaauw. Calibration method to measure accurate bow force for real violin performances. In Int. Computer Music Conf., pages 251--254, Montreal, Canada, 16/08/2009 2009.Google Scholar
- E. Guaus, J. Bonada, A. Perez, E. Maestre, and M. Blaauw. Measuring the bow pressing force in a real violin performance. In Int. Symposium on Musical Acoust., Barcelona, Spain, 2007.Google Scholar
- M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The weka data mining software: an update. SIGKDD Explor. Newsl., 11(1):10--18, Nov. 2009. Google ScholarDigital Library
- C. Kereliuk, B. Scherrer, V. Verfaille, P. Depalle, and M. M. Wanderley. Indirect acquisition of fingerings of harmonics notes on the flute. In 33rd Int. Computer Music Conf., volume 1, pages 263--6, Copenhagen, Denmark, August 2007.Google Scholar
- A. Krishnaswamy and J. O. Smith. Inferring control inputs to an acoustic violin from audio spectra. In Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2, ICME '03, pages 733--736, Washington, DC, USA, 2003. IEEE Computer Society. Google ScholarDigital Library
- A. Loscos. Low level descriptors for automatic violin transcription. In In ISMIR, pages 164--167, 2006.Google Scholar
- E. Maestre, M. Blaauw, J. Bonada, E. Guaus, and A. Pérez. Statistical modeling of bowing control applied to sound synthesis. IEEE Transactions on Audio, Speech and Language Processing. Special Issue on Virtual Analog Audio Effects and Musical Instruments, 2010. Google ScholarDigital Library
- E. Maestre, J. Bonada, M. Blaauw, A. Pérez, and E. Guaus. Acquisition of violin instrumental gestures using a commercial EMF device. In Proc. Int. Computer Music Conf., Copenhagen, Denmark, 2007.Google Scholar
- G. Peeters. A large set of audio features for sound description (similarity and classification) in the cuidado project. Technical report, IRCAM, Paris, France, 2004.Google Scholar
- A. Perez Carrillo, J. Bonada, E. Maestre, E. Guaus, and M. Blaauw. Performance control driven violin timbre model based on neural networks. Audio, Speech, and Language Processing, IEEE Transactions on, 20(3):1007--1021, march 2012. Google ScholarDigital Library
- J. Schelleng. The bowed string and the player. The Journal of the Acoustical Society of America, 53(1):26--41, 1973.Google ScholarCross Ref
- B. Scherrer and P. Depalle. Extracting the angle of release from guitar tones: preliminary results. In 2012, Nantes, France, 2012.Google Scholar
- T. Smyth and J. S. Abel. Toward an estimation of the clarinet reed pulse from instrument performance. The Journal of the Acoustical Society of America, 131(6):4799--4810, 2012.Google ScholarCross Ref
- C. Traube, P. Depalle, and M. Wanderley. Indirect acquisition of instrumental gesture based on signal, physical and perceptual information. In Proceedings of the 2003 conference on New interfaces for musical expression, NIME '03, pages 42--47, Singapore, Singapore, 2003. National University of Singapore. Google ScholarDigital Library
- G. Tzanetakis, A. Kapur, and A. Tindale. Learning indirect acquisition of instrumental gestures using direct sensors. In 8th IEEE Workshop on Multimedia Signal Processing, pages 37--40, oct. 2006.Google ScholarCross Ref
- V. Verfaille, P. Depalle, and M. M. Wanderley. Detecting overblown flute fingerings from the residual noise spectrum. The Journal of the Acoustical Society of America, 127(1):534--541, 2010.Google ScholarCross Ref
- L. Vinceslas, F. García, A. Pérez, and E. Maestre. Mapping blowing pressure and sound features in recorder playing. In Proceedings of the International Conference on Digital Audio Effects, 2011.Google Scholar
- M. M. Wanderley and P. Depalle. Gestural control of sound synthesis. In Proceedings IEEE, pages 632--644, 2004.Google ScholarCross Ref
- B. Zhang and Y. Wang. Automatic music transcription using audio-visual fusion for violin practice in home environment. Technical Report TRA7/09, Shool of Computing, National University of Singapore, 2009.Google Scholar
Index Terms
- Learning and extraction of violin instrumental controls from audio signal
Recommendations
Indirect acquisition of violin instrumental controls from audio signal with hidden Markov models
Acquisition of instrumental gestures in musical performances is a field of increasing interest with applications in different areas ranging from acoustics and sound synthesis to motor learning or artistic performances. Direct acquisition approaches are ...
Hearing movement: how taiko can inform automatic recognition of expressive movement qualities
MOCO '15: Proceedings of the 2nd International Workshop on Movement and ComputingWe describe the first stages of exploratory research undertaken to analyze expressive movement qualities of taiko performance, a Japaense artistic practice that combines stylized movement with drumming technique. The eventual goals of this research are ...
Violin fingering estimation based on violin pedagogical fingering model constrained by bowed sequence estimation from audio input
IEA/AIE'10: Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part IIIThis work presents an automated violin fingering estimation method that facilitates a student violinist acquire the "sound" of his/her favorite recording artist created by the artist's unique fingering. Our method realizes this by analyzing an audio ...
Comments