Jun Yin
ABSTRACT
Prompt feedback is essential for beginning violin learners; however, most amateur learners can only meet with teachers and receive feedback once or twice a week. To help such learners, we have attempted an initial design of Digital Violin Tutor (DVT), an integrated system that provides the much-needed feedback when human teachers are not available. DVT combines violin audio transcription with visualization. Our transcription method is fast, accurate, and robust again noise for violin audio recorded in home environments. The visualization is designed to be intuitive and easily understandable by people with little music knowledge. The different visualization modalities--video, 2D fingerboard animation, 3D avatar animation--help learners to practice and learn more effectively. The entire system has been implemented with off-the-shelf hardware and shown to be practical in home environments. In our user study, the system has received very positive evaluation.
- D. Bendor, M. Sandler. Time Domain Extraction of Vibrato from Monophonic Instruments. International Symposium on Music Information Retrieval, 2000.Google Scholar
- R. B. Dannenberg. An online-line algorithm for real-time accompaniment. Proc. ICMC 1984, ICMA (1984), 193--198.Google Scholar
- R. B. Dannenberg, M. Sanchez, A. Joseph, P Capell, R. Joseph, R. Saul. A Computer-Based Multi-Media Tutor for Beginning Piano Students. Journal of New Music Research, 19(2--3), 1990.Google Scholar
- G. ElKoura, K. Singh. Handrix: Animating the Human Hand, ACM Symp. Computer Animation, pp. 110--119, 2003. Google ScholarDigital Library
- P. Faloutsos, M. van de Panne, D. Terzopoulos. Composable Controllers for Physics-based Character Animation. SIGGRAPH Conference Proceedings, pp. 251--260, 2001. Google ScholarDigital Library
- B. Kedem. Spectral analysis and discrimination by zero-crossings. Proceedings of the IEEE, 74(11): 1477--1493, 1986.Google ScholarCross Ref
- J. Kim, F. Cordier, N.M. Thalmann. Neural Networks Based Violinist's Hand Animation. Computer Graphics International, pp. 37--41, 2000. Google ScholarDigital Library
- A. P. Klapuri. Automatic Transcription of Music. Proceedings of the Stockholm Music Acoustic Conference. 2003.Google Scholar
- P. M. Martins, J. S. Ferreira. PCM to MIDI Transposition. Audio Engineering Society 112th Convention Paper, May 2002.Google Scholar
- C. Oshima, K. Nishimoto, M. Suzuki. Family Ensemble: A Collaborative Musical Edutainment System for Children and Parents. ACM Multimedia 04, 2004. Google ScholarDigital Library
- M. Piszczalski, B.A. Galler. Automatic Music Transcription. Computer Music Journal, 1(4):24--31, 1977.Google Scholar
- S. Rossignol, X. Rodet, J. Soumagne, J. L. Collete, and P. Depalle. Automatic characterization of musical signals: feature extraction and temporal segmentation. Journal of New Music Research, 1999.Google Scholar
- S. W. Smoliar, J. A. Waterworth, P. R. Kellock. pianoFORTE: A System for Piano Education Beyond Notation Literary. ACM Multimedia 95, 1995. Google ScholarDigital Library
- J. Yin, A. Dhanik, D. Hsu, Y. Wang. The Creation of a Music-Driven Digital Violinist. ACM Multimedia 04, 2004. Google ScholarDigital Library
- J. Yin, T. Sim, Y. Wang, A Shenoy. Music Transcription Using an Instrument Model. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005.Google Scholar
- Amazing MIDI, http://www.pluto.dti.ne.jp/~araki/amazingmidi/index.htmlGoogle Scholar
- intelliScore, http://www.intelliscore.neGoogle Scholar
Index Terms
- Digital violin tutor: an integrated system for beginning violin learners
Recommendations
Interactive digital violin tutor (IDVT): an edutainment system for violin learners
ACE '07: Proceedings of the international conference on Advances in computer entertainment technologyWe present in this demo our current design of an Interactive Digital Violin Tutor (iDVT), which enables students to have reflective practice when human teachers are not available. iDVT combines violin audio transcription with visualization. Our ...
Visual analysis of fingering for pedagogical violin transcription
MM '07: Proceedings of the 15th ACM international conference on MultimediaAutomatic music transcription, in spite of decades of research, remains a challenging research problem. The traditional audio-only approach has yet to achieve a satisfactory performance for any computer-aided pedagogical system. Inspired by the high ...
Effective use of multimedia for computer-assisted musical instrument tutoring
Emme '07: Proceedings of the international workshop on Educational multimedia and multimedia educationThis paper presents a survey of recent work in computer-assisted musical instrumental tutoring and outlines several questions to consider when developing future projects. In particular, we suggest that the area ingreatest need of computer assistance is ...
Comments