Skip to main content
Top

2021 | OriginalPaper | Chapter

Tapping Along to the Difficult Ones: Leveraging User-Input for Beat Tracking in Highly Expressive Musical Content

Authors : António Sá Pinto, Matthew E. P. Davies

Published in: Perception, Representations, Image, Sound, Music

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We explore the task of computational beat tracking for musical audio signals from the perspective of putting an end-user directly in the processing loop. Unlike existing “semi-automatic” approaches for beat tracking, where users may select from among several possible outputs to determine the one that best suits their aims, in our approach we examine how high-level user input could guide the manner in which the analysis is performed. More specifically, we focus on the perceptual difficulty of tapping the beat, which has previously been associated with the musical properties of expressive timing and slow tempo. Since musical examples with these properties have been shown to be poorly addressed even by state of the art approaches to beat tracking, we re-parameterise an existing deep learning based approach to enable it to more reliably track highly expressive music. In a small-scale listening experiment we highlight two principal trends: i) that users are able to consistently disambiguate musical examples which are easy to tap to and those which are not; and in turn ii) that users preferred the beat tracking output of an expressive-parameterised system to the default parameterisation for highly expressive musical excerpts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The probability of tempo changes varies exponentially with the negative of the “transition-\(\lambda \)”, thus higher values of this parameter favour constant tempo from one beat to the next one [20].
 
Literature
1.
go back to reference Andersen, K., Knees, P.: Conversations with expert users in music retrieval and research challenges for creative MIR. In: Proceedings of the 17th International Society for Music Information Retrieval Conference, pp. 122–128 (2016) Andersen, K., Knees, P.: Conversations with expert users in music retrieval and research challenges for creative MIR. In: Proceedings of the 17th International Society for Music Information Retrieval Conference, pp. 122–128 (2016)
2.
go back to reference Böck, S., Davies, M.E.P., Knees, P.: Multi-task learning of tempo and beat: learning one to improve the other. In: Proceedings of the 20th International Society for Music Information Retrieval Conference, pp. 486–493 (2019) Böck, S., Davies, M.E.P., Knees, P.: Multi-task learning of tempo and beat: learning one to improve the other. In: Proceedings of the 20th International Society for Music Information Retrieval Conference, pp. 486–493 (2019)
4.
go back to reference Böck, S., Krebs, F., Widmer, G.: A multi-model approach to beat tracking considering heterogeneous music styles. In: Proceedings of the 15th International Society for Music Information Retrieval Conference, pp. 603–608 (2014) Böck, S., Krebs, F., Widmer, G.: A multi-model approach to beat tracking considering heterogeneous music styles. In: Proceedings of the 15th International Society for Music Information Retrieval Conference, pp. 603–608 (2014)
5.
go back to reference Böck, S., Krebs, F., Widmer, G.: Joint beat and downbeat tracking with recurrent neural networks. In: Proceedings of the 17th International Society for Music Information Retrieval Conference, pp. 255–261 (2016) Böck, S., Krebs, F., Widmer, G.: Joint beat and downbeat tracking with recurrent neural networks. In: Proceedings of the 17th International Society for Music Information Retrieval Conference, pp. 255–261 (2016)
6.
go back to reference Böck, S., Schedl, M.: Enhanced beat tracking with context-aware neural networks. In: Proceedings of the 14th International Conference on Digital Audio Effects, pp. 135–139 (2011) Böck, S., Schedl, M.: Enhanced beat tracking with context-aware neural networks. In: Proceedings of the 14th International Conference on Digital Audio Effects, pp. 135–139 (2011)
7.
go back to reference Bååth, R., Madison, G.: The subjective difficulty of tapping to a slow beat. In: Proceedings of the 12th International Conference on Music Perception and Cognition, pp. 82–55 (2012) Bååth, R., Madison, G.: The subjective difficulty of tapping to a slow beat. In: Proceedings of the 12th International Conference on Music Perception and Cognition, pp. 82–55 (2012)
8.
go back to reference Cannam, C., Landone, C., Sandler, M.: Sonic visualiser: an open source application for viewing, analysing, and annotating music audio files. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 1467–1468 (2010). https://doi.org/10.1145/1873951.1874248 Cannam, C., Landone, C., Sandler, M.: Sonic visualiser: an open source application for viewing, analysing, and annotating music audio files. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 1467–1468 (2010). https://​doi.​org/​10.​1145/​1873951.​1874248
9.
go back to reference Collins, N.: Towards a style-specific basis for computational beat tracking. In: Proceedings of the 9th International Conference on Music Perception and Cognition (ICMPC), pp. 461–467 (2006) Collins, N.: Towards a style-specific basis for computational beat tracking. In: Proceedings of the 9th International Conference on Music Perception and Cognition (ICMPC), pp. 461–467 (2006)
10.
go back to reference Davies, M.E.P., Böck, S.: Evaluating the evaluation measures for beat tracking. In: Proceedings of the 15th International Society for Music Information Retrieval Conference, pp. 637–642 (2014) Davies, M.E.P., Böck, S.: Evaluating the evaluation measures for beat tracking. In: Proceedings of the 15th International Society for Music Information Retrieval Conference, pp. 637–642 (2014)
12.
go back to reference Goto, M., Yoshii, K., Fujihara, H., Mauch, M., Nakano, T.: Songle: a web service for active music listening improved by user contributions. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, pp. 311–316 (2011) Goto, M., Yoshii, K., Fujihara, H., Mauch, M., Nakano, T.: Songle: a web service for active music listening improved by user contributions. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, pp. 311–316 (2011)
13.
go back to reference Grosche, P., Müller, M., Sapp, C.: What makes beat tracking difficult? A case study on chopin mazurkas. In: Proceedings of the 11th International Society for Music Information Retrieval Conference, pp. 649–654 (2010) Grosche, P., Müller, M., Sapp, C.: What makes beat tracking difficult? A case study on chopin mazurkas. In: Proceedings of the 11th International Society for Music Information Retrieval Conference, pp. 649–654 (2010)
14.
go back to reference Hainsworth, S.: Techniques for the Automated Analysis of Musical Audio. Ph.D. thesis, University of Cambridge (2004) Hainsworth, S.: Techniques for the Automated Analysis of Musical Audio. Ph.D. thesis, University of Cambridge (2004)
16.
go back to reference Humphrey, E.J., Turnbull, D., Collins, T.: A brief review of creative MIR. In: Late-breaking Demo Session of the 14th International Society for Music Information Retrieval Conference (2013) Humphrey, E.J., Turnbull, D., Collins, T.: A brief review of creative MIR. In: Late-breaking Demo Session of the 14th International Society for Music Information Retrieval Conference (2013)
17.
go back to reference Iversen, J.R., Patel, A.D.: The Beat Alignment Test (BAT): surveying beat processing abilities in the general population. In: Proceedings of the 10th International Conference on Music Perception and Cognition, pp. 465–468 (2010) Iversen, J.R., Patel, A.D.: The Beat Alignment Test (BAT): surveying beat processing abilities in the general population. In: Proceedings of the 10th International Conference on Music Perception and Cognition, pp. 465–468 (2010)
20.
go back to reference Krebs, F., Böck, S., Widmer, G.: An efficient state space model for joint tempo and meter tracking. In: Proceedings of the 16th International Society for Music Information Retrieval Conference, pp. 72–78 (2015) Krebs, F., Böck, S., Widmer, G.: An efficient state space model for joint tempo and meter tracking. In: Proceedings of the 16th International Society for Music Information Retrieval Conference, pp. 72–78 (2015)
21.
go back to reference Moelants, D., McKinney, M.: Tempo perception and musical content: what makes a piece fast, slow or temporally ambiguous? In: Proceedings of the 8th International Conference on Music Perception and Cognition, pp. 558–562 (2004) Moelants, D., McKinney, M.: Tempo perception and musical content: what makes a piece fast, slow or temporally ambiguous? In: Proceedings of the 8th International Conference on Music Perception and Cognition, pp. 558–562 (2004)
22.
go back to reference Serra, X., et al.: Roadmap for music information research (2013), Creative Commons BY-NC-ND 3.0 license, ISBN: 978-2-9540351-1-6 Serra, X., et al.: Roadmap for music information research (2013), Creative Commons BY-NC-ND 3.0 license, ISBN: 978-2-9540351-1-6
26.
go back to reference Zapata, J.R., Holzapfel, A., Davies, M.E.P., Oliveira, J.L., Gouyon, F.: Assigning a confidence threshold on automatic beat annotation in large datasets. In: Proceedings of the 13th International Society for Music Information Retrieval Conference, pp. 157–162 (2012) Zapata, J.R., Holzapfel, A., Davies, M.E.P., Oliveira, J.L., Gouyon, F.: Assigning a confidence threshold on automatic beat annotation in large datasets. In: Proceedings of the 13th International Society for Music Information Retrieval Conference, pp. 157–162 (2012)
Metadata
Title
Tapping Along to the Difficult Ones: Leveraging User-Input for Beat Tracking in Highly Expressive Musical Content
Authors
António Sá Pinto
Matthew E. P. Davies
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-70210-6_5