Top

The Journal of Supercomputing

Published in:

01-02-2020

A score identification parallel system based on audio-to-score alignment

Authors: A. J. Muñoz-Montoro, R. Cortina, S. García-Galán, E. F. Combarro, J. Ranilla

Published in: The Journal of Supercomputing | Issue 11/2020

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper presents a parallel system for searching a digital score of classical music in a personal library. The application scenario of the system is for a musician who wants to search for a specific score in its own device by playing an excerpt of a few seconds of the composition. We propose a solution, based on audio-to-score alignment, which allows to identify the correct score in a database of musical pieces in real time. This is a challenging task because we focus on a real-time system targeted for handheld devices characterized by both mobility and low power consumption. Experimental results show that it is possible to achieve real-time execution in the tested scenarios using parallel computing techniques with ARM processors.

previous article Trust-embedded collaborative deep generative model for social recommendation

next article Interactive capacitive touch music table with embedded microcontrollers

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

https://beatik.com.

https://www.antescofo.com.

https://tonara.com.

https://newzik.com.

https://www.shazam.com.

https://gitlab.com/SSPressing/ReMAS.

https://gitlab.com/SSPressing/shizmidi.

Alonso P, Cortina R, Rodríguez-Serrano FJ, Vera-Candeas P, Alonso-González M, Ranilla J (2017) Parallel online time warping for real-time audio-to-score alignment in multi-core systems. J Supercomput 73(1):126–138. https://doi.org/10.1007/s11227-016-1647-5CrossRef

Alonso P, Vera-Candeas P, Cortina R, Ranilla J (2017) An efficient musical accompaniment parallel system for mobile devices. J Supercomput 73(1):343–353. https://doi.org/10.1007/s11227-016-1865-xCrossRef

Arzt A (2016) Flexible and robust music tracking. Ph.D. thesis, Johannes Kepler University Linz

Carabias-Orti JJ, Cobos M, Vera-Candeas P, Rodríguez-Serrano FJ (2013) Nonnegative signal factorization with learnt instrument models for sound source separation in close-microphone recordings. EURASIP J Adv Signal Process 1:184. https://doi.org/10.1186/1687-6180-2013-184CrossRef

Carabias-Orti J.J, Rodriguez-Serrano F, Vera-Candeas P, Ruiz-Reyes N, Canadas-Quesada F.J (2015) An audio to score alignment framework using spectral factorization and dynamic time warping. In: ISMIR: Proceedings of the International Conference of Music Information Retrieval, pp 742–748

Cichocki A, Amari SI (2010) Families of alpha- beta- and gamma- divergences: flexible and robust measures of Similarities. Entropy. https://doi.org/10.3390/e12061532

Cont A (2006) Realtime audio to score alignment for polyphonic music instruments, using sparse non-negative constraints and hierarchical HMMS. In: Proceedings of 2006 IEEE International Conference on Acoustics Speed and Signal Processing, vol 5. IEEE, pp V–245–V–248. https://doi.org/10.1109/ICASSP.2006.1661258

Dixon S (2005) Live tracking of musical performances using on-line time warping. In: DAFx, pp. 1727–1728

Ewert S, Muller M, Grosche P (2009) High resolution audio synchronization using chroma onset features. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, pp 1869–1872. https://doi.org/10.1109/ICASSP.2009.4959972

10.

Févotte C, Idier J (2011) Algorithms for nonnegative matrix factorization with the \(\beta\)-divergence. Neural Comput 23(9):2421–2456MathSciNetCrossRef

11.

Hu N, Dannenberg R.B, Tzanetakis G (2003) Polyphonic audio matching and alignment for music retrieval. In: IEEE workshop on applications of signal processing to audio and acoustics, vol 2003-Janua. IEEE, pp 185–188. https://doi.org/10.1109/ASPAA.2003.1285862

12.

Kaprykowsky H, Rodet X (2006) Globally optimal short-time dynamic time warping, application to score to audio alignment. In: Proceedings of 2006 IEEE International Conference on Acoustics Speed and Signal Processing, vol 5. IEEE, pp V–249–V–252. https://doi.org/10.1109/ICASSP.2006.1661259

13.

Kurth F, Muller M (2008) Efficient index-based audio matching. IEEE Trans Audio Speech Lang Process 16(2):382–395. https://doi.org/10.1109/TASL.2007.911552CrossRef

14.

Munoz-Montoro AJ, Carabias-Orti JJ, Vera-Candeas P, Canadas-Quesada FJ (2019) Online/offline score informed music signal decomposition: application to minus one. Eurasip J Audio Speech Music Process 1:23. https://doi.org/10.1186/s13636-019-0168-6CrossRef

15.

Orio N, Schwarz D (2001) Alignment of monophonic and polyphonic music to a score. In: Proceedings of the International Computer Music Conference, pp 155–158

16.

Otsuka T, Takahashi T, Okuno H.G, Komatani K, Ogata T, Murata K, Nakadai K (2009) Incremental polyphonic audio to score alignment using beat tracking for singer robots. In: 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, pp 2289–2296. https://doi.org/10.1109/IROS.2009.5354637

17.

Raffel C, Ellis DPW (2015) Large-scale content-based matching of midi and audio files. In: Proceedings of the International Society for Music Information Retrieval Conference

18.

Raffel C, Ellis DPW (2016) Extracting ground truth information from MIDI files: A Midifesto. In: Proceedings of 17th International Society for Music Information Retrieval Conference, pp 796–802

19.

Raphael C (2010) Music plus one and machine learning. In: Proceedings of the 27th International Conference on Machine Learning, pp 21–28

20.

Rodríguez-Serrano FJ, Carabias-Orti JJ, Vera-Candeas P, Canadas-Quesada FJ, Ruiz-Reyes N (2014) Monophonic constrained non-negative sparse coding using instrument models for audio separation and transcription of monophonic source-based polyphonic mixtures. Multimed Tools Appl 72(1):925–949. https://doi.org/10.1007/s11042-013-1398-8CrossRef

21.

Rodriguez-Serrano FJ, Duan Z, Vera-Candeas P, Pardo B, Carabias-Orti JJ (2015) Online score-informed source separation with adaptive instrument models. J New Music Res 44(2):83–96. https://doi.org/10.1080/09298215.2014.989174CrossRef

22.

Thickstun J, Harchaoui Z, Kakade S (2017) Learning features of music from scratch. In: ICLR, pp 1–14

23.

Turetsky R, Ellis D (2003) Ground-truth transcriptions of real music from force-aligned MIDI syntheses. In: Proceedings of the 4th international symposium on music information retrieval, pp 135–141. https://doi.org/10.7916/D8S472CZ

24.

Wang ALC (2003) An industrial strength audio search algorithm. In: Proceedings of the 4th International Society for Music Information Retrieval Conference (ISMIR 203), Baltimore, Maryland (USA), 26–30 October 2003, pp 7–13. https://doi.org/10.1109/IITAW.2009.110

Title: A score identification parallel system based on audio-to-score alignment
Authors: A. J. Muñoz-Montoro
R. Cortina
S. García-Galán
E. F. Combarro
J. Ranilla
Publication date: 01-02-2020
Publisher: Springer US
Published in: The Journal of Supercomputing / Issue 11/2020
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-020-03185-2

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 11/2020

CA-Dedupe: content-aware deduplication in SSDs

Efficient scheduling of streams on GPGPUs

Modified adaptive neuro-fuzzy inference system (M-ANFIS) based multi-disease analysis of healthcare Big Data

Improving utilization of heterogeneous clusters

Incorporating evolutionary computation for securing wireless network against cyberthreats

On the design of two-stage multiprojection methods for distributed memory systems

Premium Partner