Skip to main content
Top

2021 | OriginalPaper | Chapter

Methods and Datasets for DJ-Mix Reverse Engineering

Authors : Diemo Schwarz, Dominique Fourer

Published in: Perception, Representations, Image, Sound, Music

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

DJ techniques are an important part of popular music culture. However, they are also not sufficiently investigated by researchers due to the lack of annotated datasets of DJ mixes. Thus, this paper aims at filling this gap by introducing novel methods to automatically deconstruct and annotate recorded mixes for which the constituent tracks are known. A rough alignment first estimates where in the mix each track starts, and which time-stretching factor was applied. Second, a sample-precise alignment is applied to determine the exact offset of each track in the mix. Third, we propose a new method to estimate the cue points and the fade curves which operates in the time-frequency domain to increase its robustness to interference with other tracks. The proposed methods are finally evaluated on our new publicly available DJ-mix dataset UnmixDB. This dataset contains automatically generated beat-synchronous mixes based on freely available music tracks, and the ground truth about the placement, transformations and effects of tracks in a mix.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aspillaga, F., Cobb, J., Chuan, C.H.: Mixme: a recommendation system for DJs. In: International Symposium on Music Information Retrieval (ISMIR), October 2011 Aspillaga, F., Cobb, J., Chuan, C.H.: Mixme: a recommendation system for DJs. In: International Symposium on Music Information Retrieval (ISMIR), October 2011
2.
go back to reference Barchiesi, D., Reiss, J.: Reverse engineering of a mix. J. Audio Eng. Soc. 58(7/8), 563–576 (2010) Barchiesi, D., Reiss, J.: Reverse engineering of a mix. J. Audio Eng. Soc. 58(7/8), 563–576 (2010)
3.
go back to reference Bittner, R.M., et al.: Automatic playlist sequencing and transitions. In: International Symposium on Music Information Retrieval (ISMIR), Suzhou, China, October 2017 Bittner, R.M., et al.: Automatic playlist sequencing and transitions. In: International Symposium on Music Information Retrieval (ISMIR), Suzhou, China, October 2017
4.
go back to reference Brecht De Man, B., King, R., Reiss, J.D.: An analysis and evaluation of audio features for multitrack music mixtures. In: International Symposium on Music Information Retrieval (ISMIR) (2014) Brecht De Man, B., King, R., Reiss, J.D.: An analysis and evaluation of audio features for multitrack music mixtures. In: International Symposium on Music Information Retrieval (ISMIR) (2014)
5.
go back to reference Cano, P., Batlle, E., Kalker, T., Haitsma, J.: A review of audio fingerprinting. J. VLSI Signal Process. Syst. Signal Image Video Technol. 41(3), 271–284 (2005)CrossRef Cano, P., Batlle, E., Kalker, T., Haitsma, J.: A review of audio fingerprinting. J. VLSI Signal Process. Syst. Signal Image Video Technol. 41(3), 271–284 (2005)CrossRef
6.
go back to reference Cliff, D.: Hang the DJ: Automatic sequencing and seamless mixing of dance-music tracks. Technical report, Hewlett-Packard Laboratories (2000). hPL 104 Cliff, D.: Hang the DJ: Automatic sequencing and seamless mixing of dance-music tracks. Technical report, Hewlett-Packard Laboratories (2000). hPL 104
7.
go back to reference De Man, B., Mora-Mcginity, M., Fazekas, G., Reiss, J.D.: The open multitrack testbed. In: Audio Engineering Society Convention 137 (2014) De Man, B., Mora-Mcginity, M., Fazekas, G., Reiss, J.D.: The open multitrack testbed. In: Audio Engineering Society Convention 137 (2014)
8.
go back to reference De Man, B., Reiss, J.D.: Crowd-sourced learning of music production practices through large-scale perceptual evaluation of mixes. Innovation in Music II, p. 144 (2016) De Man, B., Reiss, J.D.: Crowd-sourced learning of music production practices through large-scale perceptual evaluation of mixes. Innovation in Music II, p. 144 (2016)
9.
go back to reference Fourer, D., Peeters, G.: Objective characterization of audio signal quality: application to music collection description. In: Proceedings of the IEEE ICASSP, pp. 711–715, March 2017 Fourer, D., Peeters, G.: Objective characterization of audio signal quality: application to music collection description. In: Proceedings of the IEEE ICASSP, pp. 711–715, March 2017
10.
go back to reference Fujio, T., Shiizuka, H.: A system of mixing songs for automatic DJ performance using genetic programming. In: 6th Asian Design International Conference, October 2003 Fujio, T., Shiizuka, H.: A system of mixing songs for automatic DJ performance using genetic programming. In: 6th Asian Design International Conference, October 2003
11.
go back to reference Glazyrin, N.: Towards automatic content-based separation of DJ mixes into single tracks. In: International Symposium on Music Information Retrieval (ISMIR), pp. 149–154, October 2014 Glazyrin, N.: Towards automatic content-based separation of DJ mixes into single tracks. In: International Symposium on Music Information Retrieval (ISMIR), pp. 149–154, October 2014
12.
go back to reference Gorlow, S., Reiss, J.D.: Model-based inversion of dynamic range compression. IEEE Trans. Audio Speech Lang. Process. 21(7), 1434–1444 (2013)CrossRef Gorlow, S., Reiss, J.D.: Model-based inversion of dynamic range compression. IEEE Trans. Audio Speech Lang. Process. 21(7), 1434–1444 (2013)CrossRef
13.
go back to reference Ishizaki, H., Hoashi, K., Takishima, Y.: Full-automatic DJ mixing system with optimal tempo adjustment based on measurement function of user discomfort. In: International Symposium on Music Information Retrieval (ISMIR), pp. 135–140 (2009) Ishizaki, H., Hoashi, K., Takishima, Y.: Full-automatic DJ mixing system with optimal tempo adjustment based on measurement function of user discomfort. In: International Symposium on Music Information Retrieval (ISMIR), pp. 135–140 (2009)
14.
go back to reference Kell, T., Tzanetakis, G.: Empirical analysis of track selection and ordering in electronic dance music using audio feature extraction. In: International Symposium on Music Information Retrieval (ISMIR), pp. 505–510 (2013) Kell, T., Tzanetakis, G.: Empirical analysis of track selection and ordering in electronic dance music using audio feature extraction. In: International Symposium on Music Information Retrieval (ISMIR), pp. 505–510 (2013)
15.
go back to reference Kim, A., Park, S., Park, J., Ha, J.W., Kwon, T., Nam, J.: Automatic DJ mix generation using highlight detection. In: Late-breaking Session of the International Symposium on Music Information Retrieval (ISMIR), Suzhou, China, October 2017 Kim, A., Park, S., Park, J., Ha, J.W., Kwon, T., Nam, J.: Automatic DJ mix generation using highlight detection. In: Late-breaking Session of the International Symposium on Music Information Retrieval (ISMIR), Suzhou, China, October 2017
16.
go back to reference Lerch, A.: An Introduction to Audio Content Analysis: Applications in Signal Processing and Music Informatics. Wiley-IEEE Press (2012) Lerch, A.: An Introduction to Audio Content Analysis: Applications in Signal Processing and Music Informatics. Wiley-IEEE Press (2012)
17.
go back to reference López-Serrano, P., Dittmar, C., Driedger, J., Müller, M.: Towards modeling and decomposing loop-based electronic music. In: International Symposium on Music Information Retrieval (ISMIR), pp. 502–508 (2016) López-Serrano, P., Dittmar, C., Driedger, J., Müller, M.: Towards modeling and decomposing loop-based electronic music. In: International Symposium on Music Information Retrieval (ISMIR), pp. 502–508 (2016)
18.
go back to reference Maddams, J.A., Finn, S., Reiss, J.D.: An autonomous method for multi-track dynamic range compression. In: Proceedings of the Digital Audio Effects (DAFx) (2012) Maddams, J.A., Finn, S., Reiss, J.D.: An autonomous method for multi-track dynamic range compression. In: Proceedings of the Digital Audio Effects (DAFx) (2012)
19.
go back to reference Mansbridge, S., Finn, S., Reiss, J.D.: An autonomous system for multitrack stereo pan positioning. In: Audio Engineering Society Convention (2012) Mansbridge, S., Finn, S., Reiss, J.D.: An autonomous system for multitrack stereo pan positioning. In: Audio Engineering Society Convention (2012)
20.
go back to reference Molina, P., Haro, M., Jordá, S.: Beatjockey: a new tool for enhancing DJ skills. In: New Interfaces for Musical Expression (NIME), pp. 288–291. Citeseer (2011) Molina, P., Haro, M., Jordá, S.: Beatjockey: a new tool for enhancing DJ skills. In: New Interfaces for Musical Expression (NIME), pp. 288–291. Citeseer (2011)
22.
go back to reference Perez-Gonzalez, E., Reiss, J.: Automatic gain and fader control for live mixing. In: Proceedings of the IEEE WASPAA, pp. 1–4, October 2009 Perez-Gonzalez, E., Reiss, J.: Automatic gain and fader control for live mixing. In: Proceedings of the IEEE WASPAA, pp. 1–4, October 2009
23.
go back to reference Ramona, M., Richard, G.: A simple and efficient fader estimator for broadcast radio unmixing. In: Proceedings of the Digital Audio Effects (DAFx), pp. 265–268, September 2011 Ramona, M., Richard, G.: A simple and efficient fader estimator for broadcast radio unmixing. In: Proceedings of the Digital Audio Effects (DAFx), pp. 265–268, September 2011
24.
go back to reference Rocha, B., Bogaards, N., Honingh, A.: Segmentation and timbre similarity in electronic dance music. In: Sound and Music Computing (SMC), pp. 754–761 (2013) Rocha, B., Bogaards, N., Honingh, A.: Segmentation and timbre similarity in electronic dance music. In: Sound and Music Computing (SMC), pp. 754–761 (2013)
25.
go back to reference Scarfe, T., Koolen, W., Kalnishkan, Y.: Segmentation of electronic dance music. Int. J. Eng. Intell. Syst. Electr. Eng. Commun. 22(3), 4 (2014) Scarfe, T., Koolen, W., Kalnishkan, Y.: Segmentation of electronic dance music. Int. J. Eng. Intell. Syst. Electr. Eng. Commun. 22(3), 4 (2014)
29.
go back to reference Silva, D.F., Batista, G.E.D.A.P.A., Keogh, E., et al.: On the effect of endpoints on dynamic time warping. In: SIGKDD Workshop on Mining and Learning from Time Series, II. Association for Computing Machinery-ACM (2016) Silva, D.F., Batista, G.E.D.A.P.A., Keogh, E., et al.: On the effect of endpoints on dynamic time warping. In: SIGKDD Workshop on Mining and Learning from Time Series, II. Association for Computing Machinery-ACM (2016)
30.
go back to reference Sonnleitner, R., Arzt, A., Widmer, G.: Landmark-based audio fingerprinting for DJ mix monitoring. In: International Symposium on Music Information Retrieval (ISMIR), New York, NY (2016) Sonnleitner, R., Arzt, A., Widmer, G.: Landmark-based audio fingerprinting for DJ mix monitoring. In: International Symposium on Music Information Retrieval (ISMIR), New York, NY (2016)
31.
go back to reference Turetsky, R.J., Ellis, D.P.: Ground-truth transcriptions of real music from force-aligned midi syntheses. In: International Symposium on Music Information Retrieval (ISMIR), October 2003 Turetsky, R.J., Ellis, D.P.: Ground-truth transcriptions of real music from force-aligned midi syntheses. In: International Symposium on Music Information Retrieval (ISMIR), October 2003
32.
go back to reference Werthen-Brabants, L.: Ground Truth Extraction & Transition Analysis of DJ Mixes. Master’s thesis, Ghent University, Belgium (2018) Werthen-Brabants, L.: Ground Truth Extraction & Transition Analysis of DJ Mixes. Master’s thesis, Ghent University, Belgium (2018)
33.
go back to reference Yadati, K., Larson, M., Liem, C.C.S., Hanjalic, A.: Detecting drops in electronic dance music: content-based approaches to a socially significant music event. In: International Symposium on Music Information Retrieval (ISMIR) (2014) Yadati, K., Larson, M., Liem, C.C.S., Hanjalic, A.: Detecting drops in electronic dance music: content-based approaches to a socially significant music event. In: International Symposium on Music Information Retrieval (ISMIR) (2014)
Metadata
Title
Methods and Datasets for DJ-Mix Reverse Engineering
Authors
Diemo Schwarz
Dominique Fourer
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-70210-6_2