Skip to main content
Erschienen in: The Journal of Supercomputing 6/2019

31.07.2018

Are you emotional or depressed? Learning about your emotional state from your music using machine learning

verfasst von: Sharaj Panwar, Paul Rad, Kim-Kwang Raymond Choo, Mehdi Roopaei

Erschienen in: The Journal of Supercomputing | Ausgabe 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Music plays an important role in our society and has applications broader than just entertainment and pleasure due to its social and physiological effects. There has been recent interest in music, and two active research topics are music information retrieval and music emotion recognition, where data mining and machine learning techniques are integrated with music features and annotations to extract music information such as genres, instrument and its emotional content. In this paper, a machine learning music perception model is proposed to identify emotional content of a given audio stream and study the emotional effects of music. In fact, our developed model has the capability to determine the emotional state of a region (e.g., city) that could be utilized in applications such as marketing, and many other facets of the society such as cognitive development, education, therapy and security. This emotion recognition task is performed by mapping musical acoustic features to corresponding arousal and valence emotion indexes using a linear regression model. A radio-induced emotion dataset (RIED) is compiled from the songs broadcasted on radio in four US major cities (i.e., Houston, New York, Los Angeles and Miami) between October 21, 2017, and November 21, 2017. The RIED is then used as input to the proposed perception model to observe the regional music emotion propensity.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hardy D (1998) Creativity: flow and the psychology of discovery and invention. Pers Psychol 51(3):794MathSciNet Hardy D (1998) Creativity: flow and the psychology of discovery and invention. Pers Psychol 51(3):794MathSciNet
2.
Zurück zum Zitat Cooke D (1990) The language of music. Clarendon Press. https://global.oup.com/academic/product/the-language-of-music-9780198161806?cc=us&lang=en&# Cooke D (1990) The language of music. Clarendon Press. https://​global.​oup.​com/​academic/​product/​the-language-of-music-9780198161806?​cc=​us&​lang=​en&​#
3.
Zurück zum Zitat North AC, Hargreaves DJ (2008) The social and applied psychology of music. Oxford University Press, OxfordCrossRef North AC, Hargreaves DJ (2008) The social and applied psychology of music. Oxford University Press, OxfordCrossRef
4.
Zurück zum Zitat Schlaug G, Norton A, Overy K, Winner E (2005) Effects of music training on the child’s brain and cognitive development. Ann N Y Acad Sci 1060(1):219–230CrossRef Schlaug G, Norton A, Overy K, Winner E (2005) Effects of music training on the child’s brain and cognitive development. Ann N Y Acad Sci 1060(1):219–230CrossRef
5.
Zurück zum Zitat Isern B (1964) Music in special education. J Music Ther 1(4):139–142CrossRef Isern B (1964) Music in special education. J Music Ther 1(4):139–142CrossRef
6.
Zurück zum Zitat Bailey LM (1984) The use of songs in music therapy with cancer patients and their families. Music Ther J AAMT 3(1):5–17CrossRef Bailey LM (1984) The use of songs in music therapy with cancer patients and their families. Music Ther J AAMT 3(1):5–17CrossRef
7.
Zurück zum Zitat Parra F, Miljkovitch R, Persiaux G, Morales M, Scherer S (2017) The multimodal assessment of adult attachment security: developing the biometric attachment test. J Med Internet Res 19(4):e100CrossRef Parra F, Miljkovitch R, Persiaux G, Morales M, Scherer S (2017) The multimodal assessment of adult attachment security: developing the biometric attachment test. J Med Internet Res 19(4):e100CrossRef
8.
Zurück zum Zitat Liu Y, Liu Y, Zhao Y, Hua KA (2015) What strikes the strings of your heart?—feature mining for music emotion analysis. IEEE Trans Affect Comput 6(3):247–260CrossRef Liu Y, Liu Y, Zhao Y, Hua KA (2015) What strikes the strings of your heart?—feature mining for music emotion analysis. IEEE Trans Affect Comput 6(3):247–260CrossRef
9.
Zurück zum Zitat McKeganey SPN (2000) The rise and rise of peer education approaches. Drugs Educ Prev Policy 7(3):293–310CrossRef McKeganey SPN (2000) The rise and rise of peer education approaches. Drugs Educ Prev Policy 7(3):293–310CrossRef
10.
Zurück zum Zitat Leming JS (1987) Rock music and the socialization of moral values in early adolescence. Youth Soc 18(4):363–383CrossRef Leming JS (1987) Rock music and the socialization of moral values in early adolescence. Youth Soc 18(4):363–383CrossRef
11.
Zurück zum Zitat Bennett A (2000) Popular music and youth culture: music, identity and place. Macmillan Press Ltd, Houndmills, Basingstoke Bennett A (2000) Popular music and youth culture: music, identity and place. Macmillan Press Ltd, Houndmills, Basingstoke
12.
Zurück zum Zitat Wurtzler S, Campbell BB, Huntemann N, Breiner LA (2003) Communities of the air: radio century, radio culture. Duke University Press, Durham Wurtzler S, Campbell BB, Huntemann N, Breiner LA (2003) Communities of the air: radio century, radio culture. Duke University Press, Durham
13.
Zurück zum Zitat Kusek D, Leonhard G (2005) The future of music: manifesto for the digital music revolution. Omnibus Press, London Kusek D, Leonhard G (2005) The future of music: manifesto for the digital music revolution. Omnibus Press, London
14.
Zurück zum Zitat Downie JS (2005) Music information retrieval. Annu Rev Inf Sci Technol 37(1):295–340CrossRef Downie JS (2005) Music information retrieval. Annu Rev Inf Sci Technol 37(1):295–340CrossRef
16.
Zurück zum Zitat Panwar S, Das A, Roopaei M, Rad P (2017) A deep learning approach for mapping music genres. In: System of Systems Engineering Conference (SoSE), 2017 12th. IEEE Panwar S, Das A, Roopaei M, Rad P (2017) A deep learning approach for mapping music genres. In: System of Systems Engineering Conference (SoSE), 2017 12th. IEEE
17.
Zurück zum Zitat Baumgartner H (1992) Remembrance of things past: music, autobiographical memory, and emotion. Adv Consum Res 19:613–620 Baumgartner H (1992) Remembrance of things past: music, autobiographical memory, and emotion. Adv Consum Res 19:613–620
18.
Zurück zum Zitat Carlson E, Saarikallio A, Toiviainen P, Bogert B, Kliuchko M, Brattico E (2015) Maladaptive and adaptive emotion regulation through music: a behavioral and neuroimaging study of males and females. Front Hum Neurosci 9:466CrossRef Carlson E, Saarikallio A, Toiviainen P, Bogert B, Kliuchko M, Brattico E (2015) Maladaptive and adaptive emotion regulation through music: a behavioral and neuroimaging study of males and females. Front Hum Neurosci 9:466CrossRef
19.
Zurück zum Zitat Maratos A, Crawford MJ, Procter S (2011) Music therapy for depression: it seems to work, but how? Br J Psychiatry 199(2):92–93CrossRef Maratos A, Crawford MJ, Procter S (2011) Music therapy for depression: it seems to work, but how? Br J Psychiatry 199(2):92–93CrossRef
20.
Zurück zum Zitat Reynolds G, Barry D, Burke T, Coyle E (2007) Towards a personal automatic music playlist generation algorithm: the need for contextual information. In: Proceedings of the 2nd Audio Mostly Conference: interaction with sound, Fraunhofer Institute for Digital Media Technology, Limenau, Germany, pp 84–89 Reynolds G, Barry D, Burke T, Coyle E (2007) Towards a personal automatic music playlist generation algorithm: the need for contextual information. In: Proceedings of the 2nd Audio Mostly Conference: interaction with sound, Fraunhofer Institute for Digital Media Technology, Limenau, Germany, pp 84–89
21.
Zurück zum Zitat Masahiro N, Takaesu H, Demachi H, Oono M, Saito H (2008) Development of an automatic music selection system based on runner’s step frequency. In: Proceedings of ISMIR Conference Masahiro N, Takaesu H, Demachi H, Oono M, Saito H (2008) Development of an automatic music selection system based on runner’s step frequency. In: Proceedings of ISMIR Conference
22.
Zurück zum Zitat Hargreaves DJ, North AC (1999) The functions of music in everyday life: redefining the social in music psychology. Psychol Music 27(1):71–83CrossRef Hargreaves DJ, North AC (1999) The functions of music in everyday life: redefining the social in music psychology. Psychol Music 27(1):71–83CrossRef
23.
Zurück zum Zitat Stige B (2002) Culture-centered music therapy. In: The Oxford Handbook of Music Therapy Stige B (2002) Culture-centered music therapy. In: The Oxford Handbook of Music Therapy
24.
Zurück zum Zitat Napiorkowski S (2015) Music mood recognition: state of the art review. MUS-15 July 10 Napiorkowski S (2015) Music mood recognition: state of the art review. MUS-15 July 10
26.
Zurück zum Zitat Laurier C et al (2007) Audio music mood classification using support vector machine. MIREX task on Audio Mood Classification, pp 2–4 Laurier C et al (2007) Audio music mood classification using support vector machine. MIREX task on Audio Mood Classification, pp 2–4
27.
Zurück zum Zitat Thayer RE (1990) The biopsychology of mood and arousal. Oxford University Press, Oxford Thayer RE (1990) The biopsychology of mood and arousal. Oxford University Press, Oxford
28.
Zurück zum Zitat Grachten M, Schedl M, Pohle T, Widmer G (2009) The ISMIR Cloud: A Decade of ISMIR Conferences at Your Fingertips. ISMIR Grachten M, Schedl M, Pohle T, Widmer G (2009) The ISMIR Cloud: A Decade of ISMIR Conferences at Your Fingertips. ISMIR
29.
Zurück zum Zitat Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef
30.
Zurück zum Zitat Panwar S (2017) Emotional effects of music using machine learning analytics. Diss. The University of Texas at San Antonio Panwar S (2017) Emotional effects of music using machine learning analytics. Diss. The University of Texas at San Antonio
31.
Zurück zum Zitat Alajanki A, Yang Y-H, Soleymani M (2017) Developing a benchmark for emotional analysis of music. PLoS ONE 12(3):e0173392CrossRef Alajanki A, Yang Y-H, Soleymani M (2017) Developing a benchmark for emotional analysis of music. PLoS ONE 12(3):e0173392CrossRef
32.
Zurück zum Zitat Sanden C, Zhang JZ (2011) An empirical study of multi-label classifiers for music tag annotation. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011, pp 717–722 Sanden C, Zhang JZ (2011) An empirical study of multi-label classifiers for music tag annotation. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011, pp 717–722
33.
Zurück zum Zitat Eyben F, Salomão GL, Sundberg J, Scherer KR (2015) Schuller BW (2015) Emotion in the singing voice—a deeper look at acoustic features in the light of automatic classification. EURASIP J Audio Speech Music Process 1:19CrossRef Eyben F, Salomão GL, Sundberg J, Scherer KR (2015) Schuller BW (2015) Emotion in the singing voice—a deeper look at acoustic features in the light of automatic classification. EURASIP J Audio Speech Music Process 1:19CrossRef
34.
Zurück zum Zitat Misron MM, Rosli N, Manaf NA, Hali HA (2014) Music emotion classification (mec): exploiting vocal and instrumental sound features. In: Recent advances on soft computing and data mining. Springer, Cham, pp 539–549 Misron MM, Rosli N, Manaf NA, Hali HA (2014) Music emotion classification (mec): exploiting vocal and instrumental sound features. In: Recent advances on soft computing and data mining. Springer, Cham, pp 539–549
35.
Zurück zum Zitat Logan B (2000) Mel frequency cepstral coefficients for music modeling. ISMIR, vol 270 Logan B (2000) Mel frequency cepstral coefficients for music modeling. ISMIR, vol 270
36.
Zurück zum Zitat Schmidt EM., Turnbull D, Kim YE (2010) Feature selection for content-based, time-varying musical emotion regression. In: Proceedings of the International Conference on Multimedia Information Retrieval. ACM Schmidt EM., Turnbull D, Kim YE (2010) Feature selection for content-based, time-varying musical emotion regression. In: Proceedings of the International Conference on Multimedia Information Retrieval. ACM
37.
Zurück zum Zitat Stewart CA, Cockerill TM, Foster I, Hancock D, Merchant N, Skidmore E, Stanzione D, Taylor J, Tuecke S, Turner G, Vaughn M, Gaffney NI (2015) Jetstream: a self-provisioned, scalable science and engineering cloud environment. In: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure, XSEDE '15, Article No. 29 Stewart CA, Cockerill TM, Foster I, Hancock D, Merchant N, Skidmore E, Stanzione D, Taylor J, Tuecke S, Turner G, Vaughn M, Gaffney NI (2015) Jetstream: a self-provisioned, scalable science and engineering cloud environment. In: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure, XSEDE '15, Article No. 29
38.
Zurück zum Zitat Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Research 12:2825–2830MathSciNetMATH Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Research 12:2825–2830MathSciNetMATH
Metadaten
Titel
Are you emotional or depressed? Learning about your emotional state from your music using machine learning
verfasst von
Sharaj Panwar
Paul Rad
Kim-Kwang Raymond Choo
Mehdi Roopaei
Publikationsdatum
31.07.2018
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 6/2019
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-018-2499-y

Weitere Artikel der Ausgabe 6/2019

The Journal of Supercomputing 6/2019 Zur Ausgabe

Premium Partner