Skip to main content
Top
Published in: The Journal of Supercomputing 6/2019

31-07-2018

Are you emotional or depressed? Learning about your emotional state from your music using machine learning

Authors: Sharaj Panwar, Paul Rad, Kim-Kwang Raymond Choo, Mehdi Roopaei

Published in: The Journal of Supercomputing | Issue 6/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Music plays an important role in our society and has applications broader than just entertainment and pleasure due to its social and physiological effects. There has been recent interest in music, and two active research topics are music information retrieval and music emotion recognition, where data mining and machine learning techniques are integrated with music features and annotations to extract music information such as genres, instrument and its emotional content. In this paper, a machine learning music perception model is proposed to identify emotional content of a given audio stream and study the emotional effects of music. In fact, our developed model has the capability to determine the emotional state of a region (e.g., city) that could be utilized in applications such as marketing, and many other facets of the society such as cognitive development, education, therapy and security. This emotion recognition task is performed by mapping musical acoustic features to corresponding arousal and valence emotion indexes using a linear regression model. A radio-induced emotion dataset (RIED) is compiled from the songs broadcasted on radio in four US major cities (i.e., Houston, New York, Los Angeles and Miami) between October 21, 2017, and November 21, 2017. The RIED is then used as input to the proposed perception model to observe the regional music emotion propensity.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hardy D (1998) Creativity: flow and the psychology of discovery and invention. Pers Psychol 51(3):794MathSciNet Hardy D (1998) Creativity: flow and the psychology of discovery and invention. Pers Psychol 51(3):794MathSciNet
2.
go back to reference Cooke D (1990) The language of music. Clarendon Press. https://global.oup.com/academic/product/the-language-of-music-9780198161806?cc=us&lang=en&# Cooke D (1990) The language of music. Clarendon Press. https://​global.​oup.​com/​academic/​product/​the-language-of-music-9780198161806?​cc=​us&​lang=​en&​#
3.
go back to reference North AC, Hargreaves DJ (2008) The social and applied psychology of music. Oxford University Press, OxfordCrossRef North AC, Hargreaves DJ (2008) The social and applied psychology of music. Oxford University Press, OxfordCrossRef
4.
go back to reference Schlaug G, Norton A, Overy K, Winner E (2005) Effects of music training on the child’s brain and cognitive development. Ann N Y Acad Sci 1060(1):219–230CrossRef Schlaug G, Norton A, Overy K, Winner E (2005) Effects of music training on the child’s brain and cognitive development. Ann N Y Acad Sci 1060(1):219–230CrossRef
5.
6.
go back to reference Bailey LM (1984) The use of songs in music therapy with cancer patients and their families. Music Ther J AAMT 3(1):5–17CrossRef Bailey LM (1984) The use of songs in music therapy with cancer patients and their families. Music Ther J AAMT 3(1):5–17CrossRef
7.
go back to reference Parra F, Miljkovitch R, Persiaux G, Morales M, Scherer S (2017) The multimodal assessment of adult attachment security: developing the biometric attachment test. J Med Internet Res 19(4):e100CrossRef Parra F, Miljkovitch R, Persiaux G, Morales M, Scherer S (2017) The multimodal assessment of adult attachment security: developing the biometric attachment test. J Med Internet Res 19(4):e100CrossRef
8.
go back to reference Liu Y, Liu Y, Zhao Y, Hua KA (2015) What strikes the strings of your heart?—feature mining for music emotion analysis. IEEE Trans Affect Comput 6(3):247–260CrossRef Liu Y, Liu Y, Zhao Y, Hua KA (2015) What strikes the strings of your heart?—feature mining for music emotion analysis. IEEE Trans Affect Comput 6(3):247–260CrossRef
9.
go back to reference McKeganey SPN (2000) The rise and rise of peer education approaches. Drugs Educ Prev Policy 7(3):293–310CrossRef McKeganey SPN (2000) The rise and rise of peer education approaches. Drugs Educ Prev Policy 7(3):293–310CrossRef
10.
go back to reference Leming JS (1987) Rock music and the socialization of moral values in early adolescence. Youth Soc 18(4):363–383CrossRef Leming JS (1987) Rock music and the socialization of moral values in early adolescence. Youth Soc 18(4):363–383CrossRef
11.
go back to reference Bennett A (2000) Popular music and youth culture: music, identity and place. Macmillan Press Ltd, Houndmills, Basingstoke Bennett A (2000) Popular music and youth culture: music, identity and place. Macmillan Press Ltd, Houndmills, Basingstoke
12.
go back to reference Wurtzler S, Campbell BB, Huntemann N, Breiner LA (2003) Communities of the air: radio century, radio culture. Duke University Press, Durham Wurtzler S, Campbell BB, Huntemann N, Breiner LA (2003) Communities of the air: radio century, radio culture. Duke University Press, Durham
13.
go back to reference Kusek D, Leonhard G (2005) The future of music: manifesto for the digital music revolution. Omnibus Press, London Kusek D, Leonhard G (2005) The future of music: manifesto for the digital music revolution. Omnibus Press, London
14.
go back to reference Downie JS (2005) Music information retrieval. Annu Rev Inf Sci Technol 37(1):295–340CrossRef Downie JS (2005) Music information retrieval. Annu Rev Inf Sci Technol 37(1):295–340CrossRef
16.
go back to reference Panwar S, Das A, Roopaei M, Rad P (2017) A deep learning approach for mapping music genres. In: System of Systems Engineering Conference (SoSE), 2017 12th. IEEE Panwar S, Das A, Roopaei M, Rad P (2017) A deep learning approach for mapping music genres. In: System of Systems Engineering Conference (SoSE), 2017 12th. IEEE
17.
go back to reference Baumgartner H (1992) Remembrance of things past: music, autobiographical memory, and emotion. Adv Consum Res 19:613–620 Baumgartner H (1992) Remembrance of things past: music, autobiographical memory, and emotion. Adv Consum Res 19:613–620
18.
go back to reference Carlson E, Saarikallio A, Toiviainen P, Bogert B, Kliuchko M, Brattico E (2015) Maladaptive and adaptive emotion regulation through music: a behavioral and neuroimaging study of males and females. Front Hum Neurosci 9:466CrossRef Carlson E, Saarikallio A, Toiviainen P, Bogert B, Kliuchko M, Brattico E (2015) Maladaptive and adaptive emotion regulation through music: a behavioral and neuroimaging study of males and females. Front Hum Neurosci 9:466CrossRef
19.
go back to reference Maratos A, Crawford MJ, Procter S (2011) Music therapy for depression: it seems to work, but how? Br J Psychiatry 199(2):92–93CrossRef Maratos A, Crawford MJ, Procter S (2011) Music therapy for depression: it seems to work, but how? Br J Psychiatry 199(2):92–93CrossRef
20.
go back to reference Reynolds G, Barry D, Burke T, Coyle E (2007) Towards a personal automatic music playlist generation algorithm: the need for contextual information. In: Proceedings of the 2nd Audio Mostly Conference: interaction with sound, Fraunhofer Institute for Digital Media Technology, Limenau, Germany, pp 84–89 Reynolds G, Barry D, Burke T, Coyle E (2007) Towards a personal automatic music playlist generation algorithm: the need for contextual information. In: Proceedings of the 2nd Audio Mostly Conference: interaction with sound, Fraunhofer Institute for Digital Media Technology, Limenau, Germany, pp 84–89
21.
go back to reference Masahiro N, Takaesu H, Demachi H, Oono M, Saito H (2008) Development of an automatic music selection system based on runner’s step frequency. In: Proceedings of ISMIR Conference Masahiro N, Takaesu H, Demachi H, Oono M, Saito H (2008) Development of an automatic music selection system based on runner’s step frequency. In: Proceedings of ISMIR Conference
22.
go back to reference Hargreaves DJ, North AC (1999) The functions of music in everyday life: redefining the social in music psychology. Psychol Music 27(1):71–83CrossRef Hargreaves DJ, North AC (1999) The functions of music in everyday life: redefining the social in music psychology. Psychol Music 27(1):71–83CrossRef
23.
go back to reference Stige B (2002) Culture-centered music therapy. In: The Oxford Handbook of Music Therapy Stige B (2002) Culture-centered music therapy. In: The Oxford Handbook of Music Therapy
24.
go back to reference Napiorkowski S (2015) Music mood recognition: state of the art review. MUS-15 July 10 Napiorkowski S (2015) Music mood recognition: state of the art review. MUS-15 July 10
26.
go back to reference Laurier C et al (2007) Audio music mood classification using support vector machine. MIREX task on Audio Mood Classification, pp 2–4 Laurier C et al (2007) Audio music mood classification using support vector machine. MIREX task on Audio Mood Classification, pp 2–4
27.
go back to reference Thayer RE (1990) The biopsychology of mood and arousal. Oxford University Press, Oxford Thayer RE (1990) The biopsychology of mood and arousal. Oxford University Press, Oxford
28.
go back to reference Grachten M, Schedl M, Pohle T, Widmer G (2009) The ISMIR Cloud: A Decade of ISMIR Conferences at Your Fingertips. ISMIR Grachten M, Schedl M, Pohle T, Widmer G (2009) The ISMIR Cloud: A Decade of ISMIR Conferences at Your Fingertips. ISMIR
29.
go back to reference Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef
30.
go back to reference Panwar S (2017) Emotional effects of music using machine learning analytics. Diss. The University of Texas at San Antonio Panwar S (2017) Emotional effects of music using machine learning analytics. Diss. The University of Texas at San Antonio
31.
go back to reference Alajanki A, Yang Y-H, Soleymani M (2017) Developing a benchmark for emotional analysis of music. PLoS ONE 12(3):e0173392CrossRef Alajanki A, Yang Y-H, Soleymani M (2017) Developing a benchmark for emotional analysis of music. PLoS ONE 12(3):e0173392CrossRef
32.
go back to reference Sanden C, Zhang JZ (2011) An empirical study of multi-label classifiers for music tag annotation. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011, pp 717–722 Sanden C, Zhang JZ (2011) An empirical study of multi-label classifiers for music tag annotation. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011, pp 717–722
33.
go back to reference Eyben F, Salomão GL, Sundberg J, Scherer KR (2015) Schuller BW (2015) Emotion in the singing voice—a deeper look at acoustic features in the light of automatic classification. EURASIP J Audio Speech Music Process 1:19CrossRef Eyben F, Salomão GL, Sundberg J, Scherer KR (2015) Schuller BW (2015) Emotion in the singing voice—a deeper look at acoustic features in the light of automatic classification. EURASIP J Audio Speech Music Process 1:19CrossRef
34.
go back to reference Misron MM, Rosli N, Manaf NA, Hali HA (2014) Music emotion classification (mec): exploiting vocal and instrumental sound features. In: Recent advances on soft computing and data mining. Springer, Cham, pp 539–549 Misron MM, Rosli N, Manaf NA, Hali HA (2014) Music emotion classification (mec): exploiting vocal and instrumental sound features. In: Recent advances on soft computing and data mining. Springer, Cham, pp 539–549
35.
go back to reference Logan B (2000) Mel frequency cepstral coefficients for music modeling. ISMIR, vol 270 Logan B (2000) Mel frequency cepstral coefficients for music modeling. ISMIR, vol 270
36.
go back to reference Schmidt EM., Turnbull D, Kim YE (2010) Feature selection for content-based, time-varying musical emotion regression. In: Proceedings of the International Conference on Multimedia Information Retrieval. ACM Schmidt EM., Turnbull D, Kim YE (2010) Feature selection for content-based, time-varying musical emotion regression. In: Proceedings of the International Conference on Multimedia Information Retrieval. ACM
37.
go back to reference Stewart CA, Cockerill TM, Foster I, Hancock D, Merchant N, Skidmore E, Stanzione D, Taylor J, Tuecke S, Turner G, Vaughn M, Gaffney NI (2015) Jetstream: a self-provisioned, scalable science and engineering cloud environment. In: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure, XSEDE '15, Article No. 29 Stewart CA, Cockerill TM, Foster I, Hancock D, Merchant N, Skidmore E, Stanzione D, Taylor J, Tuecke S, Turner G, Vaughn M, Gaffney NI (2015) Jetstream: a self-provisioned, scalable science and engineering cloud environment. In: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure, XSEDE '15, Article No. 29
38.
go back to reference Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Research 12:2825–2830MathSciNetMATH Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Research 12:2825–2830MathSciNetMATH
Metadata
Title
Are you emotional or depressed? Learning about your emotional state from your music using machine learning
Authors
Sharaj Panwar
Paul Rad
Kim-Kwang Raymond Choo
Mehdi Roopaei
Publication date
31-07-2018
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 6/2019
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-018-2499-y

Other articles of this Issue 6/2019

The Journal of Supercomputing 6/2019 Go to the issue

Premium Partner