Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Automatic Recognition of Sound Categories from Their Vocal Imitation Using Audio Primitives Automatically Found by SI-PLCA and HMM Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Sonifying Twitter’s Emotions Through Music

Authors : Mariana Seiça, Rui (Buga) Lopes, Pedro Martins, F. Amílcar Cardoso

Published in: Music Technology with Swing

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Sonification is a scientific field that seeks to explore the potential of sound as an instrument to convey and interpret data. Its techniques have been developing significantly with the growth of technology and supporting hardware and software, which have spread in our daily environment. This allowed the establishment of new communication tools to share information, opinion and feelings as part of our daily routine.
The aim of this project was to unite the social media phenomena with sonification, using Twitter data to extract user’s emotions and translate them into musical compositions. The focus was to explore the potential of music in translating data as personal and subjective as human emotions, developing a musically complex and captivating mapping based on the rules of Western Music. The music is accompanied by a simple visualization, which results in emotions being heard and seen with the corresponding tweets, in a multimodal experience that represents Twitter’s emotional reality. The mapping was tested through an online survey, and despite a few misunderstandings, the results were generally positive, expressing the efficiency and impact of the developed system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction
next chapter Reflections on the Use of Musical Software in Compositional Processes for Light Art
Literature
1.
Aldwell, E., Schachter, C.: Harmony & Voice Leading. Thomson-Schirmer, Belmont (2003)
2.
3.
Coelho, A., Martins, P., Cardoso, A.: A Portuguese Epopee seen through sound. In: 5th Conference on Computation, Communication, Aesthetics & X (2017)
4.
5.
Gabrielsson, A., Lindström, E.: The role of structure in the musical expression of emotions. In: Juslin, P.N., Sloboda, J. (eds.) Handbook of Music and Emotion: Theory, Research, Applications. Oxford University Press, New York (2010)CrossRef
6.
Han, B., Cook, P., Baldwin, T.: Automatically constructing a normalisation dictionary for microblogs. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jeju Island, Korea (2012)
7.
8.
Hermann, T., Hunt, A., Neuhoff, J.G.: The Sonification Handbook. Logos Verlag, Berlin (2011)
9.
Hermann, T., Nehls, A.V., Eitel, F., Barri, T., Gammenl, M.: Tweetscapes - Real-time sonification of Twitter data stream for radio broadcasting. In: Proceedings of the 18th International Conference on Auditory Display, Atlanta, GA, USA (2012)
10.
Hevner, K.: Experimental studies of the elements of expression in music. Am. J. Psychol. 48(2), 246–268 (1936)CrossRef
11.
Juslin, P., Västfjäll, D.: Emotional responses to music: the need to consider underlying mechanisms. Behav. Brain Sci. 31, 559–621 (2008)CrossRef
12.
13.
Ligon, B.: Jazz Theory Resources: Tonal, Harmonic, Melodic and Rhythmic Organization of Jazz. Houston Publishing (2003)
14.
Liu, F., Weng, F., Jiang, X.: A broad-coverage normalization system for social media language. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pp. 1035–1044 (2012)
15.
Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D.: The Stanford CoreNLP natural language processing toolkit. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014)
16.
Miller, G.M.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)CrossRef
17.
Mohammad, S.M., Kiritchenjko, S.: Using hashtags to capture fine emotion categories from tweets. Comput. Intell. 31(2), 301–326 (2013)MathSciNetCrossRef
18.
Morreale, F., Miniukovich, A., De Angeli, A.: TwitterRadio: Translating Tweets into Music. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada (2014)
19.
Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)CrossRef
20.
21.
Quinn, M.: Research set to music: the climate symphony and other sonifications of ice core, radar, DNA, seismic and solar wind data. In: Proceedings of the International Conference on Auditory Display, Espoo, Finland (2001)
22.
Reynolds, C.W.: Flocks, herds and schools: a distributed behavioral model. In: Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pp. 25–34 (1987)
23.
Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychology. 39(6), 1161–1178 (1980)CrossRef
24.
Song, Y., Dixon, S., Pearce, M.T., Halpern, A.R.: Perceived and induced emotion responses to popular music: categorical and dimensional models. Music. Percept.: Interdiscip. J. 33(4), 472–492 (2016)CrossRef
25.
26.
Waite, B.: Modern jazz piano: a study in harmony and improvisation. Wise-Publications (Book Sales Limited) (1987)
27.
28.
Winters, R.M., Hattwick, I., Wanderley, M.M.: Emotional data in music performance: two environments for the emotional imaging composer. In: Proceedings of the 3rd International Conference of Music & Emotion (ICM3), Jyväskylä, Finalnd (2013)
Metadata
Title
Sonifying Twitter’s Emotions Through Music
Authors
Mariana Seiça
Rui (Buga) Lopes
Pedro Martins
F. Amílcar Cardoso
Copyright Year
2018
Book
Music Technology with Swing

Print ISBN: 978-3-030-01691-3

Electronic ISBN: 978-3-030-01692-0

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-030-01692-0_39