Skip to main content

2018 | OriginalPaper | Buchkapitel

Sonifying Twitter’s Emotions Through Music

verfasst von : Mariana Seiça, Rui (Buga) Lopes, Pedro Martins, F. Amílcar Cardoso

Erschienen in: Music Technology with Swing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sonification is a scientific field that seeks to explore the potential of sound as an instrument to convey and interpret data. Its techniques have been developing significantly with the growth of technology and supporting hardware and software, which have spread in our daily environment. This allowed the establishment of new communication tools to share information, opinion and feelings as part of our daily routine.
The aim of this project was to unite the social media phenomena with sonification, using Twitter data to extract user’s emotions and translate them into musical compositions. The focus was to explore the potential of music in translating data as personal and subjective as human emotions, developing a musically complex and captivating mapping based on the rules of Western Music. The music is accompanied by a simple visualization, which results in emotions being heard and seen with the corresponding tweets, in a multimodal experience that represents Twitter’s emotional reality. The mapping was tested through an online survey, and despite a few misunderstandings, the results were generally positive, expressing the efficiency and impact of the developed system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aldwell, E., Schachter, C.: Harmony & Voice Leading. Thomson-Schirmer, Belmont (2003) Aldwell, E., Schachter, C.: Harmony & Voice Leading. Thomson-Schirmer, Belmont (2003)
3.
Zurück zum Zitat Coelho, A., Martins, P., Cardoso, A.: A Portuguese Epopee seen through sound. In: 5th Conference on Computation, Communication, Aesthetics & X (2017) Coelho, A., Martins, P., Cardoso, A.: A Portuguese Epopee seen through sound. In: 5th Conference on Computation, Communication, Aesthetics & X (2017)
5.
Zurück zum Zitat Gabrielsson, A., Lindström, E.: The role of structure in the musical expression of emotions. In: Juslin, P.N., Sloboda, J. (eds.) Handbook of Music and Emotion: Theory, Research, Applications. Oxford University Press, New York (2010)CrossRef Gabrielsson, A., Lindström, E.: The role of structure in the musical expression of emotions. In: Juslin, P.N., Sloboda, J. (eds.) Handbook of Music and Emotion: Theory, Research, Applications. Oxford University Press, New York (2010)CrossRef
6.
Zurück zum Zitat Han, B., Cook, P., Baldwin, T.: Automatically constructing a normalisation dictionary for microblogs. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jeju Island, Korea (2012) Han, B., Cook, P., Baldwin, T.: Automatically constructing a normalisation dictionary for microblogs. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jeju Island, Korea (2012)
8.
Zurück zum Zitat Hermann, T., Hunt, A., Neuhoff, J.G.: The Sonification Handbook. Logos Verlag, Berlin (2011) Hermann, T., Hunt, A., Neuhoff, J.G.: The Sonification Handbook. Logos Verlag, Berlin (2011)
9.
Zurück zum Zitat Hermann, T., Nehls, A.V., Eitel, F., Barri, T., Gammenl, M.: Tweetscapes - Real-time sonification of Twitter data stream for radio broadcasting. In: Proceedings of the 18th International Conference on Auditory Display, Atlanta, GA, USA (2012) Hermann, T., Nehls, A.V., Eitel, F., Barri, T., Gammenl, M.: Tweetscapes - Real-time sonification of Twitter data stream for radio broadcasting. In: Proceedings of the 18th International Conference on Auditory Display, Atlanta, GA, USA (2012)
10.
Zurück zum Zitat Hevner, K.: Experimental studies of the elements of expression in music. Am. J. Psychol. 48(2), 246–268 (1936)CrossRef Hevner, K.: Experimental studies of the elements of expression in music. Am. J. Psychol. 48(2), 246–268 (1936)CrossRef
11.
Zurück zum Zitat Juslin, P., Västfjäll, D.: Emotional responses to music: the need to consider underlying mechanisms. Behav. Brain Sci. 31, 559–621 (2008)CrossRef Juslin, P., Västfjäll, D.: Emotional responses to music: the need to consider underlying mechanisms. Behav. Brain Sci. 31, 559–621 (2008)CrossRef
13.
Zurück zum Zitat Ligon, B.: Jazz Theory Resources: Tonal, Harmonic, Melodic and Rhythmic Organization of Jazz. Houston Publishing (2003) Ligon, B.: Jazz Theory Resources: Tonal, Harmonic, Melodic and Rhythmic Organization of Jazz. Houston Publishing (2003)
14.
Zurück zum Zitat Liu, F., Weng, F., Jiang, X.: A broad-coverage normalization system for social media language. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pp. 1035–1044 (2012) Liu, F., Weng, F., Jiang, X.: A broad-coverage normalization system for social media language. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pp. 1035–1044 (2012)
15.
Zurück zum Zitat Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D.: The Stanford CoreNLP natural language processing toolkit. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014) Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D.: The Stanford CoreNLP natural language processing toolkit. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014)
16.
Zurück zum Zitat Miller, G.M.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)CrossRef Miller, G.M.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)CrossRef
17.
Zurück zum Zitat Mohammad, S.M., Kiritchenjko, S.: Using hashtags to capture fine emotion categories from tweets. Comput. Intell. 31(2), 301–326 (2013)MathSciNetCrossRef Mohammad, S.M., Kiritchenjko, S.: Using hashtags to capture fine emotion categories from tweets. Comput. Intell. 31(2), 301–326 (2013)MathSciNetCrossRef
18.
Zurück zum Zitat Morreale, F., Miniukovich, A., De Angeli, A.: TwitterRadio: Translating Tweets into Music. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada (2014) Morreale, F., Miniukovich, A., De Angeli, A.: TwitterRadio: Translating Tweets into Music. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada (2014)
19.
Zurück zum Zitat Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)CrossRef Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)CrossRef
20.
Zurück zum Zitat Plutchik, R.: The nature of emotions. Am. Scientist. 89, 344–350 (2001)CrossRef Plutchik, R.: The nature of emotions. Am. Scientist. 89, 344–350 (2001)CrossRef
21.
Zurück zum Zitat Quinn, M.: Research set to music: the climate symphony and other sonifications of ice core, radar, DNA, seismic and solar wind data. In: Proceedings of the International Conference on Auditory Display, Espoo, Finland (2001) Quinn, M.: Research set to music: the climate symphony and other sonifications of ice core, radar, DNA, seismic and solar wind data. In: Proceedings of the International Conference on Auditory Display, Espoo, Finland (2001)
22.
Zurück zum Zitat Reynolds, C.W.: Flocks, herds and schools: a distributed behavioral model. In: Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pp. 25–34 (1987) Reynolds, C.W.: Flocks, herds and schools: a distributed behavioral model. In: Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pp. 25–34 (1987)
23.
Zurück zum Zitat Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychology. 39(6), 1161–1178 (1980)CrossRef Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychology. 39(6), 1161–1178 (1980)CrossRef
24.
Zurück zum Zitat Song, Y., Dixon, S., Pearce, M.T., Halpern, A.R.: Perceived and induced emotion responses to popular music: categorical and dimensional models. Music. Percept.: Interdiscip. J. 33(4), 472–492 (2016)CrossRef Song, Y., Dixon, S., Pearce, M.T., Halpern, A.R.: Perceived and induced emotion responses to popular music: categorical and dimensional models. Music. Percept.: Interdiscip. J. 33(4), 472–492 (2016)CrossRef
26.
Zurück zum Zitat Waite, B.: Modern jazz piano: a study in harmony and improvisation. Wise-Publications (Book Sales Limited) (1987) Waite, B.: Modern jazz piano: a study in harmony and improvisation. Wise-Publications (Book Sales Limited) (1987)
28.
Zurück zum Zitat Winters, R.M., Hattwick, I., Wanderley, M.M.: Emotional data in music performance: two environments for the emotional imaging composer. In: Proceedings of the 3rd International Conference of Music & Emotion (ICM3), Jyväskylä, Finalnd (2013) Winters, R.M., Hattwick, I., Wanderley, M.M.: Emotional data in music performance: two environments for the emotional imaging composer. In: Proceedings of the 3rd International Conference of Music & Emotion (ICM3), Jyväskylä, Finalnd (2013)
Metadaten
Titel
Sonifying Twitter’s Emotions Through Music
verfasst von
Mariana Seiça
Rui (Buga) Lopes
Pedro Martins
F. Amílcar Cardoso
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01692-0_39

Neuer Inhalt