Skip to main content
Top
Published in: Social Network Analysis and Mining 1/2019

01-12-2019 | Original Article

Topic modeling and sentiment analysis of global climate change tweets

Authors: Biraj Dahal, Sathish A. P. Kumar, Zhenlong Li

Published in: Social Network Analysis and Mining | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Social media websites can be used as a data source for mining public opinion on a variety of subjects including climate change. Twitter, in particular, allows for the evaluation of public opinion across both time and space because geotagged tweets include timestamps and geographic coordinates (latitude/longitude). In this study, a large dataset of geotagged tweets containing certain keywords relating to climate change is analyzed using volume analysis and text mining techniques such as topic modeling and sentiment analysis. Latent Dirichlet allocation was applied for topic modeling to infer the different topics of discussion, and Valence Aware Dictionary and sEntiment Reasoner was applied for sentiment analysis to determine the overall feelings and attitudes found in the dataset. These techniques are used to compare and contrast the nature of climate change discussion between different countries and over time. Sentiment analysis shows that the overall discussion is negative, especially when users are reacting to political or extreme weather events. Topic modeling shows that the different topics of discussion on climate change are diverse, but some topics are more prevalent than others. In particular, the discussion of climate change in the USA is less focused on policy-related topics than other countries.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Alampalayam SP, Kumar A (2004) Predictive security model using data mining. In: Global telecommunications conference, 2004. GLOBECOM’04, vol 4, pp 2208–2212. IEEE Alampalayam SP, Kumar A (2004) Predictive security model using data mining. In: Global telecommunications conference, 2004. GLOBECOM’04, vol 4, pp 2208–2212. IEEE
go back to reference Alampalayam SK, Natsheh EF (2008) Multivariate fuzzy analysis for mobile ad hoc network threat detection. Int J Bus Data Commun Netw (IJBDCN) 4(3):1–30CrossRef Alampalayam SK, Natsheh EF (2008) Multivariate fuzzy analysis for mobile ad hoc network threat detection. Int J Bus Data Commun Netw (IJBDCN) 4(3):1–30CrossRef
go back to reference Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J Mach Learn Res 3:993–1022MATH Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J Mach Learn Res 3:993–1022MATH
go back to reference Hutto CJ, Gilbert EE (2014) VADER: a parsimonious rule-based model for sentiment analysis of social media text. In: Eighth international conference on weblogs and social media (ICWSM-14), Ann Arbor, MI Hutto CJ, Gilbert EE (2014) VADER: a parsimonious rule-based model for sentiment analysis of social media text. In: Eighth international conference on weblogs and social media (ICWSM-14), Ann Arbor, MI
go back to reference IPCC (2014) Contribution of working groups I, II and III to the fifth assessment report of the Intergovernmental Panel on Climate Change. Climate change 2014: synthesis report. IPCC, Geneva, Switzerland IPCC (2014) Contribution of working groups I, II and III to the fifth assessment report of the Intergovernmental Panel on Climate Change. Climate change 2014: synthesis report. IPCC, Geneva, Switzerland
go back to reference Karami A, Dahl A, Turner-McGrievy G, Kharrazi H, Shaw G (2018) Characterizing diabetes, diet, exercise, and obesity comments on Twitter. Int J Inf Manag 38(01):1–6CrossRef Karami A, Dahl A, Turner-McGrievy G, Kharrazi H, Shaw G (2018) Characterizing diabetes, diet, exercise, and obesity comments on Twitter. Int J Inf Manag 38(01):1–6CrossRef
go back to reference Leas EC, Althouse BM, Dredze M, Obradovich N, Fowler JH et al (2016) Big data sensors of organic advocacy: the case of Leonardo DiCaprio and climate change. PLoS ONE 11(8):e0159885CrossRef Leas EC, Althouse BM, Dredze M, Obradovich N, Fowler JH et al (2016) Big data sensors of organic advocacy: the case of Leonardo DiCaprio and climate change. PLoS ONE 11(8):e0159885CrossRef
go back to reference Lee GM, Qui L, Whinston AB (2016) A friend like me: modeling network formation in a location-based social network. J Manag Inf Syst 33(4):1008–1033CrossRef Lee GM, Qui L, Whinston AB (2016) A friend like me: modeling network formation in a location-based social network. J Manag Inf Syst 33(4):1008–1033CrossRef
go back to reference Mandel B, Culotta A, Boulahanis J, Stark D, Lewis B, Rodrigue J (2012) A demographic analysis of online sentiment during Hurricane Irene. In: Proceedings of the second workshop on language in social media Mandel B, Culotta A, Boulahanis J, Stark D, Lewis B, Rodrigue J (2012) A demographic analysis of online sentiment during Hurricane Irene. In: Proceedings of the second workshop on language in social media
go back to reference Medhat W, Hassan A, Korashy H (2014) Sentiment analysis algorithms and applications: a survey. Ain Shams Eng J. 5(4):1093–1113CrossRef Medhat W, Hassan A, Korashy H (2014) Sentiment analysis algorithms and applications: a survey. Ain Shams Eng J. 5(4):1093–1113CrossRef
go back to reference Mehrotra R, Sanner S, Buntine W, Xie L (2013) Improving LDA topic models for microblogs via tweet pooling and automatic labeling. In: Proceedings of the 36th international ACM SIGIR conference on research and development in information retrieval-SIGIR 13. https://doi.org/10.1145/2484028.2484166 Mehrotra R, Sanner S, Buntine W, Xie L (2013) Improving LDA topic models for microblogs via tweet pooling and automatic labeling. In: Proceedings of the 36th international ACM SIGIR conference on research and development in information retrieval-SIGIR 13. https://​doi.​org/​10.​1145/​2484028.​2484166
go back to reference Raj P, Kumar SA (2017) Big data analytics processes and platforms facilitating smart cities. Smart cities: foundations, principles, and applications. Wiley, pp 23–52 Raj P, Kumar SA (2017) Big data analytics processes and platforms facilitating smart cities. Smart cities: foundations, principles, and applications. Wiley, pp 23–52
go back to reference Rehurek R, Sojka P (2010) Software framework for topic modeling with large corpora. In: Proceedings of the LREC 2010 workshop on new challenges for NLP frameworks, pp 45–50 Rehurek R, Sojka P (2010) Software framework for topic modeling with large corpora. In: Proceedings of the LREC 2010 workshop on new challenges for NLP frameworks, pp 45–50
go back to reference Röder M, Both A, Hinneburg A (2015) Exploring the space of topic coherence measures. In: Proceedings of ACM international conference on web search and data mining Röder M, Both A, Hinneburg A (2015) Exploring the space of topic coherence measures. In: Proceedings of ACM international conference on web search and data mining
go back to reference Shi Z, Lee GM, Whinston AB (2016) Toward a better measure of business proximity: topic modeling for industry intelligence. MIS Q 40(4):1035–1056CrossRef Shi Z, Lee GM, Whinston AB (2016) Toward a better measure of business proximity: topic modeling for industry intelligence. MIS Q 40(4):1035–1056CrossRef
go back to reference Steinskog A, Therkelsen J, Gambäck B (2017) Twitter topic modeling by tweet aggregation. In: Proceedings of the 21st nordic conference on computational linguistics, pp 77–86 Steinskog A, Therkelsen J, Gambäck B (2017) Twitter topic modeling by tweet aggregation. In: Proceedings of the 21st nordic conference on computational linguistics, pp 77–86
go back to reference Tumasjan A, Sprenger TO, Sandner PG, Welpe IM (2010) Predicting elections with Twitter: what 140 characters reveal about political sentiment. In: Proceedings of the fourth international AAAI conference on weblogs and social media Tumasjan A, Sprenger TO, Sandner PG, Welpe IM (2010) Predicting elections with Twitter: what 140 characters reveal about political sentiment. In: Proceedings of the fourth international AAAI conference on weblogs and social media
go back to reference Xu BH, Kumar SA (2014) Big data analytics framework for improved decision making. In: Proceedings on the international conference on internet computing (ICOMP) (p 1). The steering committee of the world congress in computer science, computer engineering and applied computing (WorldComp) Xu BH, Kumar SA (2014) Big data analytics framework for improved decision making. In: Proceedings on the international conference on internet computing (ICOMP) (p 1). The steering committee of the world congress in computer science, computer engineering and applied computing (WorldComp)
go back to reference Xu B, Kumar S (2015a) A text mining classification framework and its experiments using aviation datasets. In: 25th workshop of information technology and systems (WITS), Dallas, TX, 2015 SSRN Xu B, Kumar S (2015a) A text mining classification framework and its experiments using aviation datasets. In: 25th workshop of information technology and systems (WITS), Dallas, TX, 2015 SSRN
go back to reference Xu B, Kumar SA (2015b) Big data analytics framework for system health monitoring. In: 2015 IEEE international congress on big data (bigdata congress). IEEE, pp 401–408 Xu B, Kumar SA (2015b) Big data analytics framework for system health monitoring. In: 2015 IEEE international congress on big data (bigdata congress). IEEE, pp 401–408
go back to reference Xu J, Wang S, Su S, Kumar SA, Wu C (2016) Latent interest and topic mining on user-item bipartite networks. In: 2016 IEEE international conference on services computing (SCC). IEEE, pp 778–781 Xu J, Wang S, Su S, Kumar SA, Wu C (2016) Latent interest and topic mining on user-item bipartite networks. In: 2016 IEEE international conference on services computing (SCC). IEEE, pp 778–781
go back to reference Yan X, Guo J, Lan Y, Cheng X (2013) A biterm topic model for short texts. In: Proceedings of the 22nd international conference on world wide web, pp 1145–1456 Yan X, Guo J, Lan Y, Cheng X (2013) A biterm topic model for short texts. In: Proceedings of the 22nd international conference on world wide web, pp 1145–1456
Metadata
Title
Topic modeling and sentiment analysis of global climate change tweets
Authors
Biraj Dahal
Sathish A. P. Kumar
Zhenlong Li
Publication date
01-12-2019
Publisher
Springer Vienna
Published in
Social Network Analysis and Mining / Issue 1/2019
Print ISSN: 1869-5450
Electronic ISSN: 1869-5469
DOI
https://doi.org/10.1007/s13278-019-0568-8

Other articles of this Issue 1/2019

Social Network Analysis and Mining 1/2019 Go to the issue

Premium Partner