Skip to main content
Top

2020 | OriginalPaper | Chapter

Can Twitter Data Estimate Reality Show Outcomes?

Authors : Kenzo Sakiyama, Lucas de Souza Rodrigues, Edson Takashi Matsubara

Published in: Intelligent Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

People’s opinions can impact the real world in many different ways. The election of politics, the sales of products, stock market prices, and consumer habits are just a few examples. However, exploring this relationship between people’s opinions and real-world events requires data from both sides, which is usually expensive and hard to obtain. In this study, on one side, we address this problem by extracting data from Twitter, and on the other side, the real-world outcomes of a reality show. We carefully select a reality show that uses the audience’s opinion to define the elimination of participants. This relationship brings an interesting case of a causal relationship between audience opinion and real-world events. From Twitter, we obtained simple features, such as the counts of likes, retweets, followers, specific hashtags along with sentiment analysis counts obtained from a fine-tuned BERT. From the TV show, we obtained the eliminated candidate and the percentage of audience rejection of the eliminated candidate. To answer the question posed in the title, we empirically evaluate eleven standard machine learning algorithms using the collected features. The models were able to achieve 88.23% of accuracy to predict the eliminated candidate in the reality show.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Amolik, A., Jivane, N., Bhandari, M., Venkatesan, M.: Twitter sentiment analysis of movie reviews using machine learning techniques. Int. J. Eng. Technol. 7(6), 1–7 (2016) Amolik, A., Jivane, N., Bhandari, M., Venkatesan, M.: Twitter sentiment analysis of movie reviews using machine learning techniques. Int. J. Eng. Technol. 7(6), 1–7 (2016)
2.
go back to reference Anber, H., Salah, A., Abd El-Aziz, A.: A literature review on Twitter data analysis. Int. J. Comput. Electr. Eng. 8(3), 241 (2016)CrossRef Anber, H., Salah, A., Abd El-Aziz, A.: A literature review on Twitter data analysis. Int. J. Comput. Electr. Eng. 8(3), 241 (2016)CrossRef
3.
go back to reference Baziotis, C., Pelekis, N., Doulkeridis, C.: DataStories at SemEval-2017 task 4: deep LSTM with attention for message-level and topic-based sentiment analysis. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pp. 747–754. Association for Computational Linguistics, Vancouver, August 2017 Baziotis, C., Pelekis, N., Doulkeridis, C.: DataStories at SemEval-2017 task 4: deep LSTM with attention for message-level and topic-based sentiment analysis. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pp. 747–754. Association for Computational Linguistics, Vancouver, August 2017
4.
go back to reference Bertini Brum, H., das Graças Volpe Nunes, M.: Building a sentiment corpus of tweets in Brazilian Portuguese. arXiv preprint arXiv:1712.08917 (2017) Bertini Brum, H., das Graças Volpe Nunes, M.: Building a sentiment corpus of tweets in Brazilian Portuguese. arXiv preprint arXiv:​1712.​08917 (2017)
5.
go back to reference Bollen, J., Mao, H., Zeng, X.: Twitter mood predicts the stock market. J. Comput. Sci. 2(1), 1–8 (2011)CrossRef Bollen, J., Mao, H., Zeng, X.: Twitter mood predicts the stock market. J. Comput. Sci. 2(1), 1–8 (2011)CrossRef
7.
go back to reference Braithwaite, S.R., Giraud-Carrier, C., West, J., Barnes, M.D., Hanson, C.L.: Validating machine learning algorithms for Twitter data against established measures of suicidality. JMIR Ment. Health 3(2), e21 (2016)CrossRef Braithwaite, S.R., Giraud-Carrier, C., West, J., Barnes, M.D., Hanson, C.L.: Validating machine learning algorithms for Twitter data against established measures of suicidality. JMIR Ment. Health 3(2), e21 (2016)CrossRef
8.
go back to reference Buccoliero, L., Bellio, E., Crestini, G., Arkoudas, A.: Twitter and politics: evidence from the US presidential elections 2016. J. Mark. Commun. 26, 114–88 (2020)CrossRef Buccoliero, L., Bellio, E., Crestini, G., Arkoudas, A.: Twitter and politics: evidence from the US presidential elections 2016. J. Mark. Commun. 26, 114–88 (2020)CrossRef
9.
go back to reference Clark, K., Khandelwal, U., Levy, O., Manning, C.D.: What does BERT look at? An analysis of BERT’s attention. arXiv preprint arXiv:1906.04341 (2019) Clark, K., Khandelwal, U., Levy, O., Manning, C.D.: What does BERT look at? An analysis of BERT’s attention. arXiv preprint arXiv:​1906.​04341 (2019)
11.
go back to reference Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186 (2019) Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186 (2019)
12.
go back to reference Giannoulakis, S., Tsapatsoulis, N.: Evaluating the descriptive power of Instagram hashtags. J. Innov. Digit. Ecosyst. 3(2), 114–129 (2016)CrossRef Giannoulakis, S., Tsapatsoulis, N.: Evaluating the descriptive power of Instagram hashtags. J. Innov. Digit. Ecosyst. 3(2), 114–129 (2016)CrossRef
13.
go back to reference Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014) Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014)
14.
go back to reference Lim, S., Tucker, C.S.: Mining Twitter data for causal links between tweets and real-world outcomes. Expert Syst. Appl. X 3, 100007 (2019) Lim, S., Tucker, C.S.: Mining Twitter data for causal links between tweets and real-world outcomes. Expert Syst. Appl. X 3, 100007 (2019)
15.
go back to reference Mäntylä, M.V., Graziotin, D., Kuutila, M.: The evolution of sentiment analysis–a review of research topics, venues, and top cited papers. Comput. Sci. Rev. 27, 16–32 (2018)CrossRef Mäntylä, M.V., Graziotin, D., Kuutila, M.: The evolution of sentiment analysis–a review of research topics, venues, and top cited papers. Comput. Sci. Rev. 27, 16–32 (2018)CrossRef
16.
go back to reference Mulyani, E.D.S., Rohpandi, D., Rahman, F.A.: Analysis of Twitter sentiment using the classification of Naive Bayes method about television in Indonesia. In: 2019 1st International Conference on Cybernetics and Intelligent System (ICORIS), vol. 1, pp. 89–93. IEEE (2019) Mulyani, E.D.S., Rohpandi, D., Rahman, F.A.: Analysis of Twitter sentiment using the classification of Naive Bayes method about television in Indonesia. In: 2019 1st International Conference on Cybernetics and Intelligent System (ICORIS), vol. 1, pp. 89–93. IEEE (2019)
17.
go back to reference Pagolu, V.S., Reddy, K.N., Panda, G., Majhi, B.: Sentiment analysis of Twitter data for predicting stock market movements. In: 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES), pp. 1345–1350. IEEE (2016) Pagolu, V.S., Reddy, K.N., Panda, G., Majhi, B.: Sentiment analysis of Twitter data for predicting stock market movements. In: 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES), pp. 1345–1350. IEEE (2016)
18.
go back to reference Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH
19.
go back to reference Reddy, D.M., Reddy, N.V.S.: Twitter sentiment analysis using distributed word and sentence representation. arXiv abs/1904.12580 (2019) Reddy, D.M., Reddy, N.V.S.: Twitter sentiment analysis using distributed word and sentence representation. arXiv abs/1904.12580 (2019)
20.
21.
go back to reference Sakiyama, K.M., Silva, A.Q.B., Matsubara, E.T.: Twitter breaking news detector in the 2018 Brazilian presidential election using word embeddings and convolutional neural networks. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2019) Sakiyama, K.M., Silva, A.Q.B., Matsubara, E.T.: Twitter breaking news detector in the 2018 Brazilian presidential election using word embeddings and convolutional neural networks. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2019)
22.
24.
go back to reference Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., Bowman, S.R.: Glue: a multi-task benchmark and analysis platform for natural language understanding. arXiv preprint arXiv:1804.07461 (2018) Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., Bowman, S.R.: Glue: a multi-task benchmark and analysis platform for natural language understanding. arXiv preprint arXiv:​1804.​07461 (2018)
25.
go back to reference Wang, L., Niu, J., Yu, S.M.: SentiDiff: combining textual information and sentiment diffusion patterns for Twitter sentiment analysis. IEEE Trans. Knowl. Data Eng. 32, 2026–2039 (2019)CrossRef Wang, L., Niu, J., Yu, S.M.: SentiDiff: combining textual information and sentiment diffusion patterns for Twitter sentiment analysis. IEEE Trans. Knowl. Data Eng. 32, 2026–2039 (2019)CrossRef
26.
go back to reference Zacharias, C., Poldi, F.: GitHub - twintproject/twint: an advanced Twitter scraping & OSINT tool written in Python that doesn’t use Twitter’s API, allowing you to scrape a user’s followers, following, tweets and more while evading most API limitations, February 2020. https://github.com/twintproject/twint. Accessed 27 Apr 2020 Zacharias, C., Poldi, F.: GitHub - twintproject/twint: an advanced Twitter scraping & OSINT tool written in Python that doesn’t use Twitter’s API, allowing you to scrape a user’s followers, following, tweets and more while evading most API limitations, February 2020. https://​github.​com/​twintproject/​twint. Accessed 27 Apr 2020
Metadata
Title
Can Twitter Data Estimate Reality Show Outcomes?
Authors
Kenzo Sakiyama
Lucas de Souza Rodrigues
Edson Takashi Matsubara
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61377-8_32

Premium Partner