Skip to main content

2018 | OriginalPaper | Buchkapitel

Sub-event Detection on Twitter Network

verfasst von : Chao Chen, Gabriel Terejanu

Erschienen in: Artificial Intelligence Applications and Innovations

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This work addresses the online detection of sub-events using Twitter stream data. We formulate the process of sub-event identification as an outlier detection problem using three statistical methods: Kalman Filter, Gaussian Process, and Probabilistic Principal Component Analysis. These methods are used to construct the probability distribution of percentage change in the number of tweets. Outliers are identified as future observations that do not fit these predicted probability distributions. Five real-world case studies are investigated to test the effectiveness of the methods. Finally, we discuss the limitations of the proposed frame-work and provide future directions for improvement.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Meladianos, P., Nikolentzos, G., Rousseau, F., Stavrakas, Y., Vazirgiannis, M.: Degeneracy based real-time sub-event detection in Twitter stream. In: Cha, M., Mascolo, C., Sandvig, C. (eds.) ICWSM, pp. 248–257. AAAI Press (2015) Meladianos, P., Nikolentzos, G., Rousseau, F., Stavrakas, Y., Vazirgiannis, M.: Degeneracy based real-time sub-event detection in Twitter stream. In: Cha, M., Mascolo, C., Sandvig, C. (eds.) ICWSM, pp. 248–257. AAAI Press (2015)
2.
Zurück zum Zitat Atefeh, F., Khreich, W.: A survey of techniques for event detection in Twitter. Comput. Intell. 31(1), 132–164 (2015)MathSciNetCrossRef Atefeh, F., Khreich, W.: A survey of techniques for event detection in Twitter. Comput. Intell. 31(1), 132–164 (2015)MathSciNetCrossRef
3.
Zurück zum Zitat Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web, WWW 2010, pp. 851–860. ACM, New York (2010) Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web, WWW 2010, pp. 851–860. ACM, New York (2010)
4.
Zurück zum Zitat Guo, D., Chen, C.: Detecting non-personal and spam users on geo-tagged Twitter network. Trans. GIS 18(3), 370–384 (2014)MathSciNetCrossRef Guo, D., Chen, C.: Detecting non-personal and spam users on geo-tagged Twitter network. Trans. GIS 18(3), 370–384 (2014)MathSciNetCrossRef
5.
Zurück zum Zitat Huang, Y., Guo, D., Kasakoff, A., Grieve, J.: Understanding us regional linguistic variation with Twitter data analysis. Comput. Environ. Urban Syst. 59, 244–255 (2015)CrossRef Huang, Y., Guo, D., Kasakoff, A., Grieve, J.: Understanding us regional linguistic variation with Twitter data analysis. Comput. Environ. Urban Syst. 59, 244–255 (2015)CrossRef
6.
Zurück zum Zitat Wang, H., Can, D., Kazemzadeh, A., Bar, F., Narayanan, S.: A system for real-time Twitter sentiment analysis of 2012 U.S. presidential election cycle. In: Proceedings of the ACL 2012 System Demonstrations, ACL 2012, pp. 115–120. Association for Computational Linguistics, Stroudsburg (2012) Wang, H., Can, D., Kazemzadeh, A., Bar, F., Narayanan, S.: A system for real-time Twitter sentiment analysis of 2012 U.S. presidential election cycle. In: Proceedings of the ACL 2012 System Demonstrations, ACL 2012, pp. 115–120. Association for Computational Linguistics, Stroudsburg (2012)
7.
Zurück zum Zitat Pohl, D., Bouchachia, A., Hellwagner, H.: Automatic sub-event detection in emergency management using social media. In: Proceedings of the 21st International Conference on World Wide Web, WWW 2012 Companion, pp. 683–686. ACM, New York (2012) Pohl, D., Bouchachia, A., Hellwagner, H.: Automatic sub-event detection in emergency management using social media. In: Proceedings of the 21st International Conference on World Wide Web, WWW 2012 Companion, pp. 683–686. ACM, New York (2012)
8.
Zurück zum Zitat Palen, L., Starbird, K., Vieweg, S., Hughes, A.: Twitter-based information distribution during the 2009 red river valley flood threat. Bull. Am. Soc. Inf. Sci. Technol. 36(5), 13–17 (2010)CrossRef Palen, L., Starbird, K., Vieweg, S., Hughes, A.: Twitter-based information distribution during the 2009 red river valley flood threat. Bull. Am. Soc. Inf. Sci. Technol. 36(5), 13–17 (2010)CrossRef
9.
Zurück zum Zitat Tumasjan, A., Sprenger, T.O., Sandner, P.G., Welpe, I.M.: Election forecasts with Twitter. Soc. Sci. Comput. Rev. 29(4), 402–418 (2011)CrossRef Tumasjan, A., Sprenger, T.O., Sandner, P.G., Welpe, I.M.: Election forecasts with Twitter. Soc. Sci. Comput. Rev. 29(4), 402–418 (2011)CrossRef
10.
Zurück zum Zitat Lee, R., Wakamiya, S., Sumiya, K.: Discovery of unusual regional social activities using geo-tagged microblogs. World Wide Web 14(4), 321–349 (2011)CrossRef Lee, R., Wakamiya, S., Sumiya, K.: Discovery of unusual regional social activities using geo-tagged microblogs. World Wide Web 14(4), 321–349 (2011)CrossRef
11.
Zurück zum Zitat Mathioudakis, M., Koudas, N.: TwitterMonitor: trend detection over the Twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 1155–1158. ACM, New York (2010) Mathioudakis, M., Koudas, N.: TwitterMonitor: trend detection over the Twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 1155–1158. ACM, New York (2010)
12.
Zurück zum Zitat Allan, J. (ed.): Introduction to Topic Detection and Tracking, pp. 1–16. Kluwer Academic Publishers (2002) Allan, J. (ed.): Introduction to Topic Detection and Tracking, pp. 1–16. Kluwer Academic Publishers (2002)
13.
Zurück zum Zitat Zhang, C., Zhou, G., Yuan, Q., Zhuang, H., Zheng, Y., Kaplan, L.M., Wang, S., Han, J.: GeoBurst: real-time local event detection in geo-tagged tweet streams. In: Perego, R., Sebastiani, F., Aslam, J.A., Ruthven, I., Zobel, J. (eds.) SIGIR, pp. 513–522. ACM (2016) Zhang, C., Zhou, G., Yuan, Q., Zhuang, H., Zheng, Y., Kaplan, L.M., Wang, S., Han, J.: GeoBurst: real-time local event detection in geo-tagged tweet streams. In: Perego, R., Sebastiani, F., Aslam, J.A., Ruthven, I., Zobel, J. (eds.) SIGIR, pp. 513–522. ACM (2016)
14.
Zurück zum Zitat Li, R., Lei, K.H., Khadiwala, R., Chang, K.C.C.: TEDAS: a Twitter-based event detection and analysis system. In: Proceedings of the 2012 IEEE 28th International Conference on Data Engineering, ICDE 2012, pp. 1273–1276. IEEE Computer Society, Washington, DC (2012) Li, R., Lei, K.H., Khadiwala, R., Chang, K.C.C.: TEDAS: a Twitter-based event detection and analysis system. In: Proceedings of the 2012 IEEE 28th International Conference on Data Engineering, ICDE 2012, pp. 1273–1276. IEEE Computer Society, Washington, DC (2012)
15.
Zurück zum Zitat Ifrim, G., Shi, B., Brigadir, I.: Event detection in Twitter using aggressive filtering and hierarchical tweet clustering. In: Papadopoulos, S., Corney, D., Aiello, L.M. (eds.) SNOW-DC@WWW, CEUR Workshop Proceedings, vol. 1150, 33–40. CEUR-WS.org (2014) Ifrim, G., Shi, B., Brigadir, I.: Event detection in Twitter using aggressive filtering and hierarchical tweet clustering. In: Papadopoulos, S., Corney, D., Aiello, L.M. (eds.) SNOW-DC@WWW, CEUR Workshop Proceedings, vol. 1150, 33–40. CEUR-WS.org (2014)
16.
Zurück zum Zitat Chen, L., Roy, A.: Event detection from Flickr data through wavelet-based spatial analysis. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, CIKM 2009, pp. 523–532. ACM, New York (2009) Chen, L., Roy, A.: Event detection from Flickr data through wavelet-based spatial analysis. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, CIKM 2009, pp. 523–532. ACM, New York (2009)
17.
Zurück zum Zitat Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Fifth International AAAI Conference on Weblogs and Social Media (2011) Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Fifth International AAAI Conference on Weblogs and Social Media (2011)
18.
Zurück zum Zitat Popescu, A.M., Pennacchiotti, M.: Detecting controversial events from Twitter. In: Proceedings of the 19th ACM International Conference on Information and Knowledge Management, CIKM 2010, pp. 1873–1876. ACM, New York (2010) Popescu, A.M., Pennacchiotti, M.: Detecting controversial events from Twitter. In: Proceedings of the 19th ACM International Conference on Information and Knowledge Management, CIKM 2010, pp. 1873–1876. ACM, New York (2010)
19.
Zurück zum Zitat Sankaranarayanan, J., Samet, H., Teitler, B.E., Lieberman, M.D., Sperling, J.: TwitterStand: news in tweets. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS 2009, pp. 42–51. ACM, New York (2009) Sankaranarayanan, J., Samet, H., Teitler, B.E., Lieberman, M.D., Sperling, J.: TwitterStand: news in tweets. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS 2009, pp. 42–51. ACM, New York (2009)
20.
Zurück zum Zitat Zubiaga, A., Spina, D., Amigó, E., Gonzalo, J.: Towards real-time summarization of scheduled events from Twitter streams. In: Proceedings of the 23rd ACM Conference on Hypertext and Social Media, HT 2012, pp. 319–320. ACM, New York (2012) Zubiaga, A., Spina, D., Amigó, E., Gonzalo, J.: Towards real-time summarization of scheduled events from Twitter streams. In: Proceedings of the 23rd ACM Conference on Hypertext and Social Media, HT 2012, pp. 319–320. ACM, New York (2012)
21.
Zurück zum Zitat Zhao, S., Zhong, L., Wickramasuriya, J., Vasudevan, V.: Human as real-time sensors of social and physical events: a case study of Twitter and sports games. CoRR abs/1106.4300 (2011) Zhao, S., Zhong, L., Wickramasuriya, J., Vasudevan, V.: Human as real-time sensors of social and physical events: a case study of Twitter and sports games. CoRR abs/1106.4300 (2011)
22.
Zurück zum Zitat Chakrabarti, D., Punera, K.: Event summarization using tweets. In: ICWSM (2011) Chakrabarti, D., Punera, K.: Event summarization using tweets. In: ICWSM (2011)
23.
Zurück zum Zitat Nichols, J., Mahmud, J., Drews, C.: Summarizing sporting events using Twitter. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, IUI 2012, pp. 189–198. ACM, New York (2012) Nichols, J., Mahmud, J., Drews, C.: Summarizing sporting events using Twitter. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, IUI 2012, pp. 189–198. ACM, New York (2012)
24.
Zurück zum Zitat Shen, C., Liu, F., Weng, F., Li, T.: A participant-based approach for event summarization using Twitter streams. In: Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings, 9–14 June 2013, Westin Peachtree Plaza Hotel, Atlanta, Georgia, USA, pp. 1152–1162 (2013) Shen, C., Liu, F., Weng, F., Li, T.: A participant-based approach for event summarization using Twitter streams. In: Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings, 9–14 June 2013, Westin Peachtree Plaza Hotel, Atlanta, Georgia, USA, pp. 1152–1162 (2013)
25.
Zurück zum Zitat Chierichetti, F., Kleinberg, J.M., Kumar, R., Mahdian, M., Pandey, S.: Event detection via communication pattern analysis. In: Proceedings of the Eighth International Conference on Weblogs and Social Media, ICWSM 2014, Ann Arbor, Michigan, USA, 1–4 June 2014 (2014) Chierichetti, F., Kleinberg, J.M., Kumar, R., Mahdian, M., Pandey, S.: Event detection via communication pattern analysis. In: Proceedings of the Eighth International Conference on Weblogs and Social Media, ICWSM 2014, Ann Arbor, Michigan, USA, 1–4 June 2014 (2014)
26.
Zurück zum Zitat Terejanu, G., Singh, T., Scott, P.D.: Unscented Kalman filter/smoother for a CBRN puff - based dispersion model. In: 11th International Conference on Information Fusion, Quebec City, Canada, July 2007 Terejanu, G., Singh, T., Scott, P.D.: Unscented Kalman filter/smoother for a CBRN puff - based dispersion model. In: 11th International Conference on Information Fusion, Quebec City, Canada, July 2007
27.
Zurück zum Zitat Ozbek, L., Ozlale, U.: Employing the extended Kalman filter in measuring the output gap. J. Econ. Dyn. Control 29(9), 1611–1622 (2005)CrossRef Ozbek, L., Ozlale, U.: Employing the extended Kalman filter in measuring the output gap. J. Econ. Dyn. Control 29(9), 1611–1622 (2005)CrossRef
29.
Zurück zum Zitat Snelson, E., Ghahramani, Z.: Variable noise and dimensionality reduction for sparse Gaussian processes. In: UAI 2006, Proceedings of the 22nd Conference in Uncertainty in Artificial Intelligence, Cambridge, MA, USA, 13–16 July 2006 (2006) Snelson, E., Ghahramani, Z.: Variable noise and dimensionality reduction for sparse Gaussian processes. In: UAI 2006, Proceedings of the 22nd Conference in Uncertainty in Artificial Intelligence, Cambridge, MA, USA, 13–16 July 2006 (2006)
30.
Zurück zum Zitat Tipping, M.E., Bishop, C.M.: Probabilistic principal component analysis. J. Royal Stat. Soc. Ser. B 61, 611–622 (1999)MathSciNetCrossRef Tipping, M.E., Bishop, C.M.: Probabilistic principal component analysis. J. Royal Stat. Soc. Ser. B 61, 611–622 (1999)MathSciNetCrossRef
Metadaten
Titel
Sub-event Detection on Twitter Network
verfasst von
Chao Chen
Gabriel Terejanu
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-92007-8_5