Skip to main content

2019 | OriginalPaper | Buchkapitel

Incorporating Content Beyond Text: A High Reliable Twitter-Based Disaster Information System

verfasst von : Qixuan Hou, Meng Han

Erschienen in: Computational Data and Social Networks

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Social media is a valuable information source with high-volume and real-time data. It has been used in a great number of event detection applications, especially in disaster information system. However, most of the systems only extract textual content. In this paper, we present an infrastructure pipeline of disaster information system using Twitter data. Landslide is used as an example for the demonstration purpose. To further improve the quality of the detected events, the pipeline integrates both textual and imagery content from tweets in hope to fully utilize the information. The text classifier is built to remove noises, which can achieve 0.92 F1-score in classifying individual messages. The image classifier is constructed by fine-tuning pretrained VGG-F network, which can achieve 90% accuracy. The image classifier serves as a verifier in the pipeline to reject or confirm the detected events. The evaluation indicates that this verifier can significantly reduce false positive events.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
2.
Zurück zum Zitat Culnan, M., McHugh, P., Zubillaga, Jesus.: How Large U.S. Companies Can Use Twitter and Other Social Media to Gain Business Value. MIS Quarterly Executive (2010) Culnan, M., McHugh, P., Zubillaga, Jesus.: How Large U.S. Companies Can Use Twitter and Other Social Media to Gain Business Value. MIS Quarterly Executive (2010)
3.
Zurück zum Zitat Signorini, A., Segre, A.M., Polgreen, P.M.: The use of Twitter to track levels of disease activity and public concern in the U.S. during the Influenza A H1N1 pandemic. PLoS ONE 6, e19467 (2011)CrossRef Signorini, A., Segre, A.M., Polgreen, P.M.: The use of Twitter to track levels of disease activity and public concern in the U.S. during the Influenza A H1N1 pandemic. PLoS ONE 6, e19467 (2011)CrossRef
4.
Zurück zum Zitat Yates, D., Paquette, S.: Emergency knowledge management and social media technologies: a case study of the 2010 Haitian earthquake. Int. J. Inf. Manage. 31(1), 6–13 (2011)CrossRef Yates, D., Paquette, S.: Emergency knowledge management and social media technologies: a case study of the 2010 Haitian earthquake. Int. J. Inf. Manage. 31(1), 6–13 (2011)CrossRef
5.
Zurück zum Zitat Gao, H., Barbier, G., Goolsby, R.: Harnessing the crowdsourcing power of social media for disaster relief. IEEE Intell. Syst. 26(3), 10–14 (2011)CrossRef Gao, H., Barbier, G., Goolsby, R.: Harnessing the crowdsourcing power of social media for disaster relief. IEEE Intell. Syst. 26(3), 10–14 (2011)CrossRef
6.
Zurück zum Zitat Yin, J., Karimi, S., Lampert, A., Cameron, M., Robinson, B., Power, R.: Using social media to enhance emergency situation awareness: extended abstract. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (2015) Yin, J., Karimi, S., Lampert, A., Cameron, M., Robinson, B., Power, R.: Using social media to enhance emergency situation awareness: extended abstract. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)
7.
Zurück zum Zitat Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Proceedings of the Fifth International Conference on Weblogs and Social Media (2011) Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Proceedings of the Fifth International Conference on Weblogs and Social Media (2011)
8.
Zurück zum Zitat Fung, G., Yu, X., Yu, P., Lu, H.: Parameter free bursty events detection in text streams. In: Proceedings of the 31st International Conference on Very Large Data Bases (2005) Fung, G., Yu, X., Yu, P., Lu, H.: Parameter free bursty events detection in text streams. In: Proceedings of the 31st International Conference on Very Large Data Bases (2005)
9.
Zurück zum Zitat Karimi, S., Yin, J., Paris, C.: Classifying microblogs for disasters. In: Proceedings of the 2013 Australasian Document Computing Symposium (2013) Karimi, S., Yin, J., Paris, C.: Classifying microblogs for disasters. In: Proceedings of the 2013 Australasian Document Computing Symposium (2013)
10.
Zurück zum Zitat Li, R., Lei, K.H., Khadiwala, R., Change, K.: TEDAS: a Twitter-based event detection and analysis system. In: Proceedings of the IEEE 28th International Conference on Data Engineering (2012) Li, R., Lei, K.H., Khadiwala, R., Change, K.: TEDAS: a Twitter-based event detection and analysis system. In: Proceedings of the IEEE 28th International Conference on Data Engineering (2012)
11.
Zurück zum Zitat Yin, J.: Clustering microtext streams for event identification. In: Proceedings of the 6th International Joint Conference on Natural Language Processing (2013) Yin, J.: Clustering microtext streams for event identification. In: Proceedings of the 6th International Joint Conference on Natural Language Processing (2013)
14.
Zurück zum Zitat Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. eprint arXiv:1409.1556 (2014) Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. eprint arXiv:​1409.​1556 (2014)
15.
Zurück zum Zitat Donahue, J., et al.: DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. eprint arXiv:1310.1531 (2013) Donahue, J., et al.: DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. eprint arXiv:​1310.​1531 (2013)
16.
Zurück zum Zitat Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: British Machine Vision Conference (2014) Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: British Machine Vision Conference (2014)
17.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (2012) Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (2012)
18.
Zurück zum Zitat He, J.S., Han, M., Ji, S., Du, T., Li, Z.: Spreading social influence with both positive and negative opinions in online networks. Big Data Mining Anal. 2(2), 100–117 (2019)CrossRef He, J.S., Han, M., Ji, S., Du, T., Li, Z.: Spreading social influence with both positive and negative opinions in online networks. Big Data Mining Anal. 2(2), 100–117 (2019)CrossRef
19.
Zurück zum Zitat Cai, Z., He, Z., Guan, X., Li, Y.: Collective data-sanitization for preventing sensitive information inference attacks in social networks. IEEE Trans. Dependable Secure Compu. 15(4), 577–590 (2018) Cai, Z., He, Z., Guan, X., Li, Y.: Collective data-sanitization for preventing sensitive information inference attacks in social networks. IEEE Trans. Dependable Secure Compu. 15(4), 577–590 (2018)
20.
Zurück zum Zitat He, Z., Cai, Z., Yu, J.: Latent-data privacy preserving with customized data utility for social network data. IEEE Trans. Veh. Technol. 67(1), 665–673 (2018)CrossRef He, Z., Cai, Z., Yu, J.: Latent-data privacy preserving with customized data utility for social network data. IEEE Trans. Veh. Technol. 67(1), 665–673 (2018)CrossRef
21.
Zurück zum Zitat Zheng, X., Cai, Z., Yu, J., Wang, C., Li, Y.: Follow but no track: privacy preserved profile publishing in cyber-physical social systems. IEEE Internet Things 4(6), 1868–1878 (2017)CrossRef Zheng, X., Cai, Z., Yu, J., Wang, C., Li, Y.: Follow but no track: privacy preserved profile publishing in cyber-physical social systems. IEEE Internet Things 4(6), 1868–1878 (2017)CrossRef
22.
Zurück zum Zitat McGough, S.F., Brownstein, J.S., Hawkins, J.B., Santillana, M.: Forecasting Zika incidence in the 2016 Latin America outbreak combining traditional disease surveillance with search, social media, and news report data. PLoS Neql. Trop. Dis. 11, e0005295 (2017)CrossRef McGough, S.F., Brownstein, J.S., Hawkins, J.B., Santillana, M.: Forecasting Zika incidence in the 2016 Latin America outbreak combining traditional disease surveillance with search, social media, and news report data. PLoS Neql. Trop. Dis. 11, e0005295 (2017)CrossRef
23.
Zurück zum Zitat Harris, J., et al.: Evaluating the implementation of twitter-based foodborne illness reporting tool in the city of St. Louis Department of Health. Int. J. Environ. Res. Public Health 15, 833 (2018)CrossRef Harris, J., et al.: Evaluating the implementation of twitter-based foodborne illness reporting tool in the city of St. Louis Department of Health. Int. J. Environ. Res. Public Health 15, 833 (2018)CrossRef
24.
Zurück zum Zitat Finkel, J., Grenager, T., Manning, C.: Incorporating non-local information into information extraction systems by Gibbs sampling. In: Proceedings of the 43nd Annual Meeting of the Association for Computation Linguistics (2005) Finkel, J., Grenager, T., Manning, C.: Incorporating non-local information into information extraction systems by Gibbs sampling. In: Proceedings of the 43nd Annual Meeting of the Association for Computation Linguistics (2005)
27.
Zurück zum Zitat Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. Witten, I.: The WEKA data mining software. ACM SIGKDD Explor. Newsl. 11(1) (2009)CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. Witten, I.: The WEKA data mining software. ACM SIGKDD Explor. Newsl. 11(1) (2009)CrossRef
29.
Zurück zum Zitat Musaev, A., Pu, C.: Landslide information service based on composition of physical and social sensors. In: International Conference on Data Engineering (2017) Musaev, A., Pu, C.: Landslide information service based on composition of physical and social sensors. In: International Conference on Data Engineering (2017)
31.
Zurück zum Zitat He, Z., Cai, Z., Wang, X.: Modeling propagation dynamics and developing optimized countermeasures for rumor spreading in online social networks. In: The 35th IEEE International Conference on Distributed Computing Systems (2015) He, Z., Cai, Z., Wang, X.: Modeling propagation dynamics and developing optimized countermeasures for rumor spreading in online social networks. In: The 35th IEEE International Conference on Distributed Computing Systems (2015)
32.
Zurück zum Zitat He, Z., Cai, Z., Yu, J., Wang, X., Sun, Y., Li, Y.: Cost-efficient strategies for restraining rumor spreading in mobile social networks. IEEE Trans. Veh. Technol. 66(3), 2789–2800 (2017)CrossRef He, Z., Cai, Z., Yu, J., Wang, X., Sun, Y., Li, Y.: Cost-efficient strategies for restraining rumor spreading in mobile social networks. IEEE Trans. Veh. Technol. 66(3), 2789–2800 (2017)CrossRef
33.
Zurück zum Zitat Hswen, Y., Qin, Q., Brownstein, J.S., Hawkins, J.B.: Feasibility of using social media to monitor outdoor air pollution in London. England. Prev. Med. 121, 86–93 (2019)CrossRef Hswen, Y., Qin, Q., Brownstein, J.S., Hawkins, J.B.: Feasibility of using social media to monitor outdoor air pollution in London. England. Prev. Med. 121, 86–93 (2019)CrossRef
34.
Zurück zum Zitat Nsoesie, E.O., et al.: Social Media as a Sentinel for Disease Surveillance: What Does Sociodemographic Status Have to Do with It? PLOTS Current Outbreaks (2016) Nsoesie, E.O., et al.: Social Media as a Sentinel for Disease Surveillance: What Does Sociodemographic Status Have to Do with It? PLOTS Current Outbreaks (2016)
36.
Zurück zum Zitat Albinali, H., Han, M., Wang, J., Gao, H., Li, Y.: The roles of social network mavens. In: 2016 12th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN), pp. 1–8. IEEE, December 2016 Albinali, H., Han, M., Wang, J., Gao, H., Li, Y.: The roles of social network mavens. In: 2016 12th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN), pp. 1–8. IEEE, December 2016
37.
Zurück zum Zitat Han, M., Yan, M., Li, J., Ji, S., Li, Y.: Neighborhood-based uncertainty generation in social networks. J. Comb. Optim. 28(3), 561–576 (2014)MathSciNetCrossRef Han, M., Yan, M., Li, J., Ji, S., Li, Y.: Neighborhood-based uncertainty generation in social networks. J. Comb. Optim. 28(3), 561–576 (2014)MathSciNetCrossRef
Metadaten
Titel
Incorporating Content Beyond Text: A High Reliable Twitter-Based Disaster Information System
verfasst von
Qixuan Hou
Meng Han
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-34980-6_31