Skip to main content
Top
Published in: Global Journal of Flexible Systems Management 1/2017

11-01-2017 | Original Article

Towards Exploiting Social Networks for Detecting Epidemic Outbreaks

Authors: Sergio Di Martino, Sara Romano, Michela Bertolotto, Nattiya Kanhabua, Antonino Mazzeo, Wolfgang Nejdl

Published in: Global Journal of Flexible Systems Management | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Social networks are becoming a valuable source of information for applications in many domains. In particular, many studies have highlighted the potential of social networks for early detection of epidemic outbreaks, due to their capability to transmit information faster than traditional channels, thus leading to quicker reactions of public health officials. Anyhow, the most of these studies have investigated only one or two diseases, and consequently to date there is no study in the literature trying to investigate if and how different kinds of outbreaks may lead to different temporal dynamics of the messages exchanged over social networks. Furthermore, in case of a wide variability, it is not clear if it would be possible to define a single generic solution able to detect multiple epidemic outbreaks, or if specifically tailored approaches should be implemented for each disease. To get an insight into these open points, we collected a massive dataset, containing more than one hundred million Twitter messages from different countries, looking for those relevant for an early outbreak detection of multiple disease. The collected results highlight that there is a significant variability in the temporal patterns of Twitter messages among different diseases. In this paper, we report on the main findings of this analysis, and we propose a set of steps to exploit social networks for early epidemic outbreaks, including a proper document model for the outbreaks, a Graphical User Interface for the public health officials, and the identification of suitable sources of information useful as ground truth for the assessment of outbreak detection algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Almohri, S. M., Al-Shiridah, G. A., Safar, M., & Mahdi, K. (2013). Correlating feedback capacity with degree of diffusion in heterogeneous complex networks. International Journal of Space-Based and Situated Computing, 16 3(4), 193–206.CrossRef Almohri, S. M., Al-Shiridah, G. A., Safar, M., & Mahdi, K. (2013). Correlating feedback capacity with degree of diffusion in heterogeneous complex networks. International Journal of Space-Based and Situated Computing, 16 3(4), 193–206.CrossRef
go back to reference Amato, F., Casola, V., Mazzocca, N., & Romano, S. (2011). A semantic-based document processing framework: A security perspective. In 2011 International Conference on Complex, Intelligent and Software Intensive Systems (CISIS). IEEE. pp. 197–202. Amato, F., Casola, V., Mazzocca, N., & Romano, S. (2011). A semantic-based document processing framework: A security perspective. In 2011 International Conference on Complex, Intelligent and Software Intensive Systems (CISIS). IEEE. pp. 197–202.
go back to reference Amato, F., Casola, V., Mazzocca, N., & Romano, S. (2013). A semantic approach for fine-grain access control of e-health documents. Logic Journal of the IGPL, 21(4), 692–701. doi:10.1093/jigpal/jzs027.CrossRef Amato, F., Casola, V., Mazzocca, N., & Romano, S. (2013). A semantic approach for fine-grain access control of e-health documents. Logic Journal of the IGPL, 21(4), 692–701. doi:10.​1093/​jigpal/​jzs027.CrossRef
go back to reference Aramaki, E., Maskawa, S., & Morita, M. (2011). Twitter catches the flu: Detecting influenza epidemics using twitter. In Proceedings of the 2011 conference on empirical methods in natural language processing, EMNLP ’11. Aramaki, E., Maskawa, S., & Morita, M. (2011). Twitter catches the flu: Detecting influenza epidemics using twitter. In Proceedings of the 2011 conference on empirical methods in natural language processing, EMNLP ’11.
go back to reference Berberich, K., Bedathur, S., Alonso, O., & Weikum, G. (2010). A language modeling approach for temporal information needs. In Proceedings of ECIR’2010. Berberich, K., Bedathur, S., Alonso, O., & Weikum, G. (2010). A language modeling approach for temporal information needs. In Proceedings of ECIR’2010.
go back to reference Cheng, C. K., Lau, E. H., Ip, D. K., Yeung, A. S., Ho, L. M., & Cowling, B. J. (2009). A profile of the online dissemination of national influenza surveillance data. BMC Public Health, 9(1), 339.CrossRef Cheng, C. K., Lau, E. H., Ip, D. K., Yeung, A. S., Ho, L. M., & Cowling, B. J. (2009). A profile of the online dissemination of national influenza surveillance data. BMC Public Health, 9(1), 339.CrossRef
go back to reference Chunara, R., Andrews, J. R., & Brownstein, J. S. (2012). Social and news media enable estimation of epidemiological patterns early in the 2010 haitian cholera outbreak. The American Journal of Tropical Medicine and Hygiene, 86(1), 39–45.CrossRef Chunara, R., Andrews, J. R., & Brownstein, J. S. (2012). Social and news media enable estimation of epidemiological patterns early in the 2010 haitian cholera outbreak. The American Journal of Tropical Medicine and Hygiene, 86(1), 39–45.CrossRef
go back to reference Collier, N., & Doan, S. (2012). Syndromic classification of twitter messages. In Electronic Healthcare (pp. 186–195). Springer, Berlin. Collier, N., & Doan, S. (2012). Syndromic classification of twitter messages. In Electronic Healthcare (pp. 186–195). Springer, Berlin.
go back to reference Collier, N., Son, N. T., & Nguyen, N. M. (2011). Omg u got flu? Analysis of shared health messages for bio-surveillance. Journal of Biomedical Semantics, 2(S–5), S9.CrossRef Collier, N., Son, N. T., & Nguyen, N. M. (2011). Omg u got flu? Analysis of shared health messages for bio-surveillance. Journal of Biomedical Semantics, 2(S–5), S9.CrossRef
go back to reference Corazza, A., Martino, S. D., Ferrucci, F., Gravino, C., Sarro, F., & Mendes, E. (2013). Using tabu search to configure support vector regression for effort estimation. Empirical Software Engineering, 18(3), 506–546. doi:10.1007/s10664-011-9187-3.CrossRef Corazza, A., Martino, S. D., Ferrucci, F., Gravino, C., Sarro, F., & Mendes, E. (2013). Using tabu search to configure support vector regression for effort estimation. Empirical Software Engineering, 18(3), 506–546. doi:10.​1007/​s10664-011-9187-3.CrossRef
go back to reference Culotta, A. (2010). Towards detecting influenza epidemics by analyzing twitter messages. In Proceedings of the first workshop on social media analytics (SOMA’2010). Culotta, A. (2010). Towards detecting influenza epidemics by analyzing twitter messages. In Proceedings of the first workshop on social media analytics (SOMA’2010).
go back to reference Di Martino, S., Bimonte, S., Bertolotto, M., & Ferrucci, F. (2009). Integrating google earth within OLAP tools for multidimensional exploration and analysis of spatial data. In Proceedings of 11th International Conference on Enterprise Information Systems, ICEIS 2009, Milan, Italy, May 6–10, 2009 (pp. 940–951). doi:10.1007/978-3-642-01347-8_78. Di Martino, S., Bimonte, S., Bertolotto, M., & Ferrucci, F. (2009). Integrating google earth within OLAP tools for multidimensional exploration and analysis of spatial data. In Proceedings of 11th International Conference on Enterprise Information Systems, ICEIS 2009, Milan, Italy, May 6–10, 2009 (pp. 940–951). doi:10.​1007/​978-3-642-01347-8_​78.
go back to reference Di Rocco, L., Bertolotto, M., Catania, B., Guerrini, G., & Cosso, T. (2016). Extracting fine-grained implicit georeferencing information from microblogs exploiting crowdsourced gazetteers and social interactions. In 2016 19th AGILE international conference on geographic information science, Springer. Di Rocco, L., Bertolotto, M., Catania, B., Guerrini, G., & Cosso, T. (2016). Extracting fine-grained implicit georeferencing information from microblogs exploiting crowdsourced gazetteers and social interactions. In 2016 19th AGILE international conference on geographic information science, Springer.
go back to reference Diaz, F., & Jones, R. (2004). Using temporal profiles of queries for precision prediction. In Proceedings of SIGIR’2004. Diaz, F., & Jones, R. (2004). Using temporal profiles of queries for precision prediction. In Proceedings of SIGIR’2004.
go back to reference Diaz-Aviles, E., & Stewart, A. (2012). Tracking twitter for epidemic intelligence: Case study: Ehec/hus outbreak in germany, 2011. In Proceedings of the 4th annual ACM web science conference, ACM, New York, NY, USA, WebSci ’12, pp. 82–85. Diaz-Aviles, E., & Stewart, A. (2012). Tracking twitter for epidemic intelligence: Case study: Ehec/hus outbreak in germany, 2011. In Proceedings of the 4th annual ACM web science conference, ACM, New York, NY, USA, WebSci ’12, pp. 82–85.
go back to reference Diaz-Aviles, E., Stewart, A., Velasco, E., Denecke, K., & Nejdl, W. (2012). Towards personalized learning to rank for epidemic intelligence based on social media streams. In Proceedings of the 21st international conference companion on world wide web, WWW ’12 Companion, pp. 495–496. Diaz-Aviles, E., Stewart, A., Velasco, E., Denecke, K., & Nejdl, W. (2012). Towards personalized learning to rank for epidemic intelligence based on social media streams. In Proceedings of the 21st international conference companion on world wide web, WWW ’12 Companion, pp. 495–496.
go back to reference Dong, A., Zhang, R., Kolari, P., Bai, J., Diaz, F., Chang, Y., Zheng, Z., & Zha, H. (2010). Time is of the essence: Improving recency ranking using twitter data. In WWW ’10: Proceedings of the 19th international conference on world wide web, ACM, New York, NY, USA, pp. 331–340, doi:10.1145/1772690.1772725. Dong, A., Zhang, R., Kolari, P., Bai, J., Diaz, F., Chang, Y., Zheng, Z., & Zha, H. (2010). Time is of the essence: Improving recency ranking using twitter data. In WWW ’10: Proceedings of the 19th international conference on world wide web, ACM, New York, NY, USA, pp. 331–340, doi:10.​1145/​1772690.​1772725.
go back to reference Elsas, J. L., & Dumais, S. T. (2010). Leveraging temporal dynamics of document content in relevance ranking. In Proceedings of WSDM’2010. Elsas, J. L., & Dumais, S. T. (2010). Leveraging temporal dynamics of document content in relevance ranking. In Proceedings of WSDM’2010.
go back to reference Eysenbach, G. (2002). Infodemiology: The epidemiology of (mis)information. The American Journal of Medicine, 113(9), 763–765.CrossRef Eysenbach, G. (2002). Infodemiology: The epidemiology of (mis)information. The American Journal of Medicine, 113(9), 763–765.CrossRef
go back to reference Farrington, C. P., Andrews, N. J., Beale, A. D., & Catchpole, M. A. (1996). A statistical algorithm for the early detection of outbreaks of infectious disease. Journal of the Royal Statistical Society Series A (Statistics in Society) 159(3):pp. 547–563, URL http://www.jstor.org/stable/2983331. Farrington, C. P., Andrews, N. J., Beale, A. D., & Catchpole, M. A. (1996). A statistical algorithm for the early detection of outbreaks of infectious disease. Journal of the Royal Statistical Society Series A (Statistics in Society) 159(3):pp. 547–563, URL http://​www.​jstor.​org/​stable/​2983331.
go back to reference Gomide, J., Veloso, A., Meira, W., Almeida, V., Benevenuto, F., Ferraz, F., & Teixeira, M. (2011). Dengue surveillance based on a computational model of spatio-temporal locality of twitter. In Proceedings of ACM WebSci’2011. Gomide, J., Veloso, A., Meira, W., Almeida, V., Benevenuto, F., Ferraz, F., & Teixeira, M. (2011). Dengue surveillance based on a computational model of spatio-temporal locality of twitter. In Proceedings of ACM WebSci’2011.
go back to reference Hoffart, J., Suchanek, F., Berberich, K., & Weikum, G. (2012). Yago2: A spatially and temporally enhanced knowledge base from wikipedia. Special Issue on Wikipedia and Semi-Structured Resources. Artificial Intelligence, 194, 28–61. Hoffart, J., Suchanek, F., Berberich, K., & Weikum, G. (2012). Yago2: A spatially and temporally enhanced knowledge base from wikipedia. Special Issue on Wikipedia and Semi-Structured Resources. Artificial Intelligence, 194, 28–61.
go back to reference Hulth, A., Andrews, N., Ethelberg, S., Dreesman, J., Faensen, D., & van Pelt, W. (2010). Practical usage of computer-supported outbreak detection in five European countries. Robert Koch-Institut. Hulth, A., Andrews, N., Ethelberg, S., Dreesman, J., Faensen, D., & van Pelt, W. (2010). Practical usage of computer-supported outbreak detection in five European countries. Robert Koch-Institut.
go back to reference Jatowt, A., Kawai, Y., & Tanaka, K. (2005). Temporal ranking of search engine results. In Proceedings of WISE. Jatowt, A., Kawai, Y., & Tanaka, K. (2005). Temporal ranking of search engine results. In Proceedings of WISE.
go back to reference Kamilaris, A., Taliadoros, G., Pitsillides, A., & Papadiomidous, D. (2012). The practice of online social networking of the physical world. International Journal of Space-Based and Situated Computing, 2(4), 240–252.CrossRef Kamilaris, A., Taliadoros, G., Pitsillides, A., & Papadiomidous, D. (2012). The practice of online social networking of the physical world. International Journal of Space-Based and Situated Computing, 2(4), 240–252.CrossRef
go back to reference Kanhabua, N., Blanco, R., & Matthews, M. (2011). Ranking related news predictions. In Proceeding of SIGIR’2011. Kanhabua, N., Blanco, R., & Matthews, M. (2011). Ranking related news predictions. In Proceeding of SIGIR’2011.
go back to reference Kanhabua, N., Romano, S., Stewart, A., & Nejdl, W. (2012). Supporting temporal analytics for health-related events in microblogs. In Proceedings of the 21st ACM international conference on information and knowledge management, ACM, New York, NY, USA, CIKM ’12, pp. 2686–2688, doi:10.1145/2396761.2398726. Kanhabua, N., Romano, S., Stewart, A., & Nejdl, W. (2012). Supporting temporal analytics for health-related events in microblogs. In Proceedings of the 21st ACM international conference on information and knowledge management, ACM, New York, NY, USA, CIKM ’12, pp. 2686–2688, doi:10.​1145/​2396761.​2398726.
go back to reference Khan, S. A. (2007). Handbook of biosurveillance, M.M. Wagner, A.W. Moore, R.M. Aryel (Eds.). Elsevier Inc. ISBN-13: 978-0-12-369378-5. Journal of Biomedical Informatics, 40, 380–381.CrossRef Khan, S. A. (2007). Handbook of biosurveillance, M.M. Wagner, A.W. Moore, R.M. Aryel (Eds.). Elsevier Inc. ISBN-13: 978-0-12-369378-5. Journal of Biomedical Informatics, 40, 380–381.CrossRef
go back to reference Kulkarni, A., Teevan, J., Svore, K. M., & Dumais, S. T. (2011). Understanding temporal query dynamics. In Proceedings of WSDM’2011. Kulkarni, A., Teevan, J., Svore, K. M., & Dumais, S. T. (2011). Understanding temporal query dynamics. In Proceedings of WSDM’2011.
go back to reference Lampos, V., & Cristianini, N. (2010). Tracking the flu pandemic by monitoring the social web. In 2010 2nd international workshop on cognitive information processing (CIP). Lampos, V., & Cristianini, N. (2010). Tracking the flu pandemic by monitoring the social web. In 2010 2nd international workshop on cognitive information processing (CIP).
go back to reference Lampos, V., Bie, T. D., & Cristianini, N. (2010). Flu detector tracking epidemics on twitter. In ECML PKDD 2010. Lampos, V., Bie, T. D., & Cristianini, N. (2010). Flu detector tracking epidemics on twitter. In ECML PKDD 2010.
go back to reference Lee, K., Agrawal, A., & Choudhary, A. (2013). Real-time disease surveillance using twitter data: Demonstration on flu and cancer. In Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, New York, NY, USA, KDD ’13, pp. 1474–1477. Lee, K., Agrawal, A., & Choudhary, A. (2013). Real-time disease surveillance using twitter data: Demonstration on flu and cancer. In Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, New York, NY, USA, KDD ’13, pp. 1474–1477.
go back to reference Li, X., & Croft, W. B. (2003). Time-based language models. In Proceedings of CIKM’2003. Li, X., & Croft, W. B. (2003). Time-based language models. In Proceedings of CIKM’2003.
go back to reference Lumezanu, C., Feamster, N., & Klein, H. (2012). #bias: Measuring the tweeting behavior of propagandists. In Proceedings of the sixth international conference on weblogs and social media, ICWSM ’12. Lumezanu, C., Feamster, N., & Klein, H. (2012). #bias: Measuring the tweeting behavior of propagandists. In Proceedings of the sixth international conference on weblogs and social media, ICWSM ’12.
go back to reference Manning, C. D., Raghavan, P., & Schütze, H. (2008). Introduction to information retrieval. Cambridge University Press, New York. Manning, C. D., Raghavan, P., & Schütze, H. (2008). Introduction to information retrieval. Cambridge University Press, New York.
go back to reference Metzler, D., Jones, R., Peng, F., & Zhang, R. (2009). Improving search relevance for implicitly temporal queries. In Proceedings of SIGIR’2009. Metzler, D., Jones, R., Peng, F., & Zhang, R. (2009). Improving search relevance for implicitly temporal queries. In Proceedings of SIGIR’2009.
go back to reference Milinovich, G. J., Williams, G. M., Clements, A. C., & Hu, W. (2014). Internet-based surveillance systems for monitoring emerging infectious diseases. The Lancet infectious diseases, 14(2), 160–168.CrossRef Milinovich, G. J., Williams, G. M., Clements, A. C., & Hu, W. (2014). Internet-based surveillance systems for monitoring emerging infectious diseases. The Lancet infectious diseases, 14(2), 160–168.CrossRef
go back to reference Neill, D. B. (2012). New directions in artificial intelligence for public health surveillance. IEEE Intelligent Systems, 27(1), 56–59. Neill, D. B. (2012). New directions in artificial intelligence for public health surveillance. IEEE Intelligent Systems, 27(1), 56–59.
go back to reference Nishino, H., Goto, R., Fukakusa, Y., Lin, J., Kagawa, T., Yoshida, K., et al. (2013). A touch screen interface design with tactile feedback for practical applications. International Journal of Space-Based and Situated Computing, 3(1), 8–21.CrossRef Nishino, H., Goto, R., Fukakusa, Y., Lin, J., Kagawa, T., Yoshida, K., et al. (2013). A touch screen interface design with tactile feedback for practical applications. International Journal of Space-Based and Situated Computing, 3(1), 8–21.CrossRef
go back to reference Paul, M., & Dredze, M. (2011). You are what you tweet: Analyzing twitter for public health. In Proceedings of the fifth international conference on weblogs and social media, ICWSM ’11. Paul, M., & Dredze, M. (2011). You are what you tweet: Analyzing twitter for public health. In Proceedings of the fifth international conference on weblogs and social media, ICWSM ’11.
go back to reference Paul, M. J., & Dredze, M. (2012). A model for mining public health topics from twitter. Health, 11, 16–6. Paul, M. J., & Dredze, M. (2012). A model for mining public health topics from twitter. Health, 11, 16–6.
go back to reference Romano, S., Di Martino, S., Kanhabua, N., Mazzeo, A., & Nejdl, W. (2016). Challenges in detecting epidemic outbreaks from social networks. In 2016 30th international conference on advanced information networking and applications workshops (WAINA), IEEE, pp. 69–74. Romano, S., Di Martino, S., Kanhabua, N., Mazzeo, A., & Nejdl, W. (2016). Challenges in detecting epidemic outbreaks from social networks. In 2016 30th international conference on advanced information networking and applications workshops (WAINA), IEEE, pp. 69–74.
go back to reference Shokouhi, M. (2011), Detecting seasonal queries by time-series analysis. In Proceeding of SIGIR’2011. Shokouhi, M. (2011), Detecting seasonal queries by time-series analysis. In Proceeding of SIGIR’2011.
go back to reference Strötgen, J., & Gertz, M. (2010). Heideltime: High quality rule-based extraction and normalization of temporal expressions. In Proceedings of the 5th international workshop on semantic evaluation (SemEval ’10). Strötgen, J., & Gertz, M. (2010). Heideltime: High quality rule-based extraction and normalization of temporal expressions. In Proceedings of the 5th international workshop on semantic evaluation (SemEval ’10).
go back to reference Strötgen, J., Gertz, M., & Junghans, C. (2011). An event-centric model for multilingual document similarity. In Proceeding of SIGIR’2011. Strötgen, J., Gertz, M., & Junghans, C. (2011). An event-centric model for multilingual document similarity. In Proceeding of SIGIR’2011.
go back to reference Strötgen, J., Alonso, O., & Gertz, M. (2012). Identification of top relevant temporal expressions in documents. In Proceeding of the 2nd temporal web analytics workshop (TempWeb02). Strötgen, J., Alonso, O., & Gertz, M. (2012). Identification of top relevant temporal expressions in documents. In Proceeding of the 2nd temporal web analytics workshop (TempWeb02).
go back to reference Szomszor, M., Kostkova, P., & de Quincey, E. (2010). #swineflu: Twitter predicts swine flu outbreak in 2009. In Proceedings of eHealth’2010. Szomszor, M., Kostkova, P., & de Quincey, E. (2010). #swineflu: Twitter predicts swine flu outbreak in 2009. In Proceedings of eHealth’2010.
go back to reference Velardi, P., Stilo, G., Tozzi, A. E., & Gesualdo, F. (2014). Twitter mining for fine-grained syndromic surveillance. Artificial Intelligence in Medicine, 61(3), 153–163.CrossRef Velardi, P., Stilo, G., Tozzi, A. E., & Gesualdo, F. (2014). Twitter mining for fine-grained syndromic surveillance. Artificial Intelligence in Medicine, 61(3), 153–163.CrossRef
Metadata
Title
Towards Exploiting Social Networks for Detecting Epidemic Outbreaks
Authors
Sergio Di Martino
Sara Romano
Michela Bertolotto
Nattiya Kanhabua
Antonino Mazzeo
Wolfgang Nejdl
Publication date
11-01-2017
Publisher
Springer India
Published in
Global Journal of Flexible Systems Management / Issue 1/2017
Print ISSN: 0972-2696
Electronic ISSN: 0974-0198
DOI
https://doi.org/10.1007/s40171-016-0148-y

Other articles of this Issue 1/2017

Global Journal of Flexible Systems Management 1/2017 Go to the issue