Top

International Journal on Digital Libraries

Published in:

09-10-2021

Unified approach to retrospective event detection for event- based epidemic intelligence

Author: Marco Fisichella

Published in: International Journal on Digital Libraries | Issue 4/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Inferring the magnitude and occurrence of real-world events from natural language text is a crucial task in various domains. Particularly in the domain of public health, the state-of-the-art document and token centric event detection approaches have not kept the pace with the growing need for more robust event detection in public health. In this paper, we propose UPHED, a unified approach, which combines both the document and token centric event detection techniques in an unsupervised manner such that events which are: rare (aperiodic); reoccurring (periodic) can be detected using a generative model for the domain of public health. We evaluate the efficiency of our approach as well as its effectiveness for two real-world case studies with respect to the quality of document clusters. Our results show that we are able to achieve a precision of 60% and a recall of 71% analyzed using manually annotated real-world data. Finally, we also make a comparative analysis of our work with the well-established rule-based system of MedISys and find that UPHED can be used in a cooperative way with MedISys to not only detect similar anomalies, but can also deliver more information about the specific outbreak of reported diseases.

previous article What is all this new MeSH about?

next article Improving data quality in large-scale repositories through conflict resolution

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

sklearn.multiclass.OneVsRestClassifier.

http://wiki.dbpedia.org.

https://en.wikipedia.org/wiki/Portal:Current_events.

http://mmtx.nlm.nih.gov.

http://www.opencalais.com.

https://ec.europa.eu/jrc/en/about/jrc-site/ispra.

https://allenai.github.io/scispacy/.

Al Tamime, R., Giordano, R., Hall, W.: Observing burstiness in wikipedia articles during new disease outbreaks. In: Proceedings of the 10th ACM Conference on Web Science, WebSci ’18, pp. 117–126. Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3201064.3201080

Arsevska, E., Valentin, S., Rabatel, J., de Goër de Hervé, J., Falala, S., Lancelot, R., Roche, M.: Web monitoring of emerging animal infectious diseases integrated in the french animal health epidemic intelligence system. PLOS ONE 13(8), 1–25 (2018). https://doi.org/10.1371/journal.pone.0199960

Banerjee, A., Dhillon, I.S., Ghosh, J., Sra, S.: Generative model-based clustering of directional data. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) (2003)

Brants, T., Chen, F., Farahat, A.: A System for new event detection. In: In SIGIR, pp. 330–337. ACM, New York, NY, USA (2003). https://doi.org/10.1145/860435.860495

Burchard, L., Schroeder, D.T., Becker, S., Langguth, J.: Resource efficient algorithms for message sampling in online social networks. In: 2020 Seventh International Conference on Social Networks Analysis, Management and Security (SNAMS), pp. 1–8 (2020). https://doi.org/10.1109/SNAMS52053.2020.9336530

Ceroni, A., Fisichella, M.: Towards an entity-based automatic event validation. In: de Rijke, M., Kenter, T., de Vries, A.P., Zhai, C., de Jong, F., Radinsky, K., Hofmann, K. (eds.) Advances in Information Retrieval, pp. 605–611. Springer, Cham (2014)CrossRef

Ceroni, A., Gadiraju, U., Fisichella, M.: Justevents: a crowdsourced corpus for event validation with strict temporal constraints. In: Jose, J.M., Hauff, C., Altıngovde, I.S., Song, D., Albakour, D., Watt, S., Tait, J. (eds.) Advances in Information Retrieval, pp. 484–492. Springer, Cham (2017)CrossRef

Ceroni, A., Gadiraju, U., Matschke, J., Wingert, S., Fisichella, M.: Where the event lies: predicting event occurrence in textual documents. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’16, p. 1157–1160. Association for Computing Machinery, New York, NY, USA (2016). https://doi.org/10.1145/2911451.2911452

Ceroni, A., Gadiraju, U.K., Fisichella, M.: Improving event detection by automatically assessing validity of event occurrence in text. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, CIKM ’15, pp. 1815–1818. Association for Computing Machinery, New York, NY, USA (2015). https://doi.org/10.1145/2806416.2806624

10.

Chen, N., Zhong, Z., Pang, J.: An exploratory study of Covid-19 information on twitter in the greater region. Big Data Cogn. Comput. 5(1), 5 (2021). https://doi.org/10.3390/bdcc5010005CrossRef

11.

Cinti, S., Huff, A.G., Breit, N., Allen, T., Whiting, K., Kiley, C.: Evaluation and verification of the global rapid identification of threats system for infectious diseases in textual data sources. Interdiscip. Perspect. Infect. Dis. 2016, 5080746 (2016). https://doi.org/10.1155/2016/5080746CrossRef

12.

Conway, M., Collier, N., Doan, S.: Using hedges to enhance a disease outbreak report text mining system. In: BioNLP ’09: Proceedings of the Workshop on BioNLP, pp. 142–143. Association for Computational Linguistics, Morristown, NJ, USA (2009)

13.

Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. 39(1), 1–38 (1977)MathSciNetMATH

14.

Detection, T., project, T.T.: https://www.nist.gov/publications/topic-detection-and-tracking-evaluation-overview

15.

Doan, S., Kawazoe, A., Conway, M., Collier, N.: Towards role-based filtering of disease outbreak reports. J. Biomed. Inform. (2008). https://doi.org/10.1016/j.jbi.2008.12.009CrossRef

16.

Fisichella, M., Ceroni, A.: Event detection in Wikipedia edit history improved by documents web based automatic assessment. Big Data Cogn. Comput. 5(3), 34 (2021). https://doi.org/10.3390/bdcc5030034CrossRef

17.

Fisichella, M., Stewart, A., Cuzzocrea, A., Denecke, K.: Detecting health events on the social web to enable epidemic intelligence. In: SPIRE, pp. 87–103 (2011)

18.

Fung, G.P.C., Yu, J.X., Yu, P.S., Lu, H.: Parameter free bursty events detection in text streams. In: VLDB ’05: Proceedings of the 31st international conference on Very large data bases, pp. 181–192. VLDB Endowment (2005)

19.

Hartley, D., et al.: The landscape of international event-based biosurveillance. Emerg. Health Threats 3, 7096 (2010)CrossRef

20.

He, Q., Chang, K., Lim, E.P.: Analyzing feature trajectories for event detection. In: SIGIR, pp. 207–214 (2007)

21.

He, Q., Chang, K., Lim, E.P.: Using burstiness to improve clustering of topics in news streams. In: Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, ICDM ’07, pp. 493–498. IEEE Computer Society, Washington, DC, USA (2007). https://doi.org/10.1109/ICDM.2007.17

22.

He, Q., Chang, K., Lim, E.P., Banerjee, A.: Keep it simple with time: a reexamination of probabilistic topic detection models. IEEE Trans. Pattern Anal. Mach. Intell. 32(10), 1795–1808 (2010). https://doi.org/10.1109/TPAMI.2009.203CrossRef

23.

He, Q., Chang, K., Lim, E.P., Zhang, J.: Bursty feature representation for clustering text streams. In: Proceedings of the 2007 SIAM International Conference on Data Mining, pp. 491–496 (2007)

24.

Hoffart, J., Suchanek, F., Berberich, K., Weikum, G.: Yago2: a spatially and temporally enhanced knowledge base from Wikipedia. Artif. Intell. 194, 28–61 (2012)MathSciNetCrossRef

25.

Hofmann, T.: Probabilistic latent semantic analysis. In: UAI, pp. 289–296 (1999)

26.

Keller, M., Blench, M., Tolentino, H., et al.: Use of unstructured event-based reports for global infectious disease surveillance. Emerg. Infect. Dis. 15(5), 689 (2009)CrossRef

27.

Kuzey, E., Vreeken, J., Weikum, G.: A fresh look on knowledge bases: distilling named events from news. In: CIKM ’14 (2014)

28.

Lejeune, G., Brixtel, R., Doucet, A., Lucas, N.: Daniel: Language independent character-based news surveillance. In: Isahara, H., Kanzaki, K. (eds.) Advances in Natural Language Processing, pp. 64–75. Springer, Berlin (2012)CrossRef

29.

Lejeune, G., Brixtel, R., Doucet, A., Lucas, N.: Multilingual event extraction for epidemic detection. Artif. Intell. Med. 65(2), 131–143 (2015). https://doi.org/10.1016/j.artmed.2015.06.005CrossRef

30.

Li, Z., Wang, B., Li, M., Ma, W.Y.: A probabilistic model for retrospective news event detection. In: SIGIR (2005)

31.

Linge, J., Steinberger, R., Fuart, F., Bucci, S., Belyaeva, J., Gemo, M.: Medisys: medical information system. In: Asimakopoulou, Eleana, Bessis, Nik (eds.) Advanced ICTs for Disaster Management and Threat Detection: Collaborative and Distributed Frameworks, pp. 131–142. IGI Global, Hershey (2010)CrossRef

32.

Linge, J.P., Mantero, J., Fuart, F., Belyaeva, J., Atkinson, M., van der Goot, E.: Tracking media reports on the shiga toxin-producing Escherichia coli. In: In Proceedings of the Electronic Healthcare International Conference (eHealth). Springer (2011)

33.

Mutuvi, S., Boros, E., Doucet, A., Jatowt, A., Lejeune, G., Odeo, M.: Multilingual epidemiological text classification: a comparative study. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 6172–6183. International Committee on Computational Linguistics, Barcelona, Spain (2020). https://doi.org/10.18653/v1/2020.coling-main.543

34.

Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.: Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39, 103–134 (2000). https://doi.org/10.1023/A:1007692713085CrossRefMATH

35.

Paquet, C., Coulombier, D., Kaiser, R., Ciotti, M.: Epidemic intelligence: a new framework for strengthening disease surveillance in Europe. Euro Surveill. 11(12), 212–214 (2006)CrossRef

36.

Paul, M.J., Dredze, M.: You are what you tweet: analyzing twitter for public health. Artif. Intell. I, 265–272 (2011)

37.

Rao, D., Paul, M., Fink, C., Yarowsky, D., Oates, T., Coppersmith, G.: Hierarchical Bayesian models for latent attribute detection in social media. In: ICWSM (2011)

38.

Smailhodzic, E., Hooijsma, W., Boonstra, A., Langley, D.J.: Social media use in healthcare: a systematic review of effects on patients and on their relationship with healthcare professionals. BMC Health Serv. Res. 16(1), 442 (2016). https://doi.org/10.1186/s12913-016-1691-0CrossRef

39.

Steinberger, R., Fuart, F., van der Groot, E., Best, C., von Etter, P., Yangarber, R.: Text mining from the web for medical intelligence. Min. Massive Data Sets Secur. 19, 295–310 (2008)

40.

Stewart, A., Fisichella, M., Denecke, K.: Detecting public health indicators from the web for epidemic intelligence. In: eHealth, pp. 10–17 (2010)

41.

Stewart, A., Smith, M., Nejdl, W.: A transfer approach to detecting disease reporting events in blog social media. In: Proceedings of the 22nd ACM Conference on Hypertext and Hypermedia, HT ’11, pp. 271–280. ACM, New York, NY, USA (2011). https://doi.org/10.1145/1995966.1996001

42.

Steyvers, M., Griffiths, T.: Probabilistic Topic Models. Lawrence Erlbaum Associates, Mahwah (2007)

43.

Ullah, I., Khan, S., Imran, M., Lee, Y.K.: Rweetminer: automatic identification and categorization of help requests on twitter during disasters. Expert Syst. Appl. 176, 114787 (2021). https://doi.org/10.1016/j.eswa.2021.114787

44.

Vlachos, M.: Identifying similarities, periodicities and bursts for online search queries. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 131–142. ACM Press (2004)

45.

Xu, G., Meng, Y., Zhou, X., Yu, Z., Wu, X., Zhang, L.: Chinese event detection based on multi-feature fusion and BiLSTM. IEEE Access 7, 134992–135004 (2019). https://doi.org/10.1109/ACCESS.2019.2941653CrossRef

46.

Yang, Y., Pierce, T., Carbonell, J.: A study of retrospective and on-line event detection. In: SIGIR ’98: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 28–36. ACM, New York, NY, USA (1998). https://doi.org/10.1145/290941.290953

47.

Yangarber, R.: Verification of facts across document boundaries. In: Proceedings International Workshop on Intelligent Information Access (2006)

48.

Zhan, L., Jiang, X.: Survey on event extraction technology in information extraction research area. In: 2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), pp. 2121–2126 (2019). https://doi.org/10.1109/ITNEC.2019.8729158

49.

Zhang, D., Zhai, C., Han, J., Srivastava, A., Oza, N.: Topic modeling for OLAP on multidimensional text databases: topic cube and its applications. Stat. Anal. Data Min. 2(5–6), 378–395 (2009). https://doi.org/10.1002/sam.v2:5/6MathSciNetCrossRef

50.

Zhang, Y.: Automatic extraction of outbreak information from news. Ph.D. thesis, University of Illinois (2008)

Title: Unified approach to retrospective event detection for event- based epidemic intelligence
Author: Marco Fisichella
Publication date: 09-10-2021
Publisher: Springer Berlin Heidelberg
Published in: International Journal on Digital Libraries / Issue 4/2021
Print ISSN: 1432-5012
Electronic ISSN: 1432-1300
DOI: https://doi.org/10.1007/s00799-021-00308-9

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner