Naren Ramakrishnan
Chang Tien Lu
ABSTRACT
We describe the design, implementation, and evaluation of EMBERS, an automated, 24x7 continuous system for forecasting civil unrest across 10 countries of Latin America using open source indicators such as tweets, news sources, blogs, economic indicators, and other data sources. Unlike retrospective studies, EMBERS has been making forecasts into the future since Nov 2012 which have been (and continue to be) evaluated by an independent T&E team (MITRE). Of note, EMBERS has successfully forecast the June 2013 protests in Brazil and Feb 2014 violent protests in Venezuela. We outline the system architecture of EMBERS, individual models that leverage specific data sources, and a fusion and suppression engine that supports trading off specific evaluation criteria. EMBERS also provides an audit trail interface that enables the investigation of why specific predictions were made along with the data utilized for forecasting. Through numerous evaluations, we demonstrate the superiority of EMBERS over baserate methods and its capability to forecast significant societal happenings.
Supplemental Material
- R. Baeza-Yates. Searching the future. In SIGIR Workshop on Mathematical/Formal Methods in Information Retrieval, 2005.Google Scholar
- H. Becker, D. Iter, M. Naaman, and L. Gravano. Identifying content for planned events across social media sites. In WSDM, 2012. Google ScholarDigital Library
- J. M. Box-Steffensmeier and B. S. Jones. Event History Modeling: A Guide for Social Scientists. Cambridge University press, 2004. Google ScholarDigital Library
- D. Braha. Global civil unrest: contagion, self-organization, and prediction. PLoS One, 7(10), Jan. 2012.Google Scholar
- P. T. Brandt, J. R. Freeman, and P. A. Schrodt. Real time, time series forecasting of inter-and intra-state political conflict. Conflict Management and Peace Science, 28(1), 2011.Google Scholar
- M. Broecheler, L. Mihalkova, and L. Getoor. Probabilistic similarity logic. In UAI, 2010.Google Scholar
- G. Dias, R. Campos, and A. Jorge. Future retrieval: What does the future talk about. In SIGIR Workshop on Enriching Information Retrieval, 2011.Google Scholar
- S. González-Bailón, J. Borge-Holthoefer, A. Rivero, and Y. Moreno. The dynamics of protest recruitment through an online network. Sci. Rep., 1, 2011.Google Scholar
- T. Hua, C.-T. Lu, N. Ramakrishnan, F. Chen, J. Arredondo, D. Mares, and K. Summers. Analyzing Civil Unrest through Social Media. Computer, 2013. Google ScholarDigital Library
- N. Kallus. Predicting crowd behavior with big public data. In WWW, 2014. Google ScholarDigital Library
- K. Leetaru and P. Schrodt. GDELT: Global data on events, location, and tone. ISA Annual Convention, 2013.Google Scholar
- K. H. Leetaru. Culturomics 2.0: Forecasting large-scale human behavior using global news media tone in time and space. First Monday, 16, 2011.Google Scholar
- H. Llorens, L. Derczynski, R. J. Gaizauskas, and E. Saquete. TIMEN: An open temporal expression normalisation resource. In LREC, 2012.Google Scholar
- F. Malucelli, T. Ottmann, and D. Pretolani. Efficient labelling algorithms for the maximum noncrossing matching problem. Discrete Applied Mathematics, 47(2), 1993. Google ScholarDigital Library
- S. P. O'Brien. Crisis Early Warning and Decision Support: Contemporary Approaches and Thoughts on Future Research. Int. Stud. Rev., 12(1), Mar. 2010.Google Scholar
- A. Ritter, O. Etzioni, and S. Clark. Open domain event extraction from twitter. In SIGKDD, 2012. Google ScholarDigital Library
- P. A. Schrodt. Automated production of high-volume, near-real-time political event data. In American Political Science Association meetings, 2010.Google Scholar
- R. Tibshirani. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B, 58, 1996.Google Scholar
- H. Tops, A. van den Bosch, and F. Kunneman. Predicting time-to-event from twitter messages. In BNAIC, 2013.Google Scholar
Index Terms
- 'Beating the news' with EMBERS: forecasting civil unrest using open source indicators
Recommendations
EMBERS at 4 years: Experiences operating an Open Source Indicators Forecasting System
KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data MiningEMBERS is an anticipatory intelligence system forecasting population-level events in multiple countries of Latin America. A deployed system from 2012, EMBERS has been generating alerts 24x7 by ingesting a broad range of data sources including news, ...
Civil Unrest Event Forecasting Using Graphical and Sequential Neural Networks
Artificial Neural Networks and Machine Learning – ICANN 2021AbstractHaving the ability to forecast civil unrest events, such as violent protests, is crucial because they can lead to severe violent conflict and social instabilities. Civil unrests are comprehensive consequences of multiple factors, which could be ...
Comments