Skip to main content
Top
Published in: Quality & Quantity 2/2020

15-05-2019

Comparing supervised learning algorithms and artificial neural networks for conflict prediction: performance and applicability of deep learning in the field

Author: Felix Ettensperger

Published in: Quality & Quantity | Issue 2/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Machine learning algorithms and artificial neural networks promise a new and powerful approach for making better and more transferable predictions in global conflict research. In this paper, a novel conflict dataset for the prediction of conflict intensity is introduced. It includes seven socio-economic and political indicators spanning a set of 851 country-years. This set of indicators is combined with conflict intensity data covering the timeframe of 2009–2015 to build a viable predictor framework. With this dataset as a foundation, a wide range of different predictive methods are tested, including linear discriminant analysis, classification and regression trees, k-nearest neighbor, random forest and several series of advanced artificial neural networks including a novel non-sequential long-short-term memory setup. Acknowledging the potential of deep learning techniques for many disciplines and projects, this paper shows, that for this type of assembled medium sized data, resembling many common research frameworks in Social and Political Sciences, using neural networks as singular approach might not be fruitful. The advantages of neural networks do not always outweigh their practical and technical disadvantages in small or medium data settings. The argument derived from this study is that researchers should combine Supervised Learning Algorithms and Deep Learning Networks as a general approach in similar predictive setups, or carefully evaluate for each dataset and project if the added complexity accompanied with using networks is indeed translating into better predictive performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Alpaydin, E.: Introduction to Machine Learning. MIT Press, Cambridge (2004) Alpaydin, E.: Introduction to Machine Learning. MIT Press, Cambridge (2004)
go back to reference Amit, Y., Geman, D.: Shape quantization and recognition with randomized trees. Neural Comput. 9, 1545–1588 (1997)CrossRef Amit, Y., Geman, D.: Shape quantization and recognition with randomized trees. Neural Comput. 9, 1545–1588 (1997)CrossRef
go back to reference Beck, N., King, G., Zeng, L.: Improving quantitative studies of international conflict: a conjecture. Am. Political Sci. Rev. 94, 21–35 (2000)CrossRef Beck, N., King, G., Zeng, L.: Improving quantitative studies of international conflict: a conjecture. Am. Political Sci. Rev. 94, 21–35 (2000)CrossRef
go back to reference Benitez, J.M., Castro, J.L., Requena, I.: Are artificial neural networks black boxes? IEEE Trans. Neural Netw. 8, 1156–1164 (1997)CrossRef Benitez, J.M., Castro, J.L., Requena, I.: Are artificial neural networks black boxes? IEEE Trans. Neural Netw. 8, 1156–1164 (1997)CrossRef
go back to reference Bishop, C.M.: Pattern recognition and machine learning. Springer, Singapore (2006) Bishop, C.M.: Pattern recognition and machine learning. Springer, Singapore (2006)
go back to reference Breiman, L.: Bagging predictors. Mach. Learn. 26, 123–140 (1996) Breiman, L.: Bagging predictors. Mach. Learn. 26, 123–140 (1996)
go back to reference Breiman, L.: Heuristics of instability in model selection (Technical Report). University of California at Berkeley, Statistics Department, Berkeley (1994) Breiman, L.: Heuristics of instability in model selection (Technical Report). University of California at Berkeley, Statistics Department, Berkeley (1994)
go back to reference Caruana, R., Niculescu-Mizil, A., 2006. An Empirical Comparison of Supervised Learning Algorithms, in: Proceedings of the 23rd International Conference on Machine Learning. Presented at the ACM, Pittsburgh Caruana, R., Niculescu-Mizil, A., 2006. An Empirical Comparison of Supervised Learning Algorithms, in: Proceedings of the 23rd International Conference on Machine Learning. Presented at the ACM, Pittsburgh
go back to reference Cederman, L.-E., Weidmann, N.B.: Predicting armed conflict: time to adjust our expectations? Science 355, 474–476 (2017)CrossRef Cederman, L.-E., Weidmann, N.B.: Predicting armed conflict: time to adjust our expectations? Science 355, 474–476 (2017)CrossRef
go back to reference Chadefaux, T.: Conflict forecasting and its limits. Data Science 1, 7–17 (2017)CrossRef Chadefaux, T.: Conflict forecasting and its limits. Data Science 1, 7–17 (2017)CrossRef
go back to reference Chopra, C., Sinha, S., Jaroli, S., Shukla, A., Maheshwari, S.: Recurrent neural networks with non-sequential data to predict hospital readmission of diabetic patients. In: Proceedings of ICCBB. Presented at the International Conference on Computational Biology and Bioinformatics. pp. 18–23. Newark, NJ (2017) Chopra, C., Sinha, S., Jaroli, S., Shukla, A., Maheshwari, S.: Recurrent neural networks with non-sequential data to predict hospital readmission of diabetic patients. In: Proceedings of ICCBB. Presented at the International Conference on Computational Biology and Bioinformatics. pp. 18–23. Newark, NJ (2017)
go back to reference Colaresi, M., Mahmood, Z.: Do the robot: lessons from machine learning to improve conflict forecasting. J. Peace Res. 54, 193–214 (2017)CrossRef Colaresi, M., Mahmood, Z.: Do the robot: lessons from machine learning to improve conflict forecasting. J. Peace Res. 54, 193–214 (2017)CrossRef
go back to reference Collier, P., Hoeffler, A.: On the economic causes of civil war. Oxford Econ. Papers 50, 563–573 (1998)CrossRef Collier, P., Hoeffler, A.: On the economic causes of civil war. Oxford Econ. Papers 50, 563–573 (1998)CrossRef
go back to reference Collier, P., Hoeffler, A.: Greed and grievance in civil war. Oxford Econ. Papers 56, 563–595 (2004)CrossRef Collier, P., Hoeffler, A.: Greed and grievance in civil war. Oxford Econ. Papers 56, 563–595 (2004)CrossRef
go back to reference Collier, P., Hoeffler, A.: Resource rents, governance, and conflict. J. Conflict Resolut. 49, 625–633 (2005)CrossRef Collier, P., Hoeffler, A.: Resource rents, governance, and conflict. J. Conflict Resolut. 49, 625–633 (2005)CrossRef
go back to reference Cramer, C.: Does inequality cause conflict? J. Int. Dev. 15, 397–412 (2003)CrossRef Cramer, C.: Does inequality cause conflict? J. Int. Dev. 15, 397–412 (2003)CrossRef
go back to reference Cutler, A., Cutler, R., Stevens, J.R.: Random Forests. In: Zhang, C., Ma, Y. (eds.) Ensemble Machine Learning, pp. 157–175. Springer, Boston (2012)CrossRef Cutler, A., Cutler, R., Stevens, J.R.: Random Forests. In: Zhang, C., Ma, Y. (eds.) Ensemble Machine Learning, pp. 157–175. Springer, Boston (2012)CrossRef
go back to reference Dorussen, H.: Balance of power revisited: a multi-country model of trade and conflict. J. Peace Res. 36, 443–462 (1999)CrossRef Dorussen, H.: Balance of power revisited: a multi-country model of trade and conflict. J. Peace Res. 36, 443–462 (1999)CrossRef
go back to reference Dreher, A.: Does globalization affect growth? Evidence from a new index of globalization. Appl. Econ. 38, 1091–1110 (2006)CrossRef Dreher, A.: Does globalization affect growth? Evidence from a new index of globalization. Appl. Econ. 38, 1091–1110 (2006)CrossRef
go back to reference Ek, R., Karadawi, A.: Implications of refugee flows on political stability in the Sudan. Environ. Secur 20, 196–203 (1991) Ek, R., Karadawi, A.: Implications of refugee flows on political stability in the Sudan. Environ. Secur 20, 196–203 (1991)
go back to reference Fearon, J.D., Laitin, D.D.: Ethnicity, insurgency, and civil war. Am. Political Sci. Rev. 97, 75–90 (2003)CrossRef Fearon, J.D., Laitin, D.D.: Ethnicity, insurgency, and civil war. Am. Political Sci. Rev. 97, 75–90 (2003)CrossRef
go back to reference Feder, D.R.: Political instability, refugees, and a health care crisis in Malawi. East Afr. Geogr. Rev. 20, 47–57 (1998) Feder, D.R.: Political instability, refugees, and a health care crisis in Malawi. East Afr. Geogr. Rev. 20, 47–57 (1998)
go back to reference FFP: Fragile States Index and Cast Framework Methodology (Technical Report). Fund for Peace, Washington, D.C. (2017) FFP: Fragile States Index and Cast Framework Methodology (Technical Report). Fund for Peace, Washington, D.C. (2017)
go back to reference Gohdes, A.R., Carey, S.C.: Canaries in a coal-mine? What the killings of journalists tell us about future repression. J. Peace Res. 54, 157–174 (2017)CrossRef Gohdes, A.R., Carey, S.C.: Canaries in a coal-mine? What the killings of journalists tell us about future repression. J. Peace Res. 54, 157–174 (2017)CrossRef
go back to reference Goldstone, J.A., Bates, R.H., Epstein, D.L., Gurr, T.R., Lustik, M.B., Marshall, M.G., Ulfelder, J., Woodward, M.: A global model for forecasting political instability. Am. J. Political Sci. 54, 190–208 (2010)CrossRef Goldstone, J.A., Bates, R.H., Epstein, D.L., Gurr, T.R., Lustik, M.B., Marshall, M.G., Ulfelder, J., Woodward, M.: A global model for forecasting political instability. Am. J. Political Sci. 54, 190–208 (2010)CrossRef
go back to reference Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016) Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)
go back to reference Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer, New York (2009)CrossRef Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer, New York (2009)CrossRef
go back to reference Hegre, H.: Trade decreases conflict more in multi-actor systems: a comment on Dorussen. J. Peace Res. 39, 109–114 (2002)CrossRef Hegre, H.: Trade decreases conflict more in multi-actor systems: a comment on Dorussen. J. Peace Res. 39, 109–114 (2002)CrossRef
go back to reference Hegre, H., Buhaug, H., Calvin, K., Nordkvelle, J., Waldhoff, S.T., Gilmore, E.: Forecasting civil conflict along the shared socioeconomic pathways. Environ. Res. Lett. 11(5), 054002 (2016)CrossRef Hegre, H., Buhaug, H., Calvin, K., Nordkvelle, J., Waldhoff, S.T., Gilmore, E.: Forecasting civil conflict along the shared socioeconomic pathways. Environ. Res. Lett. 11(5), 054002 (2016)CrossRef
go back to reference Hegre, H., Sambanis, N.: Sensitivity analysis of empirical results on civil war onset. J. Conflict Resolut. 50, 508–535 (2006)CrossRef Hegre, H., Sambanis, N.: Sensitivity analysis of empirical results on civil war onset. J. Conflict Resolut. 50, 508–535 (2006)CrossRef
go back to reference Ho, T.K.: Random Decision Forests. AT&T Bell Laboratories, Murray Hill (1995) Ho, T.K.: Random Decision Forests. AT&T Bell Laboratories, Murray Hill (1995)
go back to reference Hudson, V.M., Schrodt, P., Whitmer, R.: Discrete sequence rule models as a social science methodology: an exploratory analysis of foreign policy rule enactment within Palestinian-Israeli event data. Foreign Policy Anal. 4, 105–126 (2008)CrossRef Hudson, V.M., Schrodt, P., Whitmer, R.: Discrete sequence rule models as a social science methodology: an exploratory analysis of foreign policy rule enactment within Palestinian-Israeli event data. Foreign Policy Anal. 4, 105–126 (2008)CrossRef
go back to reference King, G., Zeng, L.: Logistic regression in rare events data. Political Anal. 9(2), 137–163 (2001)CrossRef King, G., Zeng, L.: Logistic regression in rare events data. Political Anal. 9(2), 137–163 (2001)CrossRef
go back to reference Kiros, R., Salakhutdinov, R., Zemel, R.: Unifying visual-semantic embeddings with multimodal neural language models (2014). ArXiv arXiv:1411.2539 Kiros, R., Salakhutdinov, R., Zemel, R.: Unifying visual-semantic embeddings with multimodal neural language models (2014). ArXiv arXiv:​1411.​2539
go back to reference Le Billon, P.: Buying peace or fuelling war: the role of corruption in armed conflicts. J. Int. Dev. 15, 413–426 (2003)CrossRef Le Billon, P.: Buying peace or fuelling war: the role of corruption in armed conflicts. J. Int. Dev. 15, 413–426 (2003)CrossRef
go back to reference Muchlinski, D., Siroky, D., He, J., Kocher, M.: Comparing random forest with logistic regression for predicting class-imbalanced civil war onset data. Political Anal. 24, 87–103 (2016)CrossRef Muchlinski, D., Siroky, D., He, J., Kocher, M.: Comparing random forest with logistic regression for predicting class-imbalanced civil war onset data. Political Anal. 24, 87–103 (2016)CrossRef
go back to reference Neudorfer, N.S., Theuerkauf, U.G.: Buying war not peace: the influence of corruption on the risk of ethnic war. Comp. Political. Stud. 47, 1856–1886 (2014)CrossRef Neudorfer, N.S., Theuerkauf, U.G.: Buying war not peace: the influence of corruption on the risk of ethnic war. Comp. Political. Stud. 47, 1856–1886 (2014)CrossRef
go back to reference O’Brien, S.P.: Crisis early warning and decision support: contemporary approaches and thoughts on future research. Int. Stud. Rev. 12, 87–104 (2010)CrossRef O’Brien, S.P.: Crisis early warning and decision support: contemporary approaches and thoughts on future research. Int. Stud. Rev. 12, 87–104 (2010)CrossRef
go back to reference Perry, C.: Machine learning and conflict prediction: a use case. Int. J. Secur. Dev. 2, 1–18 (2013) Perry, C.: Machine learning and conflict prediction: a use case. Int. J. Secur. Dev. 2, 1–18 (2013)
go back to reference Sarkees, M.R., Wayman, F.W., Singer, J.D.: Inter-state, intra-state, and extra-state wars: a comprehensive look at their distribution over time, 1816–1997. Int. Stud. Q. 47, 49–70 (2003)CrossRef Sarkees, M.R., Wayman, F.W., Singer, J.D.: Inter-state, intra-state, and extra-state wars: a comprehensive look at their distribution over time, 1816–1997. Int. Stud. Q. 47, 49–70 (2003)CrossRef
go back to reference Schmeidl, S., Bond, D.: FAST Early Warning and Conflict Prevention: The Strengths and Limitations of (Automated) Event-Data Monitoring to Support Early Warning Analyses. Paper prepared for the annual convention of the International Studies Association. Swiss Peace Foundation, Berne (2000) Schmeidl, S., Bond, D.: FAST Early Warning and Conflict Prevention: The Strengths and Limitations of (Automated) Event-Data Monitoring to Support Early Warning Analyses. Paper prepared for the annual convention of the International Studies Association. Swiss Peace Foundation, Berne (2000)
go back to reference Segal, M.R.: Machine Learning Benchmarks and Random Forest Regression (Technical Report). Center for Bioinformatics & Molecular Biostatistics, San Francisco (2003) Segal, M.R.: Machine Learning Benchmarks and Random Forest Regression (Technical Report). Center for Bioinformatics & Molecular Biostatistics, San Francisco (2003)
go back to reference Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., von der Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M.: Mastering the game of Go with deep neural networks and tree search. Nature 529, 484–489 (2016)CrossRef Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., von der Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M.: Mastering the game of Go with deep neural networks and tree search. Nature 529, 484–489 (2016)CrossRef
go back to reference Smidt, M., Vernaccini, L., Hachemer, P., De Groeve, T.: The Global Conflict Risk Index (GCRI)—Manual for data management and product output (No. Version 5). GCRI (2016) Smidt, M., Vernaccini, L., Hachemer, P., De Groeve, T.: The Global Conflict Risk Index (GCRI)—Manual for data management and product output (No. Version 5). GCRI (2016)
go back to reference Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014) Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)
go back to reference Standaert, S.: Divining the level of corruption: a Bayesian state-space approach. J. Comp. Econ. 43, 782–803 (2015)CrossRef Standaert, S.: Divining the level of corruption: a Bayesian state-space approach. J. Comp. Econ. 43, 782–803 (2015)CrossRef
go back to reference Stekhoven, D.J., Bühlmann, P.: MissForest—nonparametric missing value imputation for mixed-type data (2011). ArXiv arXiv:1105.0828v2 [stat.AP] Stekhoven, D.J., Bühlmann, P.: MissForest—nonparametric missing value imputation for mixed-type data (2011). ArXiv arXiv:​1105.​0828v2 [stat.AP]
go back to reference Stewart, E. (ed.): Horizontal Inequality and Conflict. Palgrave, New York (2008) Stewart, E. (ed.): Horizontal Inequality and Conflict. Palgrave, New York (2008)
go back to reference Vreeland, J.R.: The effect of political regime on civil war: unpacking anocracy. J. Conflict Resolut. 52, 401–425 (2008)CrossRef Vreeland, J.R.: The effect of political regime on civil war: unpacking anocracy. J. Conflict Resolut. 52, 401–425 (2008)CrossRef
go back to reference Ward, M.D., Greenhill, B., Bakke, K.: The perils of policy by p-value: predicting civil conflicts. J. Peace Res. 47, 363–375 (2010)CrossRef Ward, M.D., Greenhill, B., Bakke, K.: The perils of policy by p-value: predicting civil conflicts. J. Peace Res. 47, 363–375 (2010)CrossRef
Metadata
Title
Comparing supervised learning algorithms and artificial neural networks for conflict prediction: performance and applicability of deep learning in the field
Author
Felix Ettensperger
Publication date
15-05-2019
Publisher
Springer Netherlands
Published in
Quality & Quantity / Issue 2/2020
Print ISSN: 0033-5177
Electronic ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-019-00882-w

Other articles of this Issue 2/2020

Quality & Quantity 2/2020 Go to the issue