Skip to main content
Erschienen in: Social Indicators Research 1/2013

01.01.2013

Aggregating Political Dimensions: Of the Feasibility of Political Indicators

verfasst von: Francisco Gutiérrez Sanín, Diana Buitrago, Andrea González

Erschienen in: Social Indicators Research | Ausgabe 1/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Political indicators are widely used in academic writing and decision making, but remain controversial. This paper discusses the problems related to the aggregation functions they use. Almost always, political indicators are aggregated by weighted averages or summations. The use of such functions is based on untenable assumptions (existence of homogeneous substitution rates, total compensation, and strict monotonicity). We show through concrete examples how these hidden assumptions are likely to produce results that are basically an artifact of ad hoc decisions, which additionally contradict very fundamental notions common to all credible political theories. We suggest, also through example, that some—necessarily partial—solutions are possible.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
See for example http://​www.​carleton.​ca/​cifp/​gdp_​indicator_​descriptions.​ht. From now on, we will use somewhat inexactly expressions as “indicator”, “index”, and “measure” as synonymous.
 
3
This includes also indexes that apparently constitute exceptions. For example, the Worldwide Governance Indicator uses an aggregation function which is more sophisticated than others. By the Unobserved Components Method, the WGI tries to isolate the signal from the noise sent by each variable. However, the outcome of this operation, as the coordinators of the index explicitly acknowledge, “is simply a weighted average of the rescaled scores for each country” (Kaufmann et al. 2010, p. 10). Something similar can be said about Polity IV (2010), see below.
 
4
It subtracts autocracy from democracy, and adds the variables of democracy and autocracy to obtain the respective scores. However, below this operation, there is a non-linear transformation of the scales, sending to zero the score of categories that are below a cut-off point. These transformations have their own issues, but we will concentrate here on the “high level” operation over the scores, not in the way the scores themselves were produced.
 
8
Adding numerical tags from ordinal scales is far from uncontroversial, but we will drop the issue here.
 
9
In economy typically individuals are taking decisions on their behalf. In politics they are habitually discussing rules that will apply for everybody, or for large chunks of the population.
 
10
For analogous exercises, see the Bouyssou et al. (2000) discussion of the Human Development Index, and other examples, p. 57. Anybody who is familiar in the way PIs are used in regressions will see that this kind of transformation is everything but extraordinary.
 
11
In that they use basically the same method, averages or summations, but plug in different parameters.
 
12
Rather atypically, and strangely, the FSI does not deal explicitly with variables. Each box has a mark, based on a soft assessment of criteria that “are neither exclusive nor exhaustive”. http://​www.​fundforpeace.​org/​web/​index.​php?​option=​com_​content&​task=​view&​id=​452&​Itemid=​900.
 
13
We took subsets of size two because there are more of them than subsets of size four, three or one. In each of these choices the exercise we present here is much easier to perform.
 
14
Additionally, we found in the process of correcting the paper that there were many forms of obtaining the same results. That is, several other arrays of weights would produce a similar outcome.
 
15
The domain of PIs is bounded above and below.
 
16
This definition can easily be generalized for g with different domains in each of its variables.
 
17
Once the scores of the variables have been fixed. See note 4 relative to Polity.
 
18
In Beliakov et al. (2007) weights are attributed ad hoc. For a more general example in this vein, see Gutierrez et al. (2010).
 
19
Note besides that, since scales are sometimes different and the aggregation is generally produced through a two-step procedure, in practice the majority of indicators allot different weights to their variables. The FSI at least gives the same weight to all its boxes.
 
Literatur
Zurück zum Zitat Becker, G. (1983). A theory of competition among pressure groups for political influence. The Quarterly Journal of Economics, 98, 371–400.CrossRef Becker, G. (1983). A theory of competition among pressure groups for political influence. The Quarterly Journal of Economics, 98, 371–400.CrossRef
Zurück zum Zitat Beliakov, G., Pradera, A., & Calvo, T. (2007). Aggregation functions. A guide for practitioners. New York: Springer. Beliakov, G., Pradera, A., & Calvo, T. (2007). Aggregation functions. A guide for practitioners. New York: Springer.
Zurück zum Zitat Bertocchi, G., Guerzoni, A. (2010). Growth, history or institutions? What explains state fragility in Sub-Saharan Africa. IZA DP No. 4817. Bertocchi, G., Guerzoni, A. (2010). Growth, history or institutions? What explains state fragility in Sub-Saharan Africa. IZA DP No. 4817.
Zurück zum Zitat Bollen, K., & Paxton, P. (2000). Subjective measures of liberal democracy. Comparative Political Studies, 33(1), 58–86.CrossRef Bollen, K., & Paxton, P. (2000). Subjective measures of liberal democracy. Comparative Political Studies, 33(1), 58–86.CrossRef
Zurück zum Zitat Bouyssou, D., Marchant, T., Pirlot, M., Perny, P., Tsoukias, A., & Vincke, P.H. (2000). Evaluation and desicion models: A critial perspective. Massachusetts: Kluwer Academic Publisher. Bouyssou, D., Marchant, T., Pirlot, M., Perny, P., Tsoukias, A., & Vincke, P.H. (2000). Evaluation and desicion models: A critial perspective. Massachusetts: Kluwer Academic Publisher.
Zurück zum Zitat Bouyssou, D., & Perny, P. (1992). Ranking methods for valued preference relations: A characterization of a method based on leaving and entering flows. European Journal of Operational Research, 61, 186–194.CrossRef Bouyssou, D., & Perny, P. (1992). Ranking methods for valued preference relations: A characterization of a method based on leaving and entering flows. European Journal of Operational Research, 61, 186–194.CrossRef
Zurück zum Zitat Carment, D. , Prest, S., & Samy, Y. (2008). Determinants of state fragility and implications for aid allocation: An assessment based on the country indicators for foreign policy project. Conflict Management and Peace Science, 25, 349–373.CrossRef Carment, D. , Prest, S., & Samy, Y. (2008). Determinants of state fragility and implications for aid allocation: An assessment based on the country indicators for foreign policy project. Conflict Management and Peace Science, 25, 349–373.CrossRef
Zurück zum Zitat Chauvet, L., & Collier, P. (2004). Development effectiveness in fragile states: Spillovers and turnarounds. Oxford: Centre for the Study of African Economies, Department of Economics, Oxford University. Chauvet, L., & Collier, P. (2004). Development effectiveness in fragile states: Spillovers and turnarounds. Oxford: Centre for the Study of African Economies, Department of Economics, Oxford University.
Zurück zum Zitat Cohen, W., Schapire, R., & Singer, Y. (1999). Learning to order things. In Advances in Neural Information Processing Systems 11: Proceedings of NIPS’98. MIT Press. Cohen, W., Schapire, R., & Singer, Y. (1999). Learning to order things. In Advances in Neural Information Processing Systems 11: Proceedings of NIPS’98. MIT Press.
Zurück zum Zitat Collier, D., Sekhon, J., & Stark, P. (2010). Inference and shoe leather. In: F. David (Eds.), Statistical models and causal inference. A dialogue with the social sciences. Cambridge: Cambridge University Press. Collier, D., Sekhon, J., & Stark, P. (2010). Inference and shoe leather. In: F. David (Eds.), Statistical models and causal inference. A dialogue with the social sciences. Cambridge: Cambridge University Press.
Zurück zum Zitat Di John, J. (2008). Conceptualising the causes and consequences of failed states: A critial review of the literature. Crisis States Working Papers Series, 2, 1–51. Di John, J. (2008). Conceptualising the causes and consequences of failed states: A critial review of the literature. Crisis States Working Papers Series, 2, 1–51.
Zurück zum Zitat Elster, J. (1993). Political psychology. Cambridge: Cambridge University Press. Elster, J. (1993). Political psychology. Cambridge: Cambridge University Press.
Zurück zum Zitat Fabra, J., & Ziaja, S. (2009). Users’ guide on measuring fragility. Germany: German Development Institute (DIE), United Nation Development Programme (UNDP). Fabra, J., & Ziaja, S. (2009). Users’ guide on measuring fragility. Germany: German Development Institute (DIE), United Nation Development Programme (UNDP).
Zurück zum Zitat Fearon, J., & Laitin, D. (2003). Ethnicity, insurgency, and civil war. American Political Science Review, 97(1), 75–90.CrossRef Fearon, J., & Laitin, D. (2003). Ethnicity, insurgency, and civil war. American Political Science Review, 97(1), 75–90.CrossRef
Zurück zum Zitat Freedman, D. (2005). Statistical models: Theory and practice. New York: Cambridge University Press.CrossRef Freedman, D. (2005). Statistical models: Theory and practice. New York: Cambridge University Press.CrossRef
Zurück zum Zitat Freedman, D. (2010). Statistical models and causal inference. A dialogue with the social sciences. New York: Cambridge University Press. Freedman, D. (2010). Statistical models and causal inference. A dialogue with the social sciences. New York: Cambridge University Press.
Zurück zum Zitat Grabisch, M., Marichal, J. L., Mesiar, R., & Pap, E. (2009). Aggregation functions. Cambridge: Cambridge University Press. Grabisch, M., Marichal, J. L., Mesiar, R., & Pap, E. (2009). Aggregation functions. Cambridge: Cambridge University Press.
Zurück zum Zitat Green, D., & Shapiro, I. (1994). Pathologies of rational choice theory: A critique of applications in political science. New Haven: Yale U. Press. Green, D., & Shapiro, I. (1994). Pathologies of rational choice theory: A critique of applications in political science. New Haven: Yale U. Press.
Zurück zum Zitat Gutierrez, F. (2010). Evaluating state performance. A critical view of state failure and fragility indexes. European Journal of Development Research, 3, 1–23. Gutierrez, F. (2010). Evaluating state performance. A critical view of state failure and fragility indexes. European Journal of Development Research, 3, 1–23.
Zurück zum Zitat Gutierrez, F., & Argoty, C. (2010). Order preserving functions from finite posets to \({\mathbb{R}}\): How many are there? In F. Gutierrez, D. Buitrago, A. Gonzales & C. Lozano (Eds.), Measuring poor state performance: Problems, perspectives and paths ahead. London: London School of Economics. Gutierrez, F., & Argoty, C. (2010). Order preserving functions from finite posets to \({\mathbb{R}}\): How many are there? In F. Gutierrez, D. Buitrago, A. Gonzales & C. Lozano (Eds.), Measuring poor state performance: Problems, perspectives and paths ahead. London: London School of Economics.
Zurück zum Zitat Gutierrez, F., Buitrago, D., Gonzales, A., & Lozano, C. (2010). Measuring poor state performance: problems, perspectives and paths ahead. London: London School of Economics. Gutierrez, F., Buitrago, D., Gonzales, A., & Lozano, C. (2010). Measuring poor state performance: problems, perspectives and paths ahead. London: London School of Economics.
Zurück zum Zitat Gutierrez, F., & Gonzalez, A. (2009). Force and Ambiguity: Evaluating sources for cross-national research—the case of military interventions. Crisis States Working Papers Series, 50(2), 1–32. Gutierrez, F., & Gonzalez, A. (2009). Force and Ambiguity: Evaluating sources for cross-national research—the case of military interventions. Crisis States Working Papers Series, 50(2), 1–32.
Zurück zum Zitat Howard, T. O. (2008). Revisiting state failure: Developing a causal model of state failure based upon theoretical insight. Civil Wars, 10(2), 125–146.CrossRef Howard, T. O. (2008). Revisiting state failure: Developing a causal model of state failure based upon theoretical insight. Civil Wars, 10(2), 125–146.CrossRef
Zurück zum Zitat Kaufmann, D., Kraay, A., & Mastruzzi, M. (2010). The worldwide governance indicators. Methodology and analytical issues. Development Research Group. Macroeconomics and Growth Team, The World Bank. Policy Research Working Paper 5430. Kaufmann, D., Kraay, A., & Mastruzzi, M. (2010). The worldwide governance indicators. Methodology and analytical issues. Development Research Group. Macroeconomics and Growth Team, The World Bank. Policy Research Working Paper 5430.
Zurück zum Zitat King, G., Keohane, R. O., & Verba, S. (1994). Designing social inquiry: Scientific inference in qualitative research. Princeton, NJ: Princeton University Press. King, G., Keohane, R. O., & Verba, S. (1994). Designing social inquiry: Scientific inference in qualitative research. Princeton, NJ: Princeton University Press.
Zurück zum Zitat Labreuche, C., & Grabisch, M. (2003). The Choquet integral for the aggregation of interval scales in multicriteria decision making. Fuzzy Sets and Systems, 137, 11–26.CrossRef Labreuche, C., & Grabisch, M. (2003). The Choquet integral for the aggregation of interval scales in multicriteria decision making. Fuzzy Sets and Systems, 137, 11–26.CrossRef
Zurück zum Zitat Lavrač, N., Flach, P., & Zupan, B. (1999). Rule evaluation measures: A unifying view. In Proceedings of the 9th International Workshop on Inductive Logic Programming, Springer-Verlag, 174–185. Lavrač, N., Flach, P., & Zupan, B. (1999). Rule evaluation measures: A unifying view. In Proceedings of the 9th International Workshop on Inductive Logic Programming, Springer-Verlag, 174–185.
Zurück zum Zitat Lootsma, F. (1997). Fuzzy logic for planning and decision making. London: Kluwer academic publishers. Lootsma, F. (1997). Fuzzy logic for planning and decision making. London: Kluwer academic publishers.
Zurück zum Zitat McMahon, E., & Kornheiser, E. (2010). Assessing the assessors: Correlating democracy methodologies. Social Indicators Research, 97(2), 269–277.CrossRef McMahon, E., & Kornheiser, E. (2010). Assessing the assessors: Correlating democracy methodologies. Social Indicators Research, 97(2), 269–277.CrossRef
Zurück zum Zitat Munck, G., & Verkuilen, J. (2002). Conceptualizing and measuring democracy evaluating alternative indice. Comparative political studies, 1(35), 5–34. Munck, G., & Verkuilen, J. (2002). Conceptualizing and measuring democracy evaluating alternative indice. Comparative political studies, 1(35), 5–34.
Zurück zum Zitat Munda, G. (2005). “Measuring sustainability”: A multi-criterion framework. Environment, Development and Sustainability, 7, 117–134.CrossRef Munda, G. (2005). “Measuring sustainability”: A multi-criterion framework. Environment, Development and Sustainability, 7, 117–134.CrossRef
Zurück zum Zitat Munda, G., & Nardo M. (2005). Non-compensatory composite indicators for ranking countries: A defensible setting. Technical Report EUR 21833 EN, European Commission. Munda, G., & Nardo M. (2005). Non-compensatory composite indicators for ranking countries: A defensible setting. Technical Report EUR 21833 EN, European Commission.
Zurück zum Zitat Nardo, M., Sasaina, M., Saltelli, A., & Tarantola, S. (2005). Handbook on constructing composite indicators: Methodology and user guide. OECD Statistics Working Paper, 13, 1–55. Nardo, M., Sasaina, M., Saltelli, A., & Tarantola, S. (2005). Handbook on constructing composite indicators: Methodology and user guide. OECD Statistics Working Paper, 13, 1–55.
Zurück zum Zitat Noda, E., & Freitas, A. A. (2006). Data mining and knowledge discovery approaches based on rule induction techniques. In E. Triantaphyllou & G. Felici (Eds.), Massive computing series (pp. 395–432). Heidelberg, Germany: Springer. Noda, E., & Freitas, A. A. (2006). Data mining and knowledge discovery approaches based on rule induction techniques. In E. Triantaphyllou & G. Felici (Eds.), Massive computing series (pp. 395–432). Heidelberg, Germany: Springer.
Zurück zum Zitat Pǎun, G. (1983). An impossibility theorem for indicators aggregation. Fuzzy Sets and Systems, 9, 205–210.CrossRef Pǎun, G. (1983). An impossibility theorem for indicators aggregation. Fuzzy Sets and Systems, 9, 205–210.CrossRef
Zurück zum Zitat Pele, D. T. (2009). About the impossibility theorem for indicators aggregation. Journal of Applied Quantitative Methods, 4(1), 82–87. Pele, D. T. (2009). About the impossibility theorem for indicators aggregation. Journal of Applied Quantitative Methods, 4(1), 82–87.
Zurück zum Zitat Przeworski, A. (2004). States and markets. A primer in political economy. New York: Cambridge University Press. Przeworski, A. (2004). States and markets. A primer in political economy. New York: Cambridge University Press.
Zurück zum Zitat Torra, V., & Narukawa, Y. (2004). On the interpretation of some fuzzy integrals. In Proceedings of the 1st International Conference on Modeling Decisions for Artificial Intelligence, Lecture Notes in Artificial Intelligence, vol. 3131, pp. 316–326. Torra, V., & Narukawa, Y. (2004). On the interpretation of some fuzzy integrals. In Proceedings of the 1st International Conference on Modeling Decisions for Artificial Intelligence, Lecture Notes in Artificial Intelligence, vol. 3131, pp. 316–326.
Zurück zum Zitat Torra, V., & Narukawa, Y. (2006). The interpretation of fuzzy integrals and their application to fuzzy systems. International Journal of Approximate Reasoning, 41, 43–58.CrossRef Torra, V., & Narukawa, Y. (2006). The interpretation of fuzzy integrals and their application to fuzzy systems. International Journal of Approximate Reasoning, 41, 43–58.CrossRef
Zurück zum Zitat von Neumann, J., & Morgenstern, O. (1944). The theory of games and economic behavior. Princeton: Princeton University Press. von Neumann, J., & Morgenstern, O. (1944). The theory of games and economic behavior. Princeton: Princeton University Press.
Zurück zum Zitat Vreeland, J. R. (2008). The effect of political regime on civil war: Unpacking anocracy. Journal of Conflict Resolution, 52(3), 401–425.CrossRef Vreeland, J. R. (2008). The effect of political regime on civil war: Unpacking anocracy. Journal of Conflict Resolution, 52(3), 401–425.CrossRef
Zurück zum Zitat Zintl, R. (2008). On the rationality and stability of a minimal consensus. In: J. Kühnelt (Ed.), Political legitimization without morality? (pp. 73–90). Netherlands: Springer.CrossRef Zintl, R. (2008). On the rationality and stability of a minimal consensus. In: J. Kühnelt (Ed.), Political legitimization without morality? (pp. 73–90). Netherlands: Springer.CrossRef
Zurück zum Zitat Zupan, B., Bohanec, M., Bratko, I., Demsar, J. (1997). Machine learning by function decomposition. In: D. H. Fisher Jr. (Ed.), Proceedings Fourteenth International Conference on Machine Learning (ICML-97), pages 421–429, San Mateo, CA. Morgan Kaufmann. Zupan, B., Bohanec, M., Bratko, I., Demsar, J. (1997). Machine learning by function decomposition. In: D. H. Fisher Jr. (Ed.), Proceedings Fourteenth International Conference on Machine Learning (ICML-97), pages 421–429, San Mateo, CA. Morgan Kaufmann.
Metadaten
Titel
Aggregating Political Dimensions: Of the Feasibility of Political Indicators
verfasst von
Francisco Gutiérrez Sanín
Diana Buitrago
Andrea González
Publikationsdatum
01.01.2013
Verlag
Springer Netherlands
Erschienen in
Social Indicators Research / Ausgabe 1/2013
Print ISSN: 0303-8300
Elektronische ISSN: 1573-0921
DOI
https://doi.org/10.1007/s11205-011-9932-4

Weitere Artikel der Ausgabe 1/2013

Social Indicators Research 1/2013 Zur Ausgabe

Premium Partner