Skip to main content
Erschienen in: Social Indicators Research 3/2018

23.05.2017

The Difficulty of Measuring Institutions: a Methodological Approach to the Comparative Analysis of Institutions

verfasst von: Patricia Frericks, Julia Höppner, Ralf Och

Erschienen in: Social Indicators Research | Ausgabe 3/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the social sciences it is hardly contested that “institutions matter”. Consequently the analysis of differences and similarities of institutions should be a routine task. Prevailing methods to the measurement of institutions are however problematic, in particular when they have to deal with different levels of measurement. To overcome this, in this paper we present an innovative method to the quantification of qualitative institutional data. We do this by, first, developing benchmarks for comparison based on Weberian ideal types. Then we identify and operationalise the dimensions and indicators to a nuanced measurement of institutions, after which we apply a careful and differentiated scoring, weighting and aggregation procedure in order to guarantee the highest standards of comparability, transparency and reliability of the method. Finally, we demonstrate our method by applying it to the analysis of institutional individualisation in European welfare institutions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Aspalter, C. (2011). The development of ideal-typical welfare regime theory. International Social Work, 54(6), 735–750.CrossRef Aspalter, C. (2011). The development of ideal-typical welfare regime theory. International Social Work, 54(6), 735–750.CrossRef
Zurück zum Zitat Bambra, C. (2007). ‘Sifting the wheat from the chaff’: A two-dimensional discriminant analysis of welfare state regime theory. Social Policy & Administration, 41(1), 1–28.CrossRef Bambra, C. (2007). ‘Sifting the wheat from the chaff’: A two-dimensional discriminant analysis of welfare state regime theory. Social Policy & Administration, 41(1), 1–28.CrossRef
Zurück zum Zitat Basurto, X., Kingsley, G., McQueen, K., Smith, M. & Weible, C. M. (2009). A systematic approach to institutional analysis—applying Crawford and Ostrom’s Grammar. Political Research Quarterly Online First, 1–16. Basurto, X., Kingsley, G., McQueen, K., Smith, M. & Weible, C. M. (2009). A systematic approach to institutional analysis—applying Crawford and Ostrom’s Grammar. Political Research Quarterly Online First, 1–16.
Zurück zum Zitat Bennett, A., & Elman, C. (2006). Qualitative research: Recent developments in case study methods. Annual Review of Political Science, 9, 455–476.CrossRef Bennett, A., & Elman, C. (2006). Qualitative research: Recent developments in case study methods. Annual Review of Political Science, 9, 455–476.CrossRef
Zurück zum Zitat Booysen, F. (2002). An overview and evaluation of composite indices of development. Social Indicators Research, 59, 115–151.CrossRef Booysen, F. (2002). An overview and evaluation of composite indices of development. Social Indicators Research, 59, 115–151.CrossRef
Zurück zum Zitat Campbell, J. L. (2011). Institutional Reproduction and Change. In G. Morgan, J. L. Campbell, C. Crouch, O. K. Pedersen, & R. Whiteley (Eds.), The Oxford handbook of comparative institutional analysis (pp. 87–115). Oxford: Oxford Univ. Press. Campbell, J. L. (2011). Institutional Reproduction and Change. In G. Morgan, J. L. Campbell, C. Crouch, O. K. Pedersen, & R. Whiteley (Eds.), The Oxford handbook of comparative institutional analysis (pp. 87–115). Oxford: Oxford Univ. Press.
Zurück zum Zitat Castles, F. G. (2002). Developing new measures of welfare state change and reform. European Journal of Political Research, 41, 613–641.CrossRef Castles, F. G. (2002). Developing new measures of welfare state change and reform. European Journal of Political Research, 41, 613–641.CrossRef
Zurück zum Zitat Castles, F. G. (2008). What welfare states do: A disaggregated expenditure approach. Journal of Social Policy, 38, 45–62.CrossRef Castles, F. G. (2008). What welfare states do: A disaggregated expenditure approach. Journal of Social Policy, 38, 45–62.CrossRef
Zurück zum Zitat Clasen, J., & Clegg, D. (2007). Levels and levers of conditionality: Measuring change within welfare states. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change. The ‘dependent variable problem’ in comparative analysis (pp. 166–197). Cheltenham, Northampton: Edward Elgar.CrossRef Clasen, J., & Clegg, D. (2007). Levels and levers of conditionality: Measuring change within welfare states. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change. The ‘dependent variable problem’ in comparative analysis (pp. 166–197). Cheltenham, Northampton: Edward Elgar.CrossRef
Zurück zum Zitat Crawford, S. E. S., & Ostrom, E. (1995). A grammar of institutions. The American Political Science Review, 89(3), 582–600.CrossRef Crawford, S. E. S., & Ostrom, E. (1995). A grammar of institutions. The American Political Science Review, 89(3), 582–600.CrossRef
Zurück zum Zitat Donegan, B., George, C., Gilles, A., Hadwen, W., Hall, D., Krishna, H., et al. (2013). Welfare benefits and tax credits handbook, 2013 (15th ed.). London: Child Poverty Action Group. Donegan, B., George, C., Gilles, A., Hadwen, W., Hall, D., Krishna, H., et al. (2013). Welfare benefits and tax credits handbook, 2013 (15th ed.). London: Child Poverty Action Group.
Zurück zum Zitat Ebbinghaus, B. (2011). Case selection in medium-N comparative welfare state analysis. Qualitative & Multi-Method Research, 9(2), 15–20. Ebbinghaus, B. (2011). Case selection in medium-N comparative welfare state analysis. Qualitative & Multi-Method Research, 9(2), 15–20.
Zurück zum Zitat Esping-Andersen, G. (1990). The three worlds of welfare capitalism (2012th ed.). Cambridge: Polity Press. Esping-Andersen, G. (1990). The three worlds of welfare capitalism (2012th ed.). Cambridge: Polity Press.
Zurück zum Zitat Fedderke, J., & Garlick, J. (2011). Measuring institutions: Indicators of political and property rights in Malawi. Social Indicators Research, 106, 491–521.CrossRef Fedderke, J., & Garlick, J. (2011). Measuring institutions: Indicators of political and property rights in Malawi. Social Indicators Research, 106, 491–521.CrossRef
Zurück zum Zitat Ferrarini, T., Nelson, K., Korpi, W., & Palme, J. (2013). Social citizenship rights and social insurance replacement rate validity: pitfalls and possibilities. Journal of European Public Policy, 20(9), 1251–1266.CrossRef Ferrarini, T., Nelson, K., Korpi, W., & Palme, J. (2013). Social citizenship rights and social insurance replacement rate validity: pitfalls and possibilities. Journal of European Public Policy, 20(9), 1251–1266.CrossRef
Zurück zum Zitat Figueredo, A. J., Olderbak, S. G., Schlomer, G. L., Garcia, R. A., & Abril Wolf, P. S. (2013). Program Evaluation: Principles, Procedures, and Practices. In T. D. Little (Ed.), The Oxford handbook of quantitative methods in psychology (Vol. 1, pp. 332–360). New York: Oxford University Press. Figueredo, A. J., Olderbak, S. G., Schlomer, G. L., Garcia, R. A., & Abril Wolf, P. S. (2013). Program Evaluation: Principles, Procedures, and Practices. In T. D. Little (Ed.), The Oxford handbook of quantitative methods in psychology (Vol. 1, pp. 332–360). New York: Oxford University Press.
Zurück zum Zitat Frericks, P., & Höppner, J. (2017). What about family in European old-age security systems? The Complexity of Institutional Individualisation, Ageing and Society. doi:10.1017/S0144686X16001392. Frericks, P., & Höppner, J. (2017). What about family in European old-age security systems? The Complexity of Institutional Individualisation, Ageing and Society. doi:10.​1017/​S0144686X1600139​2.
Zurück zum Zitat Frericks, P., Höppner, J., & Och, R. (2016). Institutional individualisation? The family in European social security institutions. Journal of Social Policy, 45(4), 747–764.CrossRef Frericks, P., Höppner, J., & Och, R. (2016). Institutional individualisation? The family in European social security institutions. Journal of Social Policy, 45(4), 747–764.CrossRef
Zurück zum Zitat Gilbert, N., & Van Voorhis, R. A. (2003). Changing patterns of social protection. New Brunswick/London: Transaction Publishers. Gilbert, N., & Van Voorhis, R. A. (2003). Changing patterns of social protection. New Brunswick/London: Transaction Publishers.
Zurück zum Zitat Green-Pedersen, C. (2007). More than data questions and methodological issues: theoretical conceptualization and the dependent variable ‘problem’ in the study of welfare reform. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change. The ‘dependent variable problem’ in comparative analysis (pp. 13–23). Cheltenham, Northampton: Edward Elgar Publishing Ltd. Green-Pedersen, C. (2007). More than data questions and methodological issues: theoretical conceptualization and the dependent variable ‘problem’ in the study of welfare reform. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change. The ‘dependent variable problem’ in comparative analysis (pp. 13–23). Cheltenham, Northampton: Edward Elgar Publishing Ltd.
Zurück zum Zitat Grünewald, A. (2014). Social security around the World: A review of datasets. ZeS Working Paper 03/2014. Bremen. Grünewald, A. (2014). Social security around the World: A review of datasets. ZeS Working Paper 03/2014. Bremen.
Zurück zum Zitat Hall, P. A. (1986). Governing the economy. The politics of state intervention in Britain and France. New York: Oxford University Press. Hall, P. A. (1986). Governing the economy. The politics of state intervention in Britain and France. New York: Oxford University Press.
Zurück zum Zitat Hall, P. A., & Soskice, D. W. (Eds.). (2001). Varieties of capitalism: The institutional foundations of comparative advantage. Oxford, New York: Oxford University Press. Hall, P. A., & Soskice, D. W. (Eds.). (2001). Varieties of capitalism: The institutional foundations of comparative advantage. Oxford, New York: Oxford University Press.
Zurück zum Zitat Hall, P. A., & Taylor, R. C. R. (1996). Political science and the three new institutionalisms. Political Studies, 44(5), 936–957.CrossRef Hall, P. A., & Taylor, R. C. R. (1996). Political science and the three new institutionalisms. Political Studies, 44(5), 936–957.CrossRef
Zurück zum Zitat Howell, C. (2003). Varieties of capitalism: And then there was one? Comparative Politics, 36(1), 103–124.CrossRef Howell, C. (2003). Varieties of capitalism: And then there was one? Comparative Politics, 36(1), 103–124.CrossRef
Zurück zum Zitat Javornik, J. (2012). Rethinking comparative childcare policy analysis: Example of Central and Eastern Europe. Working paper 10/2012. Department of Sociology, Umeå University. Javornik, J. (2012). Rethinking comparative childcare policy analysis: Example of Central and Eastern Europe. Working paper 10/2012. Department of Sociology, Umeå University.
Zurück zum Zitat Kangas, O., & Palme, J. (2007). Social rights, structural needs and social expenditure: a comparative study of 18 OECD countries 1960-2000. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change the ‘dependent variable problem’ in comparative analysis (pp. 106–129). Cheltenham, Northampton: Edward Elgar Publishing Ltd. Kangas, O., & Palme, J. (2007). Social rights, structural needs and social expenditure: a comparative study of 18 OECD countries 1960-2000. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change the ‘dependent variable problem’ in comparative analysis (pp. 106–129). Cheltenham, Northampton: Edward Elgar Publishing Ltd.
Zurück zum Zitat Kogut, B. (2010). Qualitative comparative analysis of social science data. In G. Morgan, J. L. Campbell, C. Crouch, O. K. Pedersen, & R. Whiteley (Eds.), The Oxford handbook of comparative institutional analysis (pp. 139–179). Oxford: Oxford University Press. Kogut, B. (2010). Qualitative comparative analysis of social science data. In G. Morgan, J. L. Campbell, C. Crouch, O. K. Pedersen, & R. Whiteley (Eds.), The Oxford handbook of comparative institutional analysis (pp. 139–179). Oxford: Oxford University Press.
Zurück zum Zitat Korpi, W., & Palme, J. (1998). The paradox of redistribution and strategies of equality: Welfare state institutions, inequality, and poverty in the western countries. American Sociological Review, 63(5), 661–687.CrossRef Korpi, W., & Palme, J. (1998). The paradox of redistribution and strategies of equality: Welfare state institutions, inequality, and poverty in the western countries. American Sociological Review, 63(5), 661–687.CrossRef
Zurück zum Zitat Kvist, J. (2006). Diversity, ideal types and fuzzy sets in comparative welfare state research. In B. Rihoux & H. Grimm (Eds.), Innovative comparative methods for policy analysis: beyond the quantitative-qualitative divide (pp. 167–184). Boston, MA: Springer Science + Business Media Inc.CrossRef Kvist, J. (2006). Diversity, ideal types and fuzzy sets in comparative welfare state research. In B. Rihoux & H. Grimm (Eds.), Innovative comparative methods for policy analysis: beyond the quantitative-qualitative divide (pp. 167–184). Boston, MA: Springer Science + Business Media Inc.CrossRef
Zurück zum Zitat Kvist, J. (2007). Fuzzy set ideal type analysis. Journal of Business Research, 60(5), 474–481.CrossRef Kvist, J. (2007). Fuzzy set ideal type analysis. Journal of Business Research, 60(5), 474–481.CrossRef
Zurück zum Zitat Lazarsfeld, P. F. (1937). Some remarks on the typological procedures in social research. Zeitschrift für Sozialforschung, 6, 119–139.CrossRef Lazarsfeld, P. F. (1937). Some remarks on the typological procedures in social research. Zeitschrift für Sozialforschung, 6, 119–139.CrossRef
Zurück zum Zitat Lucas, S. R., & Szatrowski, A. (2014). Qualitative comparative analysis in critical perspective. Sociological Methodology, 44(1), 1–79.CrossRef Lucas, S. R., & Szatrowski, A. (2014). Qualitative comparative analysis in critical perspective. Sociological Methodology, 44(1), 1–79.CrossRef
Zurück zum Zitat Mahoney, J. (2004). Comparative historical methodology. Annual Review of Sociology, 30, 81–101.CrossRef Mahoney, J. (2004). Comparative historical methodology. Annual Review of Sociology, 30, 81–101.CrossRef
Zurück zum Zitat North, D. C. (1991). Institutions. Journal of Economic Perspectives, 5(1), 97–112.CrossRef North, D. C. (1991). Institutions. Journal of Economic Perspectives, 5(1), 97–112.CrossRef
Zurück zum Zitat Pfau-Effinger, B., Flaquer, L., & Jensen, P. H. (Eds.). (2009). Formal and informal work. The hidden work regime in Europe (p. 46). New York: Routledge (Routledge advances in sociology. Pfau-Effinger, B., Flaquer, L., & Jensen, P. H. (Eds.). (2009). Formal and informal work. The hidden work regime in Europe (p. 46). New York: Routledge (Routledge advances in sociology.
Zurück zum Zitat Ragin, C. (2000). Fuzzy-set social science. Chicago/London: The University of Chicago Press. Ragin, C. (2000). Fuzzy-set social science. Chicago/London: The University of Chicago Press.
Zurück zum Zitat Schnell, R., Hill, P. B., & Esser, E. (2005). Methoden der empirischen Sozialforschung. München: Oldenbourg Verlag. Schnell, R., Hill, P. B., & Esser, E. (2005). Methoden der empirischen Sozialforschung. München: Oldenbourg Verlag.
Zurück zum Zitat Schreier, M. (2012). Qualitative Content Analysis in Practice. London/Thousand Oaks/New Delhi/Singapore: SAGE. Schreier, M. (2012). Qualitative Content Analysis in Practice. London/Thousand Oaks/New Delhi/Singapore: SAGE.
Zurück zum Zitat Scruggs, L. A. (2007). Welfare state generosity across space and time. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change. the ‘dependent variable problem’ in comparative analysis (pp. 133–166). Cheltenham, Northampton: Edward Elgar Publishing Ltd. Scruggs, L. A. (2007). Welfare state generosity across space and time. In J. Clasen & N. Siegel (Eds.), Investigating welfare state change. the ‘dependent variable problem’ in comparative analysis (pp. 133–166). Cheltenham, Northampton: Edward Elgar Publishing Ltd.
Zurück zum Zitat Scruggs, L. A., & Allan, J. (2006). Welfare-state decommodification in 18 OECD countries: A replication and revision. Journal of European Social Policy, 16(1), 55–72.CrossRef Scruggs, L. A., & Allan, J. (2006). Welfare-state decommodification in 18 OECD countries: A replication and revision. Journal of European Social Policy, 16(1), 55–72.CrossRef
Zurück zum Zitat Streeck, W., & Thelen, K. (2005). Introduction: Institutional change in advanced political economies. In W. Streeck & K. Thelen (Eds.), Beyond continuity—institutional change in advanced political economies (pp. 3–39). Oxford: University Press. Streeck, W., & Thelen, K. (2005). Introduction: Institutional change in advanced political economies. In W. Streeck & K. Thelen (Eds.), Beyond continuity—institutional change in advanced political economies (pp. 3–39). Oxford: University Press.
Zurück zum Zitat Thelen, K., & Steinmo, S. (1992). Historical institutionalism in comparative politics. In S. Steinmo, K. Thelen, & F. Longstreth (Eds.), Structuring politics. Historical institutionalism in comparative analysis (pp. 1–32). Cambridge, New York: Cambridge University Press. Thelen, K., & Steinmo, S. (1992). Historical institutionalism in comparative politics. In S. Steinmo, K. Thelen, & F. Longstreth (Eds.), Structuring politics. Historical institutionalism in comparative analysis (pp. 1–32). Cambridge, New York: Cambridge University Press.
Zurück zum Zitat Voigt, S. (2013). How (Not) to measure institutions. Journal of Institutional Economics, 9(1), 1–26.CrossRef Voigt, S. (2013). How (Not) to measure institutions. Journal of Institutional Economics, 9(1), 1–26.CrossRef
Zurück zum Zitat Wagemann, C. (2008). Qualitative comparative analysis und policy-forschung. In F. Jannig & K. Toens (Eds.), Die Zukunft der Policy-Forschung: Theorien, Methoden, Anwendungen (pp. 242–258). Wiesbaden: VS Verlag.CrossRef Wagemann, C. (2008). Qualitative comparative analysis und policy-forschung. In F. Jannig & K. Toens (Eds.), Die Zukunft der Policy-Forschung: Theorien, Methoden, Anwendungen (pp. 242–258). Wiesbaden: VS Verlag.CrossRef
Zurück zum Zitat Weber, M. (1973). Die ‚Objektivität‘sozialwissenschaftlicher und sozialpolitischer Erkenntnis. In M. Weber (Ed.), Gesammelte Aufsätze zur Wissenschaftslehre (pp. 146–214). Tübingen. Weber, M. (1973). Die ‚Objektivität‘sozialwissenschaftlicher und sozialpolitischer Erkenntnis. In M. Weber (Ed.), Gesammelte Aufsätze zur Wissenschaftslehre (pp. 146–214). Tübingen.
Zurück zum Zitat Weber, M., & Winckelmann, J. (Eds.). (1985). Gesammelte Aufsätze zur Wissenschaftslehre (6th ed.). Tübingen: J.C.B. Mohr. Weber, M., & Winckelmann, J. (Eds.). (1985). Gesammelte Aufsätze zur Wissenschaftslehre (6th ed.). Tübingen: J.C.B. Mohr.
Zurück zum Zitat Wenzelburger, G., Zohlnhöfer, R., & Wolf, F. (2013). Implications of dataset choice in comparative welfare state research. Journal of European Public Policy, 20(9), 1229–1250.CrossRef Wenzelburger, G., Zohlnhöfer, R., & Wolf, F. (2013). Implications of dataset choice in comparative welfare state research. Journal of European Public Policy, 20(9), 1229–1250.CrossRef
Zurück zum Zitat Yin, Robert K. (2014). Case study research: Design and methods (5th ed.). Los Angeles: SAGE. Yin, Robert K. (2014). Case study research: Design and methods (5th ed.). Los Angeles: SAGE.
Metadaten
Titel
The Difficulty of Measuring Institutions: a Methodological Approach to the Comparative Analysis of Institutions
verfasst von
Patricia Frericks
Julia Höppner
Ralf Och
Publikationsdatum
23.05.2017
Verlag
Springer Netherlands
Erschienen in
Social Indicators Research / Ausgabe 3/2018
Print ISSN: 0303-8300
Elektronische ISSN: 1573-0921
DOI
https://doi.org/10.1007/s11205-017-1638-9

Weitere Artikel der Ausgabe 3/2018

Social Indicators Research 3/2018 Zur Ausgabe