Skip to main content
Top
Published in: Social Indicators Research 3/2012

01-12-2012

Choosing Aggregation Rules for Composite Indicators

Author: Giuseppe Munda

Published in: Social Indicators Research | Issue 3/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

From a formal point of view, a composite indicator is an aggregate of all dimensions, objectives, individual indicators and variables used for its construction. This implies that what defines a composite indicator is the set of properties underlying its mathematical aggregation convention. In this article, I try to revise the theoretical debate on aggregation rules by looking at contributions from both voting theory and multi-criteria decision analysis. This cross-fertilization helps in clarifying many ambiguous issues still present in the literature and allows discussing the key assumptions that may change the evaluation of an aggregation rule easily, when a composite indicator has to be constructed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Given the set of individual indicators G, a subset of indicators Y is preferentially independent of Y C  = Q (the complement of Y) only if any conditional preference among elements of Y, holding all elements of Q fixed, remain the same, regardless of the levels at which Q are held. The indicators g 1 , g 2 ,…, g m are mutually preferentially independent if every subset Y of these indicators is preferentially independent of its complementary set of indicators. From an operational point of view, this means that an additive aggregation function permits the assessment of the marginal contribution of each indicator separately (as a consequence of the preferential independence condition). The marginal contribution of each indicator can then be added together to yield a total value, no phenomena of synergy or conflict can be taken into account.
 
2
The original Arrow’s impossibility theorem (Arrow 1963) is slightly different, above all with respect to the independence of irrelevant alternatives axiom. In the social choice literature formulation, it is called the axiom of binary independence, i.e., the social ranking of each pair of alternatives depends only on the preferences of each voter on that specific pair of alternatives. The ranking of any other alternative is irrelevant for this social ranking. Indeed in the version proposed by Arrow and Raynaud (1986) the axiom of independence of irrelevant alternatives is closer to the definition given by Chernoff (1954), which is derived from Nash’s bargaining theory. For a deep discussion on the independence of irrelevant alternatives axiom and its various definitions see e.g., Ray (1973) and Bordes and Tideman (1991).
 
3
Often this search for clear properties characterizing an algorithm is indicated as the axiomatic approach. However, one should note that properties or assumptions are NOT axioms. As perfectly synthesized by Saari (2006, p. 110) “Many, if not most, results in this area are merely properties that happen to uniquely identify a particular procedure. But unless these properties can be used to construct, or be identified with all properties of the procedure (such as in the development of utility functions in the individual choice literature), they are not building blocks and they most surely are not axioms: they are properties that just happen to identify but not characterize, a procedure. As an example, the two properties (1) Finnish-American heritage (2) a particular DNA structure, uniquely identify me, but they most surely do not characterize me”.
 
4
It is to be noted that an important key implicit assumption underlying a Borda rule has to be accepted, i.e. the arbitrary transition from an ordinal scale of measurement to an interval or ratio scale one (according to the scoring rule adopted).
 
5
The term “outranking matrix” was invented by B. Roy in the so-called ELECTRE methods.
 
6
Arrow and Raynaud (1986, pp. 77–78) arrive at the conclusion that a Condorcet aggregation algorithm has always to be preferred in a multi-criterion framework. On the complete opposite side one can find Saari (1989, 2000, 2006). His main criticism against Condorcet based approaches are based on two arguments: (1) if one wants to preserve relationships among pairs (e.g., to impose a side constraint to protect some relationship-balanced gender for candidates in a public concourse) then it is impossible to use pair-wise voting rules, a Borda count should be used necessarily. It is important to note that, although desirable in some cases, to preserve a relationship among pairs implies the loss of neutrality; this is not desirable on general grounds. (2) The individual rationality property (i.e., transitivity) has necessarily to be weakened if one wishes to adopt a Condorcet based voting rule.
 
7
However, one should note that this voting rule is normally referred in the literature as the Kemeny’s method or Kemeny’s rule.
 
8
One should note that in general the opportunity cost for decisiveness is the loss of one of the basic requirements of a social choice rule, i.e. anonymity, neutrality or monotonicity. Saari (2006) defence of the Borda rule is based on the fact that it is less dangerous, or even sometimes desirable, to eliminate neutrality and if one eliminates neutrality, then only a Borda rule can be adopted. But, if one wishes to keep neutrality and eliminate anonymity, then a Condorcet voting rule is appropriate.
 
9
Simon (1983) notes that humans have at their disposal neither the facts nor the consistent structure of values nor the reasoning power needed to apply the principles of utility theory. In microeconomics, where the assumption that an economic agent is always a utility maximize is a fundamental one, it is generally admitted that this behavioural assumption has a predictive meaning and not a descriptive one (see Friedman 1953 for the most forceful defence of this non-descriptive meaning of the axioms of ordinal utility theory). A corroboration of this criticism in the framework of social choice can be found in Kelsey (1986), where it is stated that because of social choice problems, an individual with multiple objectives may find it impossible to construct a transitive ordering. Recent analyses of the concept of rational agent can also be found in Bykvist (2010) and Sugden (2010).
 
10
Arrow and Raynaud (1986, pp. 95–96) took into consideration the paper by Young and Levenglick (1978), but they arrive at the conclusion that reinforcement “… has definite ethical content and is therefore relevant to welfare economics and political science. But here our aim is operations research, of use to businessmen. We are unable to see why the “consistency” criterion has any compelling justification when efficiency is the prime consideration.” (Arrow and Raynaud 1986, p. 96).
 
11
The complexity class of decision problems that are intrinsically harder than those that can be solved by a nondeterministic Turing machine in polynomial time. When a decision version of a combinatorial optimization problem is proved to belong to the class of NP-complete problems, then the optimization version is NP-hard (definition given by the National Institute of Standards and Technology, http://​www.​nist.​gov/​dads/​HTML/​nphard.​html).
 
Literature
go back to reference Anderson, N. H., & Zalinski, J. (1988). Functional measurement approach to self-estimation in multiattribute evaluation. Journal of Behavioural Decision Making, 1, 191–221.CrossRef Anderson, N. H., & Zalinski, J. (1988). Functional measurement approach to self-estimation in multiattribute evaluation. Journal of Behavioural Decision Making, 1, 191–221.CrossRef
go back to reference Arrow, K. J. (1963). Social choice and individual values (2nd ed.). New York: Wiley. Arrow, K. J. (1963). Social choice and individual values (2nd ed.). New York: Wiley.
go back to reference Arrow, K. J., & Raynaud, H. (1986). Social choice and multicriterion decision making. Cambridge: M.I.T. Press. Arrow, K. J., & Raynaud, H. (1986). Social choice and multicriterion decision making. Cambridge: M.I.T. Press.
go back to reference Barthelemy, J. P., Guenoche, A., & Hudry, O. (1989). Median linear orders: heuristics and a branch and bound algorithm. European Journal of Operational Research, 42, 313–325.CrossRef Barthelemy, J. P., Guenoche, A., & Hudry, O. (1989). Median linear orders: heuristics and a branch and bound algorithm. European Journal of Operational Research, 42, 313–325.CrossRef
go back to reference Black, D. (1958). The theory of committees and elections. Cambridge: Cambridge University Press. Black, D. (1958). The theory of committees and elections. Cambridge: Cambridge University Press.
go back to reference Borda, de J. C. (1784). Mémoire sur les élections au scrutin. In Histoire de l’ Académie Royale des Sciences. Paris. Borda, de J. C. (1784). Mémoire sur les élections au scrutin. In Histoire de l’ Académie Royale des Sciences. Paris.
go back to reference Bordes, G., & Tideman, N. (1991). Independence of irrelevant alternatives in the theory of voting. Theory and Decision, 30(2), 163–186.CrossRef Bordes, G., & Tideman, N. (1991). Independence of irrelevant alternatives in the theory of voting. Theory and Decision, 30(2), 163–186.CrossRef
go back to reference Bouyssou, D., & Vansnick, J. C. (1986). Noncompensatory and generalized noncompensatory preference structures. Theory and Decision, 21, 251–266.CrossRef Bouyssou, D., & Vansnick, J. C. (1986). Noncompensatory and generalized noncompensatory preference structures. Theory and Decision, 21, 251–266.CrossRef
go back to reference Bykvist, K. (2010). Can unstable preferences provide a stable standard of well-being? Economics and Philosophy, 26, 1–26.CrossRef Bykvist, K. (2010). Can unstable preferences provide a stable standard of well-being? Economics and Philosophy, 26, 1–26.CrossRef
go back to reference Charon, I., Guenoche, A., Hudry, O., & Woirgard, F. (1997). New results on the computation of median orders. Discrete Mathematics, 165/166, 139–153.CrossRef Charon, I., Guenoche, A., Hudry, O., & Woirgard, F. (1997). New results on the computation of median orders. Discrete Mathematics, 165/166, 139–153.CrossRef
go back to reference Chernoff, H. (1954). Rational selection of decision functions. Econometrica, 22(4), 422–443.CrossRef Chernoff, H. (1954). Rational selection of decision functions. Econometrica, 22(4), 422–443.CrossRef
go back to reference Cohen, W., Schapire, R., & Singer, Y. (1999). Learning to order things. Journal of Artificial Intelligence Research, 10, 213–270. Cohen, W., Schapire, R., & Singer, Y. (1999). Learning to order things. Journal of Artificial Intelligence Research, 10, 213–270.
go back to reference Davenport, A., & Kalagnanam, J. (2004). A computational study of the Kemeny rule for preference aggregation. In D. L. McGuinness & G. Ferguson (Eds). Proceedings of the nineteenth national conference on artificial intelligence, sixteenth conference on innovative applications of artificial intelligence, July 25–29, 2004, San Jose, California. AAAI Press/The MIT Press, USA. Davenport, A., & Kalagnanam, J. (2004). A computational study of the Kemeny rule for preference aggregation. In D. L. McGuinness & G. Ferguson (Eds). Proceedings of the nineteenth national conference on artificial intelligence, sixteenth conference on innovative applications of artificial intelligence, July 2529, 2004, San Jose, California. AAAI Press/The MIT Press, USA.
go back to reference de Condorcet, M. (1785). Essai sur l’application de l’analyse à la probabilité des décisions rendues à la probabilité des voix. Paris: De l’ Imprimerie Royale. de Condorcet, M. (1785). Essai sur l’application de l’analyse à la probabilité des décisions rendues à la probabilité des voix. Paris: De l’ Imprimerie Royale.
go back to reference Dwork, C., Kumar, R., Naor, M., & Sivakumar, D. (2001). Rank aggregation methods for the web. In Proceedings 10th WWW (pp. 613–622). Dwork, C., Kumar, R., Naor, M., & Sivakumar, D. (2001). Rank aggregation methods for the web. In Proceedings 10th WWW (pp. 613–622).
go back to reference Fishburn, P. C. (1970). Utility theory with inexact preferences and degrees of preference. Synthese, 21, 204–222.CrossRef Fishburn, P. C. (1970). Utility theory with inexact preferences and degrees of preference. Synthese, 21, 204–222.CrossRef
go back to reference Fishburn, P. C. (1973a). Binary choice probabilities: on the varieties of stochastic transitivity. Journal of Mathematical Psychology, 10, 327–352.CrossRef Fishburn, P. C. (1973a). Binary choice probabilities: on the varieties of stochastic transitivity. Journal of Mathematical Psychology, 10, 327–352.CrossRef
go back to reference Fishburn, P. C. (1973b). The theory of social choice. Princeton: Princeton University Press. Fishburn, P. C. (1973b). The theory of social choice. Princeton: Princeton University Press.
go back to reference Fishburn, P. C. (1982). Monotonicity paradoxes in the theory of elections. Discrete Applied Mathematics, 4, 119–134.CrossRef Fishburn, P. C. (1982). Monotonicity paradoxes in the theory of elections. Discrete Applied Mathematics, 4, 119–134.CrossRef
go back to reference Fishburn, P. C. (1984). Discrete mathematics in voting and group choice. SIAM Journal of Algebraic and Discrete Methods, 5, 263–275.CrossRef Fishburn, P. C. (1984). Discrete mathematics in voting and group choice. SIAM Journal of Algebraic and Discrete Methods, 5, 263–275.CrossRef
go back to reference Fishburn, P. C., Gehrlein, W. V., & Maskin, E. (1979). Condorcet’s proportions and Kelly’s conjecture. Discrete Applied Mathematics, 1, 229–252.CrossRef Fishburn, P. C., Gehrlein, W. V., & Maskin, E. (1979). Condorcet’s proportions and Kelly’s conjecture. Discrete Applied Mathematics, 1, 229–252.CrossRef
go back to reference Jacquet-Lagrèze, E. (1969). L’agrégation des opinions individuelles. In Informatiques et Sciences Humaines, Vol. 4. Jacquet-Lagrèze, E. (1969). L’agrégation des opinions individuelles. In Informatiques et Sciences Humaines, Vol. 4.
go back to reference Kacprzyk, J., & Roubens, M. (Eds.). (1988). Non-conventional preference relations in decision making. Heidelberg: Springer. Kacprzyk, J., & Roubens, M. (Eds.). (1988). Non-conventional preference relations in decision making. Heidelberg: Springer.
go back to reference Keeney, R., & Raiffa, H. (1976). Decision with multiple objectives: preferences and value trade-offs. New York: Wiley. Keeney, R., & Raiffa, H. (1976). Decision with multiple objectives: preferences and value trade-offs. New York: Wiley.
go back to reference Kelsey, D. (1986). Utility and the individual: An analysis of internal conflicts. Social Choice and Welfare, 3(2), 77–87.CrossRef Kelsey, D. (1986). Utility and the individual: An analysis of internal conflicts. Social Choice and Welfare, 3(2), 77–87.CrossRef
go back to reference Kemeny, J. (1959). Mathematics without numbers. Daedalus, 88, 571–591. Kemeny, J. (1959). Mathematics without numbers. Daedalus, 88, 571–591.
go back to reference Köhler, G. (1978). Choix multicritère et analyse algébrique des données ordinales. Ph.D. Thesis, Université Scientifique et Médicale de Grenoble, France. Köhler, G. (1978). Choix multicritère et analyse algébrique des données ordinales. Ph.D. Thesis, Université Scientifique et Médicale de Grenoble, France.
go back to reference Luce, R. D. (1956). Semiorders and a theory of utility discrimination. Econometrica, 24, 178–191.CrossRef Luce, R. D. (1956). Semiorders and a theory of utility discrimination. Econometrica, 24, 178–191.CrossRef
go back to reference McLean, I. (1990). The Borda and Condorcet principles: Three medieval applications. Social Choice and Welfare, 7, 99–108.CrossRef McLean, I. (1990). The Borda and Condorcet principles: Three medieval applications. Social Choice and Welfare, 7, 99–108.CrossRef
go back to reference Moulin, H. (1985). From social welfare orderings to acyclic aggregation of preferences. Mathematical Social Sciences, 9, 1–17.CrossRef Moulin, H. (1985). From social welfare orderings to acyclic aggregation of preferences. Mathematical Social Sciences, 9, 1–17.CrossRef
go back to reference Moulin, H. (1988). Axioms of co-operative decision making, Econometric Society Monographs. Cambridge: Cambridge University Press. Moulin, H. (1988). Axioms of co-operative decision making, Econometric Society Monographs. Cambridge: Cambridge University Press.
go back to reference Munda, G. (2004). “Social multi-criteria evaluation (SMCE)”: methodological foundations and operational consequences. European Journal of Operational Research, 158(3), 662–677.CrossRef Munda, G. (2004). “Social multi-criteria evaluation (SMCE)”: methodological foundations and operational consequences. European Journal of Operational Research, 158(3), 662–677.CrossRef
go back to reference Munda, G. (2008). Social multi-criteria evaluation for a sustainable economy. Heidelberg, New York: Springer.CrossRef Munda, G. (2008). Social multi-criteria evaluation for a sustainable economy. Heidelberg, New York: Springer.CrossRef
go back to reference Munda, G., & Nardo, M. (2009). Non-compensatory/non-linear composite indicators for ranking countries: A defensible setting. Applied Economics, 41, 1513–1523.CrossRef Munda, G., & Nardo, M. (2009). Non-compensatory/non-linear composite indicators for ranking countries: A defensible setting. Applied Economics, 41, 1513–1523.CrossRef
go back to reference Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffman, A., & Giovannini, E. (2008) OECD/JRC Handbook on constructing composite indicators: methodology and user guide. OECD Statistics Working Paper, Paris, publication code: 302008251E1. Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffman, A., & Giovannini, E. (2008) OECD/JRC Handbook on constructing composite indicators: methodology and user guide. OECD Statistics Working Paper, Paris, publication code: 302008251E1.
go back to reference Ozturk, M., Tsoukias, A., & Vincke, Ph. (2005). Preference modelling. In J. Figueira, S. Greco, & M. Ehrgott (Eds.), Multiple-criteria decision analysis. State of the art surveys (pp. 27–71). New York: Springer International Series in Operations Research and Management Science. Ozturk, M., Tsoukias, A., & Vincke, Ph. (2005). Preference modelling. In J. Figueira, S. Greco, & M. Ehrgott (Eds.), Multiple-criteria decision analysis. State of the art surveys (pp. 27–71). New York: Springer International Series in Operations Research and Management Science.
go back to reference Podinovskii, V. V. (1994). Criteria importance theory. Mathematical Social Sciences, 27, 237–252.CrossRef Podinovskii, V. V. (1994). Criteria importance theory. Mathematical Social Sciences, 27, 237–252.CrossRef
go back to reference Poincaré, H. (1935). La valeur de la science. Paris: Flammarion. Poincaré, H. (1935). La valeur de la science. Paris: Flammarion.
go back to reference Ray, P. (1973). Independence of irrelevant alternatives. Econometrica, 41(5), 987–991.CrossRef Ray, P. (1973). Independence of irrelevant alternatives. Econometrica, 41(5), 987–991.CrossRef
go back to reference Roberts, F. S. (1979). Measurement theory with applications to decision making, utility and the social sciences. London: Addison-Wesley. Roberts, F. S. (1979). Measurement theory with applications to decision making, utility and the social sciences. London: Addison-Wesley.
go back to reference Roubens, M., & Vincke, Ph. (1985). Preference modelling. Heidelberg: Springer.CrossRef Roubens, M., & Vincke, Ph. (1985). Preference modelling. Heidelberg: Springer.CrossRef
go back to reference Roy, B. (1985). Méthodologie multicritere d’ aide à la decision. Economica, Paris. Roy, B. (1985). Méthodologie multicritere d’ aide à la decision. Economica, Paris.
go back to reference Roy, B. (1996). Multicriteria methodology for decision analysis. Dordrecht: Kluwer. Roy, B. (1996). Multicriteria methodology for decision analysis. Dordrecht: Kluwer.
go back to reference Saari, D. G. (1989). A dictionary for voting paradoxes. Journal of Economic Theory, 48, 443–475.CrossRef Saari, D. G. (1989). A dictionary for voting paradoxes. Journal of Economic Theory, 48, 443–475.CrossRef
go back to reference Saari, D. G. (2000). Mathematical structure of voting paradoxes. 1. Pairwise votes. Economic Theory, 15, 1–53.CrossRef Saari, D. G. (2000). Mathematical structure of voting paradoxes. 1. Pairwise votes. Economic Theory, 15, 1–53.CrossRef
go back to reference Saari, D. G. (2006). Which is better: The Condorcet or Borda winner? Social Choice and Welfare, 26, 107–129.CrossRef Saari, D. G. (2006). Which is better: The Condorcet or Borda winner? Social Choice and Welfare, 26, 107–129.CrossRef
go back to reference Saari, D. G., & Merlin, V. R. (2000). A geometric examination of Kemeny’s rule. Social Choice and Welfare, 17, 403–438.CrossRef Saari, D. G., & Merlin, V. R. (2000). A geometric examination of Kemeny’s rule. Social Choice and Welfare, 17, 403–438.CrossRef
go back to reference Saltelli, A. (2007). Composite indicators between analysis and advocacy. Social Indicators Research, 81, 65–77.CrossRef Saltelli, A. (2007). Composite indicators between analysis and advocacy. Social Indicators Research, 81, 65–77.CrossRef
go back to reference Simon, H. A. (1983). Reason in human affairs. Stanford: Stanford University Press. Simon, H. A. (1983). Reason in human affairs. Stanford: Stanford University Press.
go back to reference Sugden, R. (2010). Opportunity as mutual advantage. Economics and Philosophy, 26, 47–68.CrossRef Sugden, R. (2010). Opportunity as mutual advantage. Economics and Philosophy, 26, 47–68.CrossRef
go back to reference Truchon, M. (1995). Voting games and acyclic collective choice rules. Mathematical Social Sciences, 25, 165–179.CrossRef Truchon, M. (1995). Voting games and acyclic collective choice rules. Mathematical Social Sciences, 25, 165–179.CrossRef
go back to reference Truchon, M. (1998). An extension of the Condorcet criterion and Kemeny orders. Cahier 9813 du Centre de Recherche en Economie et Finance Appliquées (CREFA). Truchon, M. (1998). An extension of the Condorcet criterion and Kemeny orders. Cahier 9813 du Centre de Recherche en Economie et Finance Appliquées (CREFA).
go back to reference Vansnick, J. C. (1990). Measurement theory and decision aid. In C. A. Bana e Costa (Ed.), Readings in multiple criteria decision aid (pp. 81–100). Berlin: Springer.CrossRef Vansnick, J. C. (1990). Measurement theory and decision aid. In C. A. Bana e Costa (Ed.), Readings in multiple criteria decision aid (pp. 81–100). Berlin: Springer.CrossRef
go back to reference Vidu, L. (2002). Majority cycles in a multi-dimensional setting. Economic Theory, 20, 373–386.CrossRef Vidu, L. (2002). Majority cycles in a multi-dimensional setting. Economic Theory, 20, 373–386.CrossRef
go back to reference Weber, J. (2002). How many voters are needed for paradoxes? Economic Theory, 20, 341–355.CrossRef Weber, J. (2002). How many voters are needed for paradoxes? Economic Theory, 20, 341–355.CrossRef
go back to reference Young, H. P. (1986). Optimal ranking and choice from pair-wise comparisons. In B. Grofman & G. Owen (Eds.), Information pooling and group decision-making. Greenwuich, CT: JAL. Young, H. P. (1986). Optimal ranking and choice from pair-wise comparisons. In B. Grofman & G. Owen (Eds.), Information pooling and group decision-making. Greenwuich, CT: JAL.
go back to reference Young, H. P. (1988). Condorcet’s theory of voting. American Political Science Review, 82(4), 1231–1244.CrossRef Young, H. P. (1988). Condorcet’s theory of voting. American Political Science Review, 82(4), 1231–1244.CrossRef
go back to reference Young, H. P. (1995). Optimal voting rules. Journal of Economic Perspectives, 9, 51–64.CrossRef Young, H. P. (1995). Optimal voting rules. Journal of Economic Perspectives, 9, 51–64.CrossRef
go back to reference Young, H. P., & Levenglick, A. (1978). A consistent extension of Condorcet’s election principle. SIAM Journal of Applied Mathematics, 35, 285–300.CrossRef Young, H. P., & Levenglick, A. (1978). A consistent extension of Condorcet’s election principle. SIAM Journal of Applied Mathematics, 35, 285–300.CrossRef
Metadata
Title
Choosing Aggregation Rules for Composite Indicators
Author
Giuseppe Munda
Publication date
01-12-2012
Publisher
Springer Netherlands
Published in
Social Indicators Research / Issue 3/2012
Print ISSN: 0303-8300
Electronic ISSN: 1573-0921
DOI
https://doi.org/10.1007/s11205-011-9911-9

Other articles of this Issue 3/2012

Social Indicators Research 3/2012 Go to the issue