Skip to main content
Top
Published in: Quality & Quantity 4/2016

28-05-2015

Towards greater validity in Schwartz’s portrait values indicator using experimental research

Authors: Jacques P. de Wet, Johann Bacher, Daniela Wetzelhütter

Published in: Quality & Quantity | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In Schwartz’s 21-item portrait values questionnaire (PVQ) each item consists of two statements which refer to a single underling value. In each of the 21 items the respondents are asked to give a single response to the two statements. Anecdotal evidence and cognitive response theory alert us to potential measurement error in this two-statements-single-response approach. Respondents might be influenced by different themes contained in the statements and their answers might not be comparable. This paper addresses the question: Do the responses to the 21 items in Schwartz’s PVQ (where each item contains two statements) differ significantly when two separate responses are allowed per item (in the split version) compared to when a single response is allowed (in the combined version)? In order to answer this research question we adopted an experimental design in a two-wave panel study. In the first wave we used Schwartz’s combined version of the PVQ. In the second wave we split the two statements and treated each statement as a separate item, thus requiring responses to each statement. Data was collected from Sociology classes at two universities: one in Austria (n = 52) and the other in South Africa (n = 61). We used statistical and non-statistical methods of analysis. The overall statistical assessment (z test) supports the split version although not all the various z test results unanimously concur. The non-statistical assessment does not support either the split version or the combined version. These mixed results necessitate further interrogation of the continued use of the combined version in the PVQ.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
Cieciuch et al. (2013) argue that a revised version, which has 19 more narrowly defined motivationally distinct values, has more heuristic power than the old ten values. This recently refined theory gave rise to a revised 57-item instrument that replicated the PVQ methodology (Cieciuch et al. 2013). This new development, which Cieciuch et al. (2013) call a “magnifying glass strategy”, was not available when we started our research and so we worked with the well established ten values and the 21-item PVQ. Furthermore, the shorter questionnaire was less taxing to complete in our two-wave panel experiment. In the future we could repeat our experiment using the refined theory, 19 values and the 57-item instrument.
 
2
Schwartz’s two-dimensional value space was developed in order to map empirical data based on Schwartz’s two-dimensional theoretical model.
 
3
Schwartz (2009) makes a clear reference to his starting configuration, but in other publications where the two-dimensional value space is computed the starting configuration is not always mentioned. We cannot confirm, therefore, that the same starting configuration is used consistently by Schwartz.
 
4
This method of counting the number of necessary moves to fit the theoretical model is taken from Schwartz’s 1994 publication (see Schwartz 1994). However, in other publications (e.g. Schwartz 1992) he does not refer to this method. Sometimes he refers to “deviations” rather than counted moves (see Schwartz 2009, Bilsky et al. 2011), but no detail is provided.
 
5
The z values for the combined version test the hypothesis that the number normalised moves for the combined version is smaller than the number of normalised moves for the split version. This hypothesis is the alternative of the hypothesis that the number of normalised moves for the split version is smaller than the number of normalised moves for the combined version. Mathematically speaking the z values for the combined version are the z values of the split version multiplied by −1.
 
6
Johann Bacher suggested the generalisation of Stouffer’s combined test.
 
Literature
go back to reference Allport, G.W.: Pattern and Growth in Personality. Holt, Rinehart & Winston, New York (1961) Allport, G.W.: Pattern and Growth in Personality. Holt, Rinehart & Winston, New York (1961)
go back to reference Archdeacon, T.J.: Correlation and Regression Analysis: A Historian’s Guide. University of Wisconsin Press, Wisconsin (1994) Archdeacon, T.J.: Correlation and Regression Analysis: A Historian’s Guide. University of Wisconsin Press, Wisconsin (1994)
go back to reference Bilsky, W., Janik, M., Schwartz, S.H.: The structural organization of human values—evidence from three rounds of the European Social Survey (ESS). J. Cross Cult. Psychol. 42(5), 759–776 (2011)CrossRef Bilsky, W., Janik, M., Schwartz, S.H.: The structural organization of human values—evidence from three rounds of the European Social Survey (ESS). J. Cross Cult. Psychol. 42(5), 759–776 (2011)CrossRef
go back to reference Borg, I., Groenen, P.J.F.: Modern Multidimensional Scaling. Theory and Application, 2nd edn. Springer, New York (2005) Borg, I., Groenen, P.J.F.: Modern Multidimensional Scaling. Theory and Application, 2nd edn. Springer, New York (2005)
go back to reference Cieciuch, J., Schwartz, S.H.: The number of distinct basic values and their structure assessed by PVQ-40. J. Personal. Assess. 94, 321–328 (2012)CrossRef Cieciuch, J., Schwartz, S.H.: The number of distinct basic values and their structure assessed by PVQ-40. J. Personal. Assess. 94, 321–328 (2012)CrossRef
go back to reference Cieciuch, J., Schwartz, S.H., Vecchione, M.: Applying the refined values theory to past data: what can researchers gain? J. Cross Cult. Psychol. 44(8), 1215–1234 (2013)CrossRef Cieciuch, J., Schwartz, S.H., Vecchione, M.: Applying the refined values theory to past data: what can researchers gain? J. Cross Cult. Psychol. 44(8), 1215–1234 (2013)CrossRef
go back to reference Cox, T.F., Cox, M.A.A.: Multidimensional Scaling, 2nd edn. Chapman and Hall/CRC, Boca Raton (2001) Cox, T.F., Cox, M.A.A.: Multidimensional Scaling, 2nd edn. Chapman and Hall/CRC, Boca Raton (2001)
go back to reference De Maio, T.J., Landreth, A.: Do different cognitive interview techniques produce different results? In: Presser, S., Rothgeb, J.M., Couper, M.P., Lessler, J.T., Martin, E., Martin, J., Singer, E. (eds.) Methods for Testing and Evaluating Survey Questions, pp. 89–108. Wiley, Chichester (2004) De Maio, T.J., Landreth, A.: Do different cognitive interview techniques produce different results? In: Presser, S., Rothgeb, J.M., Couper, M.P., Lessler, J.T., Martin, E., Martin, J., Singer, E. (eds.) Methods for Testing and Evaluating Survey Questions, pp. 89–108. Wiley, Chichester (2004)
go back to reference Feather, N.T.: Values, valences and choice: the influence of values on the perceived attractiveness and choice of alternatives. J. Personal. Soc. Psychol. 68, 1135–1151 (1995)CrossRef Feather, N.T.: Values, valences and choice: the influence of values on the perceived attractiveness and choice of alternatives. J. Personal. Soc. Psychol. 68, 1135–1151 (1995)CrossRef
go back to reference Groves, R.M., Fowler, F.J., Couper, M.P., Lepkowski, J.M., Singer, E., Tourangeau, R.: Survey Methodology, 2nd edn. Wiley, Hoboken, NJ (2009) Groves, R.M., Fowler, F.J., Couper, M.P., Lepkowski, J.M., Singer, E., Tourangeau, R.: Survey Methodology, 2nd edn. Wiley, Hoboken, NJ (2009)
go back to reference Hartung, J., Knapp, G., Sinha, B.K.: Statistical Meta-Analysis with Applications. Wiley, Hoboken (2008)CrossRef Hartung, J., Knapp, G., Sinha, B.K.: Statistical Meta-Analysis with Applications. Wiley, Hoboken (2008)CrossRef
go back to reference Inglehart, R.: Modernization and Postmodernization. Princeton University Press, Princeton, NJ (1997) Inglehart, R.: Modernization and Postmodernization. Princeton University Press, Princeton, NJ (1997)
go back to reference Kluckhohn, C.: Values and value-orientations in the theory of action: an exploration in definition and classification. In: Parsons, T., Shils, E. (eds.) Toward a General Theory of Action, pp. 388–433. Harvard University Press, Cambridge, MA (1951) Kluckhohn, C.: Values and value-orientations in the theory of action: an exploration in definition and classification. In: Parsons, T., Shils, E. (eds.) Toward a General Theory of Action, pp. 388–433. Harvard University Press, Cambridge, MA (1951)
go back to reference Kohn, M.L.: Class and Conformity. Dorsey Press, Homewood, Il (1969) Kohn, M.L.: Class and Conformity. Dorsey Press, Homewood, Il (1969)
go back to reference Krosnick, J.A., Presser, S.: Question and Questionnaire Design. In Handbook of Survey Research. Emerald, West Yorkshire (2010) Krosnick, J.A., Presser, S.: Question and Questionnaire Design. In Handbook of Survey Research. Emerald, West Yorkshire (2010)
go back to reference Morris, C.W.: Varieties of Human Value. University of Chicago Press, Chicago (1956)CrossRef Morris, C.W.: Varieties of Human Value. University of Chicago Press, Chicago (1956)CrossRef
go back to reference Neuman, W.L.: Social Research Methods. Qualitative and Quantitative Approaches. Allyn & Bacon, Boston (2000) Neuman, W.L.: Social Research Methods. Qualitative and Quantitative Approaches. Allyn & Bacon, Boston (2000)
go back to reference Rokeach, M.: The Nature of Human Values. Free Press, New York (1973) Rokeach, M.: The Nature of Human Values. Free Press, New York (1973)
go back to reference Rosenthal, R., Rubin, D.B.: Meta-analytic procedures for combined studies with multiple effect sizes. Psychol. Bulletin. 99(3), 400–406 (1986) Rosenthal, R., Rubin, D.B.: Meta-analytic procedures for combined studies with multiple effect sizes. Psychol. Bulletin. 99(3), 400–406 (1986)
go back to reference Schwartz, S.H.: Universals in the content and structure of values: theory and empirical tests in 20 countries. In: Zanna, M. (ed.) Advances in Experimental Social Psychology, vol. 25, pp. 1–65. Academic Press, New York (1992) Schwartz, S.H.: Universals in the content and structure of values: theory and empirical tests in 20 countries. In: Zanna, M. (ed.) Advances in Experimental Social Psychology, vol. 25, pp. 1–65. Academic Press, New York (1992)
go back to reference Schwartz, S.H.: Are there universal aspects in the structure and contents of human values. J. Soc. Issues 50(4), 19–45 (1994)CrossRef Schwartz, S.H.: Are there universal aspects in the structure and contents of human values. J. Soc. Issues 50(4), 19–45 (1994)CrossRef
go back to reference Schwartz, S.H.: Value priorities and behavior: applying of theory of integrated value systems. In: Seligman, C., Olson, J.M., Zanna, M.P. (eds.) The Psychology of Values: The Ontario Symposium, vol. 8, pp. 1–24. Erlbaum, Hillsdale, NJ (1996) Schwartz, S.H.: Value priorities and behavior: applying of theory of integrated value systems. In: Seligman, C., Olson, J.M., Zanna, M.P. (eds.) The Psychology of Values: The Ontario Symposium, vol. 8, pp. 1–24. Erlbaum, Hillsdale, NJ (1996)
go back to reference Schwartz, S.H.: Basic human values: their content and structure across countries. In: Tamayo, A., Porto, J.B. (eds.) Valores e comportamento nas organizações [Values and behavior in organizations], pp. 21–55. Vozes, Petrópolis (2005a) Schwartz, S.H.: Basic human values: their content and structure across countries. In: Tamayo, A., Porto, J.B. (eds.) Valores e comportamento nas organizações [Values and behavior in organizations], pp. 21–55. Vozes, Petrópolis (2005a)
go back to reference Schwartz, S.H.: Robustness and fruitfulness of a theory of universals in individual human values. In: Tamayo, A., Porto, J.B. (eds.) Valores e comportamento nas organizações [Values and behavior in organizations], pp. 56–95. Vozes, Petrópolis (2005b) Schwartz, S.H.: Robustness and fruitfulness of a theory of universals in individual human values. In: Tamayo, A., Porto, J.B. (eds.) Valores e comportamento nas organizações [Values and behavior in organizations], pp. 56–95. Vozes, Petrópolis (2005b)
go back to reference Schwartz, S.H.: Les valeurs de base de la personne: théorie, mesures et applications [Basic human values: theory, measurement, and applications]. Rev Fr de Sociol 47, 249–288 (2006) Schwartz, S.H.: Les valeurs de base de la personne: théorie, mesures et applications [Basic human values: theory, measurement, and applications]. Rev Fr de Sociol 47, 249–288 (2006)
go back to reference Schwartz, S.H.: Value orientations: measurement, antecedents and consequences across nations. In: Jowell, R., Roberts, C., Fitzgeral, R., Eva, G. (eds.) Measuring Attitudes Cross-Nationally. Lessons from the European Social Survey. Sage Publications, London (2007) Schwartz, S.H.: Value orientations: measurement, antecedents and consequences across nations. In: Jowell, R., Roberts, C., Fitzgeral, R., Eva, G. (eds.) Measuring Attitudes Cross-Nationally. Lessons from the European Social Survey. Sage Publications, London (2007)
go back to reference Schwartz, S.H., Bardi, A.: Influences of adaptation to communist rule on value priorities in Eastern Europe. Polit Psychol 18, 385–410 (1997)CrossRef Schwartz, S.H., Bardi, A.: Influences of adaptation to communist rule on value priorities in Eastern Europe. Polit Psychol 18, 385–410 (1997)CrossRef
go back to reference Schwartz, S.H., Bilsky, W.: Toward a universal psychological structure of human values. J. Personal. Soc. Psychol. 53, 550–562 (1987)CrossRef Schwartz, S.H., Bilsky, W.: Toward a universal psychological structure of human values. J. Personal. Soc. Psychol. 53, 550–562 (1987)CrossRef
go back to reference Schwartz, S.H., Boehnke, K.: Evaluating the structure of human values with confirmatory factor analysis. J. Res. Personal. 38, 230–255 (2004)CrossRef Schwartz, S.H., Boehnke, K.: Evaluating the structure of human values with confirmatory factor analysis. J. Res. Personal. 38, 230–255 (2004)CrossRef
go back to reference Schwartz, S.H., Rubel, T.: Sex differences in value priorities: cross-cultural and multimethod studies. J. Personal. Soc. Psychol. 89, 1010–1028 (2005)CrossRef Schwartz, S.H., Rubel, T.: Sex differences in value priorities: cross-cultural and multimethod studies. J. Personal. Soc. Psychol. 89, 1010–1028 (2005)CrossRef
go back to reference Schwartz, S.H., Melech, G., Lehmann, A., Burgess, S., Harris, M., Owens, V.: Extending the cross-cultural validity of the theory of basic human values with a different method of measurement. J. Cross Cult. Psychol. 32(5), 519–542 (2001)CrossRef Schwartz, S.H., Melech, G., Lehmann, A., Burgess, S., Harris, M., Owens, V.: Extending the cross-cultural validity of the theory of basic human values with a different method of measurement. J. Cross Cult. Psychol. 32(5), 519–542 (2001)CrossRef
go back to reference Sudman, S., Bradburn, N.M., Schwarz, N.: Thinking About Answers. The Application of Cognitive Process to Survey Methodology. Wiley, New York (1996) Sudman, S., Bradburn, N.M., Schwarz, N.: Thinking About Answers. The Application of Cognitive Process to Survey Methodology. Wiley, New York (1996)
go back to reference Tracz, S.M., Elmore, P.B., Pohlmann, J.T.: Correlational meta-Analysis: Independent and nonindependent cases. Educ. Psychol. Meas. 52, 879–893 (1992) Tracz, S.M., Elmore, P.B., Pohlmann, J.T.: Correlational meta-Analysis: Independent and nonindependent cases. Educ. Psychol. Meas. 52, 879–893 (1992)
go back to reference Van der Veld, W.M., Saris, W.E.A.: Unified Model for the Survey Response Process. Conference paper. European Association for Survey Research. Barcelonia (2005) Van der Veld, W.M., Saris, W.E.A.: Unified Model for the Survey Response Process. Conference paper. European Association for Survey Research. Barcelonia (2005)
go back to reference Wolf, F.M.: Meta-Analysis. Quantitative Methods for Research Synthesis. SAGE, Newbury Park (1986) Wolf, F.M.: Meta-Analysis. Quantitative Methods for Research Synthesis. SAGE, Newbury Park (1986)
Metadata
Title
Towards greater validity in Schwartz’s portrait values indicator using experimental research
Authors
Jacques P. de Wet
Johann Bacher
Daniela Wetzelhütter
Publication date
28-05-2015
Publisher
Springer Netherlands
Published in
Quality & Quantity / Issue 4/2016
Print ISSN: 0033-5177
Electronic ISSN: 1573-7845
DOI
https://doi.org/10.1007/s11135-015-0221-1

Other articles of this Issue 4/2016

Quality & Quantity 4/2016 Go to the issue

Premium Partner