Abstract
Data equivalence refers to the extent to which the elements of a research design have the same meaning, and can be applied in the same way, in different cultural contexts. Failure to establish data equivalence in cross-cultural studies may bias empirical results and theoretical inferences. Although several authors have encouraged researchers to ensure high levels of data equivalence, no study has assessed the status of the field in relation to compliance with data equivalence standards. Accordingly, this study examines three aspects of data equivalence (construct equivalence, measurement equivalence, and data collection equivalence) within 167 studies that involve cross-cultural data published in the Journal of International Business Studies, Management International Review, Journal of World Business, Strategic Management Journal and the Academy of Management Journal from 1995 to 2005. The findings indicate that international business researchers report insufficient information in relation to data equivalence issues, thus limiting confidence in the findings of many cross-cultural studies. To enhance future research, a guideline for procedures for researchers to follow and report in establishing data equivalence is offered.
Similar content being viewed by others
Notes
We have included 20 studies that were conducted in a single country, but surveyed companies or managers from different countries.
The percentages do not total to 100% owing to rounding.
The Tamhane test was used for post hoc comparisons. Further, it is important to note that there were significant differences in sample sizes across journals: thus the post hoc analysis should be viewed with caution.
References
Anderson, J. C., & Gerbing, D. W. 1988. Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103 (3): 411–423.
Balabanis, G., Diamantopoulos, A., Mueller, R. D., & Melewar, T. C. 2001. The impact of nationalism, patriotism and internationalism on consumer ethnocentric tendencies. Journal of International Business Studies, 32 (1): 157–175.
Bensaou, M., Coyne, M., & Venkatraman, N. 1999. Testing metric equivalence in cross-national strategy research: An empirical test across the United States and Japan. Strategic Management Journal, 20 (7): 671–689.
Bollen, K. A. 1989. Structural equations with latent variables. New York: John Wiley & Sons.
Boyacigiller, N. A., & Adler, N. J. 1991. The parochial dinosaur: Organizational science in a global context. Academy of Management Review, 16 (2): 262–290.
Brislin, R. W., Lonner, W. J., & Thorndike, R. M. 1973. Cross-cultural research methods. New York: John Wiley.
Calantone, R. J., Schmidt, J. B., & Song, X. M. 1996. Controllable factors of new product success: A cross-national comparison. Marketing Science, 15 (4): 341–358.
Campbell, D. T., & Fiske, D. W. 1959. Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin, 56 (2): 81–105.
Cavusgil, S. T., & Das, A. 1997. Methodological issues in empirical cross-cultural research: A survey of the management literature and a framework. Management International Review, 37 (1): 71–96.
Churchill Jr, G. A. 1979. A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 16 (1): 64–73.
Combs, J. G., & Ketchen, D. J. 2003. Why do firms use franchising as an entrepreneurial strategy? A meta-analysis. Journal of Management, 29 (3): 443–465.
Craig, C. S., & Douglas, S. P. 2000. International market research, 2nd edn. Chichester: John Wiley & Sons.
Cronbach, L. J. 1951. Coefficient alpha and the internal structure of tests. Psychometrika, 16 (3): 297–334.
Davis, H. L., Douglas, S. P., & Silk, A. J. 1981. Measure unreliability: A hidden threat to cross-national marketing research? Journal of Marketing, 45 (2): 98–109.
DuBois, F. L., & Reeb, D. 2000. Ranking the international business journals. Journal of International Business Studies, 31 (4): 689–704.
Durvasula, S., Andrews, J. C., Lysonski, S., & Netemeyer, R. G. 1993. Assessing the cross-national applicability of consumer behavior models: A model of attitude toward advertising in general. Journal of Consumer Research, 19 (4): 626–636.
Fornell, C., & Larcker, D. F. 1981. Structural equation models with unobservable variables and measurement error: Algebra and statistics. Journal of Marketing Research, 18 (3): 382–388.
Gerbing, D. W., & Anderson, J. C. 1992. Monte Carlo evaluations of goodness-of-fit indices for structural equation models. Sociological Methods and Research, 21 (2): 132–160.
Gibson, C. B. 1995. An investigation of gender differences in leadership across four countries. Journal of International Business Studies, 26 (2): 255–279.
Harpaz, I., Honig, B., & Coetsier, P. 2002. A cross-cultural longitudinal analysis of the meaning of work and the socialization process of career starters. Journal of World Business, 37 (4): 230–244.
Hofstede, G. 1980. Culture's consequences: International differences in work-related values. Newbury Park, CA: Sage.
Horn, J. L. 1991. Comments on issues in factorial invariance. In L. M. Collins and J. H. Horn (Eds) Best methods for the analysis of change: 114–125. Washington, DC: American Psychological Association.
Kumar, V. 2000. International marketing research. Upper Saddle River, NJ: Prentice-Hall.
Lenartowicz, T., & Johnson, J. P. 2002. Comparing managerial values in twelve Latin American countries: An exploratory study. Management International Review, 42 (3): 279–307.
Messick, S. 1995. Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50 (9): 741–749.
Mintu, A. T., Calantone, R. J., & Gassenheimer, J. B. 1994. Towards improving cross-cultural research: Extending Churchill's research paradigm. Journal of International Marketing, 7 (2): 5–23.
Mullen, M. R. 1995. Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 26 (3): 573–596.
Myers, M. B., Calantone, R. J., Page, T. J., & Taylor, C. R. 2000. Academic insights: An application of multiple-group causal models in assessing cross-cultural measurement equivalence. Journal of International Marketing, 8 (4): 108–121.
Nunnally, J. C. 1978. Psychometric theory. New York: McGraw-Hill.
Peterson, R. A. 2001. On the use of college students in social science research: Insights from a second-order meta-analysis. Journal of Consumer Research, 28 (3): 450–461.
Peterson, M. F., Smith, P. B., Akande, A., Ayestaran, S., et al. 1995. Role conflict, ambiguity, and overload: A 21-nation study. Academy of Management Journal, 38 (2): 429–452.
Reynolds, N. L., Simintiras, A. C., & Diamantopoulos, A. 2003. Theoretical justification of sampling choices in international marketing research: Key issues and guidelines for researchers. Journal of International Business Studies, 34 (1): 80–89.
Robertson, C., Al-Khatib, J., Al-Habib, M., & Lanoue, D. 2001. Beliefs about work in the Middle East and the convergence versus divergence of values. Journal of World Business, 36 (3): 223–244.
Salzberger, T., Sinkovics, R. R., & Schlegelmilch, B. B. 2001. Data equivalence in international research: A comparison of classical test theory and latent trait theory based approaches. Australasian Marketing Journal, 7 (2): 23–38.
Schwarz, N. 2003. Self-reports in consumer research: The challenge of comparing cohorts and cultures. Journal of Consumer Research, 29 (4): 588–594.
Sekaran, U. 1983. Methodological and theoretical issues and advancements in cross-cultural research. Journal of International Business Studies, 14 (2): 61–73.
Singh, J. 1995. Measurement issues in cross-national research. Journal of International Business Studies, 26 (3): 597–619.
Sivakumar, K., & Nakata, C. 2001. The stampede toward Hofstede's framework: Avoiding the sample design pit in cross-cultural research. Journal of International Business Studies, 32 (3): 555–574.
Sperber, A. D., Devellis, R. F., & Boehlecke, B. 1994. Cross-cultural translation: Methodology and validation. Journal of Cross-Cultural Psychology, 25 (4): 501–524.
Steenkamp, J.-B. E., & Baumgartner, H. 1998. Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25 (1): 78–90.
Steenkamp, J.-B. E., & Baumgartner, H. 2001. Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38 (2): 143–156.
Tahai, A., & Meyer, M. H. 1999. A revealed preference study of management journals’ direct influences. Strategic Management Journal, 20 (3): 279–296.
van de Vijver, F., & Leung, K. 1997. Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage Publications.
Wong, N., Rindfleisch, A., & Burroughs, J. E. 2003. Do reverse-worded items confound measures in cross-cultural consumer research? The case of the material values scale. Journal of Consumer Research, 30 (1): 72–91.
Wright, R. W. 1970. Trends in international business research. Journal of International Business Studies, 1 (1): 109–123.
Acknowledgements
We appreciate the guidance provided by Editor-in-Chief Arie Lewin and the anonymous reviewers, as well as research funding from the Center for International Business Education and Research at Michigan State University (MSU-CIBER).
Author information
Authors and Affiliations
Corresponding author
Additional information
Accepted by Arie Y Lewin, Editor-in-Chief, 21 August 2007. This paper has been with the authors for two revisions.
APPENDIX
APPENDIX
Coding Form
Construct equivalence: Are we studying the same phenomena in countries X, Y, and Z?
Functional equivalence: Checked whether a given concept or behavior serves the same function from country to country (including literature review).
Conceptual equivalence: Checked whether the same concepts/behaviors occur in different countries – the way in which they are expressed is similar.
Category equivalence: Checked same product attributes/characteristics considered.
Post data collection: Checked for tests for unidimensionaliy, reliability, convergent validity, discriminant validity
Any specifically national or cultural constructs?
Measurement equivalence: Are the phenomena in countries X, Y, and Z measured in the same way?
Calibration equivalence: For example, monetary units, measures of weights, distance and volume and perceptual cues; compared factor loadings (λ's) (via multigroup SEM); checked for the comparability of standards and units.
Translation equivalence: Checked whether the concept can be measured by using the same or similar questions in every country.
Method of translation/back-translation reported.
Metric equivalence: Checked for scoring consistency: compared reliabilities or compared measurement error variances (δ's).
Checked for scaling equivalence: Multimethod of measurement, profile analysis, optimal scaling or compared measurement error variances (δ's) and factor loadings (λ's) (via multigroup SEM).
Decentered or adapted scoring/scaling for that country?
Any other cultural biases (e.g., exaggerated or mean responses) accounted for?
Data collection equivalence: Are the data collection procedures in countries X, Y, and Z the same?
Criterion for country/culture selection (convenience, theoretical justification); sufficient variance between countries/cultures.
Sample size for each country/culture studied.
Relevant or same respondent for each country (manager, decision-maker, executive, etc.).
Sampling frame techniques match between countries?
Sampling frame comparability.
Coverage comparability.
Countries where the survey was developed.
Sampling procedure equivalence (telephone interviews, surveys, etc.) (do procedures match?).
Any procedure for non-sampling/non-response bias?
Sampling method in each country
Rights and permissions
About this article
Cite this article
Hult, G., Ketchen, D., Griffith, D. et al. Data equivalence in cross-cultural international business research: assessment and guidelines. J Int Bus Stud 39, 1027–1044 (2008). https://doi.org/10.1057/palgrave.jibs.8400396
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1057/palgrave.jibs.8400396