Skip to main content
Log in

Data equivalence in cross-cultural international business research: assessment and guidelines

  • Article
  • Published:
Journal of International Business Studies Aims and scope Submit manuscript

Abstract

Data equivalence refers to the extent to which the elements of a research design have the same meaning, and can be applied in the same way, in different cultural contexts. Failure to establish data equivalence in cross-cultural studies may bias empirical results and theoretical inferences. Although several authors have encouraged researchers to ensure high levels of data equivalence, no study has assessed the status of the field in relation to compliance with data equivalence standards. Accordingly, this study examines three aspects of data equivalence (construct equivalence, measurement equivalence, and data collection equivalence) within 167 studies that involve cross-cultural data published in the Journal of International Business Studies, Management International Review, Journal of World Business, Strategic Management Journal and the Academy of Management Journal from 1995 to 2005. The findings indicate that international business researchers report insufficient information in relation to data equivalence issues, thus limiting confidence in the findings of many cross-cultural studies. To enhance future research, a guideline for procedures for researchers to follow and report in establishing data equivalence is offered.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. We have included 20 studies that were conducted in a single country, but surveyed companies or managers from different countries.

  2. The percentages do not total to 100% owing to rounding.

  3. The Tamhane test was used for post hoc comparisons. Further, it is important to note that there were significant differences in sample sizes across journals: thus the post hoc analysis should be viewed with caution.

References

  • Anderson, J. C., & Gerbing, D. W. 1988. Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103 (3): 411–423.

    Article  Google Scholar 

  • Balabanis, G., Diamantopoulos, A., Mueller, R. D., & Melewar, T. C. 2001. The impact of nationalism, patriotism and internationalism on consumer ethnocentric tendencies. Journal of International Business Studies, 32 (1): 157–175.

    Article  Google Scholar 

  • Bensaou, M., Coyne, M., & Venkatraman, N. 1999. Testing metric equivalence in cross-national strategy research: An empirical test across the United States and Japan. Strategic Management Journal, 20 (7): 671–689.

    Article  Google Scholar 

  • Bollen, K. A. 1989. Structural equations with latent variables. New York: John Wiley & Sons.

    Book  Google Scholar 

  • Boyacigiller, N. A., & Adler, N. J. 1991. The parochial dinosaur: Organizational science in a global context. Academy of Management Review, 16 (2): 262–290.

    Google Scholar 

  • Brislin, R. W., Lonner, W. J., & Thorndike, R. M. 1973. Cross-cultural research methods. New York: John Wiley.

    Google Scholar 

  • Calantone, R. J., Schmidt, J. B., & Song, X. M. 1996. Controllable factors of new product success: A cross-national comparison. Marketing Science, 15 (4): 341–358.

    Article  Google Scholar 

  • Campbell, D. T., & Fiske, D. W. 1959. Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin, 56 (2): 81–105.

    Article  Google Scholar 

  • Cavusgil, S. T., & Das, A. 1997. Methodological issues in empirical cross-cultural research: A survey of the management literature and a framework. Management International Review, 37 (1): 71–96.

    Google Scholar 

  • Churchill Jr, G. A. 1979. A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 16 (1): 64–73.

    Article  Google Scholar 

  • Combs, J. G., & Ketchen, D. J. 2003. Why do firms use franchising as an entrepreneurial strategy? A meta-analysis. Journal of Management, 29 (3): 443–465.

    Article  Google Scholar 

  • Craig, C. S., & Douglas, S. P. 2000. International market research, 2nd edn. Chichester: John Wiley & Sons.

    Google Scholar 

  • Cronbach, L. J. 1951. Coefficient alpha and the internal structure of tests. Psychometrika, 16 (3): 297–334.

    Article  Google Scholar 

  • Davis, H. L., Douglas, S. P., & Silk, A. J. 1981. Measure unreliability: A hidden threat to cross-national marketing research? Journal of Marketing, 45 (2): 98–109.

    Article  Google Scholar 

  • DuBois, F. L., & Reeb, D. 2000. Ranking the international business journals. Journal of International Business Studies, 31 (4): 689–704.

    Article  Google Scholar 

  • Durvasula, S., Andrews, J. C., Lysonski, S., & Netemeyer, R. G. 1993. Assessing the cross-national applicability of consumer behavior models: A model of attitude toward advertising in general. Journal of Consumer Research, 19 (4): 626–636.

    Article  Google Scholar 

  • Fornell, C., & Larcker, D. F. 1981. Structural equation models with unobservable variables and measurement error: Algebra and statistics. Journal of Marketing Research, 18 (3): 382–388.

    Article  Google Scholar 

  • Gerbing, D. W., & Anderson, J. C. 1992. Monte Carlo evaluations of goodness-of-fit indices for structural equation models. Sociological Methods and Research, 21 (2): 132–160.

    Article  Google Scholar 

  • Gibson, C. B. 1995. An investigation of gender differences in leadership across four countries. Journal of International Business Studies, 26 (2): 255–279.

    Article  Google Scholar 

  • Harpaz, I., Honig, B., & Coetsier, P. 2002. A cross-cultural longitudinal analysis of the meaning of work and the socialization process of career starters. Journal of World Business, 37 (4): 230–244.

    Article  Google Scholar 

  • Hofstede, G. 1980. Culture's consequences: International differences in work-related values. Newbury Park, CA: Sage.

    Google Scholar 

  • Horn, J. L. 1991. Comments on issues in factorial invariance. In L. M. Collins and J. H. Horn (Eds) Best methods for the analysis of change: 114–125. Washington, DC: American Psychological Association.

    Google Scholar 

  • Kumar, V. 2000. International marketing research. Upper Saddle River, NJ: Prentice-Hall.

    Google Scholar 

  • Lenartowicz, T., & Johnson, J. P. 2002. Comparing managerial values in twelve Latin American countries: An exploratory study. Management International Review, 42 (3): 279–307.

    Google Scholar 

  • Messick, S. 1995. Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50 (9): 741–749.

    Article  Google Scholar 

  • Mintu, A. T., Calantone, R. J., & Gassenheimer, J. B. 1994. Towards improving cross-cultural research: Extending Churchill's research paradigm. Journal of International Marketing, 7 (2): 5–23.

    Google Scholar 

  • Mullen, M. R. 1995. Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 26 (3): 573–596.

    Article  Google Scholar 

  • Myers, M. B., Calantone, R. J., Page, T. J., & Taylor, C. R. 2000. Academic insights: An application of multiple-group causal models in assessing cross-cultural measurement equivalence. Journal of International Marketing, 8 (4): 108–121.

    Article  Google Scholar 

  • Nunnally, J. C. 1978. Psychometric theory. New York: McGraw-Hill.

    Google Scholar 

  • Peterson, R. A. 2001. On the use of college students in social science research: Insights from a second-order meta-analysis. Journal of Consumer Research, 28 (3): 450–461.

    Article  Google Scholar 

  • Peterson, M. F., Smith, P. B., Akande, A., Ayestaran, S., et al. 1995. Role conflict, ambiguity, and overload: A 21-nation study. Academy of Management Journal, 38 (2): 429–452.

    Article  Google Scholar 

  • Reynolds, N. L., Simintiras, A. C., & Diamantopoulos, A. 2003. Theoretical justification of sampling choices in international marketing research: Key issues and guidelines for researchers. Journal of International Business Studies, 34 (1): 80–89.

    Article  Google Scholar 

  • Robertson, C., Al-Khatib, J., Al-Habib, M., & Lanoue, D. 2001. Beliefs about work in the Middle East and the convergence versus divergence of values. Journal of World Business, 36 (3): 223–244.

    Article  Google Scholar 

  • Salzberger, T., Sinkovics, R. R., & Schlegelmilch, B. B. 2001. Data equivalence in international research: A comparison of classical test theory and latent trait theory based approaches. Australasian Marketing Journal, 7 (2): 23–38.

    Article  Google Scholar 

  • Schwarz, N. 2003. Self-reports in consumer research: The challenge of comparing cohorts and cultures. Journal of Consumer Research, 29 (4): 588–594.

    Article  Google Scholar 

  • Sekaran, U. 1983. Methodological and theoretical issues and advancements in cross-cultural research. Journal of International Business Studies, 14 (2): 61–73.

    Article  Google Scholar 

  • Singh, J. 1995. Measurement issues in cross-national research. Journal of International Business Studies, 26 (3): 597–619.

    Article  Google Scholar 

  • Sivakumar, K., & Nakata, C. 2001. The stampede toward Hofstede's framework: Avoiding the sample design pit in cross-cultural research. Journal of International Business Studies, 32 (3): 555–574.

    Article  Google Scholar 

  • Sperber, A. D., Devellis, R. F., & Boehlecke, B. 1994. Cross-cultural translation: Methodology and validation. Journal of Cross-Cultural Psychology, 25 (4): 501–524.

    Article  Google Scholar 

  • Steenkamp, J.-B. E., & Baumgartner, H. 1998. Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25 (1): 78–90.

    Article  Google Scholar 

  • Steenkamp, J.-B. E., & Baumgartner, H. 2001. Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38 (2): 143–156.

    Article  Google Scholar 

  • Tahai, A., & Meyer, M. H. 1999. A revealed preference study of management journals’ direct influences. Strategic Management Journal, 20 (3): 279–296.

    Article  Google Scholar 

  • van de Vijver, F., & Leung, K. 1997. Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Wong, N., Rindfleisch, A., & Burroughs, J. E. 2003. Do reverse-worded items confound measures in cross-cultural consumer research? The case of the material values scale. Journal of Consumer Research, 30 (1): 72–91.

    Article  Google Scholar 

  • Wright, R. W. 1970. Trends in international business research. Journal of International Business Studies, 1 (1): 109–123.

    Article  Google Scholar 

Download references

Acknowledgements

We appreciate the guidance provided by Editor-in-Chief Arie Lewin and the anonymous reviewers, as well as research funding from the Center for International Business Education and Research at Michigan State University (MSU-CIBER).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to G Tomas M Hult.

Additional information

Accepted by Arie Y Lewin, Editor-in-Chief, 21 August 2007. This paper has been with the authors for two revisions.

APPENDIX

APPENDIX

Coding Form

Construct equivalence: Are we studying the same phenomena in countries X, Y, and Z?

Functional equivalence: Checked whether a given concept or behavior serves the same function from country to country (including literature review).

Conceptual equivalence: Checked whether the same concepts/behaviors occur in different countries – the way in which they are expressed is similar.

Category equivalence: Checked same product attributes/characteristics considered.

Post data collection: Checked for tests for unidimensionaliy, reliability, convergent validity, discriminant validity

Any specifically national or cultural constructs?

Measurement equivalence: Are the phenomena in countries X, Y, and Z measured in the same way?

Calibration equivalence: For example, monetary units, measures of weights, distance and volume and perceptual cues; compared factor loadings (λ's) (via multigroup SEM); checked for the comparability of standards and units.

Translation equivalence: Checked whether the concept can be measured by using the same or similar questions in every country.

Method of translation/back-translation reported.

Metric equivalence: Checked for scoring consistency: compared reliabilities or compared measurement error variances (δ's).

Checked for scaling equivalence: Multimethod of measurement, profile analysis, optimal scaling or compared measurement error variances (δ's) and factor loadings (λ's) (via multigroup SEM).

Decentered or adapted scoring/scaling for that country?

Any other cultural biases (e.g., exaggerated or mean responses) accounted for?

Data collection equivalence: Are the data collection procedures in countries X, Y, and Z the same?

Criterion for country/culture selection (convenience, theoretical justification); sufficient variance between countries/cultures.

Sample size for each country/culture studied.

Relevant or same respondent for each country (manager, decision-maker, executive, etc.).

Sampling frame techniques match between countries?

Sampling frame comparability.

Coverage comparability.

Countries where the survey was developed.

Sampling procedure equivalence (telephone interviews, surveys, etc.) (do procedures match?).

Any procedure for non-sampling/non-response bias?

Sampling method in each country

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hult, G., Ketchen, D., Griffith, D. et al. Data equivalence in cross-cultural international business research: assessment and guidelines. J Int Bus Stud 39, 1027–1044 (2008). https://doi.org/10.1057/palgrave.jibs.8400396

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/palgrave.jibs.8400396

Keywords

Navigation