Skip to main content
Erschienen in: Journal of the Academy of Marketing Science 2/2021

06.01.2021 | Methodological Paper

The biasing effect of common method variance: some clarifications

verfasst von: Hans Baumgartner, Bert Weijters, Rik Pieters

Erschienen in: Journal of the Academy of Marketing Science | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There are enduring misconceptions in the marketing and management literature about the potential biasing effects of Common Method Variance (CMV). One belief is that the biasing effect of CMV is of greater theoretical than practical importance; another belief is that if CMV is a potential problem, it can be easily identified with the Harman one-factor test. In this article, we show that both beliefs are ill founded and need correction. To demonstrate our key points with greater generality, we use analytical derivations rather than empirical simulations. First, we examine the effects of CMV on correlations between observed variables as a function of measure unreliability and the sign and size of the “true” trait correlation. We demonstrate that, for negative trait correlations, CMV leads to a substantial upward bias in observed correlations (i.e., observed correlations are less negative than the trait correlation), and under certain conditions observed correlations may even have the wrong sign (assuming that the method loadings are both positive or both negative). We also show that, for positive trait correlations, the downward bias due to measurement unreliability does not always mitigate the upward bias due to CMV (again assuming that the method loadings are either both positive or both negative). Importantly, our results indicate that the inflationary effect of CMV is larger at lower levels of (positive) trait correlations, whereas the deflationary effect of unreliability is larger at higher levels of trait correlations. Second, we demonstrate analytically the serious deficiencies of the popular Harman one-factor test for detecting common method variance and strongly recommend against its use in future research.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
There are differences of opinion in the literature about what counts as a method (Podsakoff et al. 2012). Many researchers subscribe to the broad definition of method used here. However, Lance et al. (2010) argue that method should essentially be restricted to different measurement instruments (e.g., different items to measure the Big Five personality traits) and different response formats (e.g., Likert, Thurstone, and semantic differential scales) for measuring the same trait. They specifically claim that raters and measurement occasions should not be considered as methods because in some areas (e.g., multisource performance ratings) these have been shown to constitute substantive measurement facets, not method facets. It is undeniable that method factors may sometimes have substantive implications. For instance, social desirability might correlate with, say, true yielding to persuasive communications and self-report measures used to assess yielding. However, it is incorrect to reverse the argument and claim that if a variable could, under certain conditions, function as a substantive construct, it cannot be a method factor in a different situation. The fact that an umbrella could perhaps be used as a hockey stick does not imply that it should not be used to protect oneself against the rain.
 
2
We thank the reviewers for nudging us to consider these extensions.
 
3
In the multivariate case, measurement error does not necessarily attenuate the partial correlations.
 
4
Lance et al. (2010) re-analyzed 18 MTMM matrices and found that the average method loading was .427 and the average method correlation was .520. These findings support our contention that positive method loadings are more common than mixed positive and negative method loadings (or, more generally, that μ1μ2ψ21 > 0 is more common than μ1μ2ψ21 < 0).
 
5
Since there is only one observation per cell, it is not possible to report statistical tests. However, the sums of squares of reliability, the interaction of reliability with CMV, and the triple interaction are zero. The percentages of the total variation in observed correlations accounted for by the remaining design factors (in decreasing order of importance) are as follows: trait correlation 45 percent; CMV 43 percent; trait correlation by CMV 9 percent; and trait correlation by reliability 3 percent.
 
6
The effects of μ2ρxx, and φ21 on v1 can be evaluated by taking the partial derivative of v1with respect to each of these terms. This analysis shows the following. First, increasing CMV will increase the magnitude of the first eigenvalue when r > 0 (or \( {\varphi}_{21}>\frac{-{\mu}^2}{\left(\ {\rho}_{xx}-{\mu}^2\right)} \)), whereas it will decrease the magnitude of the first eigenvalue when r < 0 (or \( {\varphi}_{21}<\frac{-{\mu}^2}{\left(\ {\rho}_{xx}-{\mu}^2\right)} \)). A positive correlation increases the communality of the items, a negative correlation decreases it. Second, increasing unreliability of measurement will decrease the magnitude of the first eigenvalue when \( {\varphi}_{21}<\frac{-{\mu}^2}{\left(\ {\rho}_{xx}-{\mu}^2\right)} \) or φ21 > 0, whereas it will increase the magnitude of the first eigenvalue when \( \frac{-{\mu}^2}{\left(\ {\rho}_{xx}-{\mu}^2\right)}<{\varphi}_{21}<0 \). Third, an increase in the trait correlation (i.e., a less negative or more positive trait correlation) will increase the magnitude of the first eigenvalue when r > 0 (or \( {\varphi}_{21}>\frac{-{\mu}^2}{\left(\ {\rho}_{xx}-{\mu}^2\right)} \)), whereas it will decrease the magnitude of the first eigenvalue when r < 0 (or \( {\varphi}_{21}<\frac{-{\mu}^2}{\left(\ {\rho}_{xx}-{\mu}^2\right)} \)).
 
Literatur
Zurück zum Zitat Aguirre-Urreta, M., & Hu, J. (2019). Detecting common method bias: performance of the Harman’s single-factor test. Advances in Information Systems, 50(2), 45–70. Aguirre-Urreta, M., & Hu, J. (2019). Detecting common method bias: performance of the Harman’s single-factor test. Advances in Information Systems, 50(2), 45–70.
Zurück zum Zitat Baumgartner, H., & Steenkamp, J. B. E. (2001). Response styles in marketing research: a cross-national investigation. Journal of Marketing Research, 38(2), 143–156.CrossRef Baumgartner, H., & Steenkamp, J. B. E. (2001). Response styles in marketing research: a cross-national investigation. Journal of Marketing Research, 38(2), 143–156.CrossRef
Zurück zum Zitat Baumgartner, H., & Weijters, B. (2019). Measurement in marketing. Foundations and Trends® in Marketing, 12(4), 278–400.CrossRef Baumgartner, H., & Weijters, B. (2019). Measurement in marketing. Foundations and Trends® in Marketing, 12(4), 278–400.CrossRef
Zurück zum Zitat Baumgartner, H., Weijters, B., & Pieters, R. (2018). Misresponse to survey questions: a conceptual framework and empirical test of the effects of reversals, negations, and polar opposite core concepts. Journal of Marketing Research, 55(6), 869–883.CrossRef Baumgartner, H., Weijters, B., & Pieters, R. (2018). Misresponse to survey questions: a conceptual framework and empirical test of the effects of reversals, negations, and polar opposite core concepts. Journal of Marketing Research, 55(6), 869–883.CrossRef
Zurück zum Zitat Bill, F., Feurer, S., & Klarmann, M. (2020). Salesperson social media use in business-to-business relationships: an empirical test of an integrative framework linking antecedents and consequences. Journal of the Academy of Marketing Science, 48, 734–752.CrossRef Bill, F., Feurer, S., & Klarmann, M. (2020). Salesperson social media use in business-to-business relationships: an empirical test of an integrative framework linking antecedents and consequences. Journal of the Academy of Marketing Science, 48, 734–752.CrossRef
Zurück zum Zitat Brannick, M. T., Chan, D., Conway, J. M., Lance, C. E., & Spector, P. E. (2010). What is method variance and how can we cope with it? A panel discussion. Organizational Research Methods, 13(3), 407–420.CrossRef Brannick, M. T., Chan, D., Conway, J. M., Lance, C. E., & Spector, P. E. (2010). What is method variance and how can we cope with it? A panel discussion. Organizational Research Methods, 13(3), 407–420.CrossRef
Zurück zum Zitat Cohen, A., & Ehrlich, S. (2019). Exchange variables, organizational culture and their relationship with constructive deviance. Management Research Review, 42(12), 1423–1446.CrossRef Cohen, A., & Ehrlich, S. (2019). Exchange variables, organizational culture and their relationship with constructive deviance. Management Research Review, 42(12), 1423–1446.CrossRef
Zurück zum Zitat Cote, J. A., & Buckley, M. R. (1987). Measurement error and theory testing in consumer research: an illustration of the importance of construct validation. Journal of Consumer Research, 14(March), 579–582. Cote, J. A., & Buckley, M. R. (1987). Measurement error and theory testing in consumer research: an illustration of the importance of construct validation. Journal of Consumer Research, 14(March), 579–582.
Zurück zum Zitat Cote, J. A., & Buckley, M. R. (1988). Estimating trait, method, and error variance: generalizing across 70 construct validation studies. Journal of Marketing Research, 24(3), 315–318.CrossRef Cote, J. A., & Buckley, M. R. (1988). Estimating trait, method, and error variance: generalizing across 70 construct validation studies. Journal of Marketing Research, 24(3), 315–318.CrossRef
Zurück zum Zitat Dai, B., Zhang, W., Wang, Y., & Jian, X. (2020). Comparison of trust assessment scales based on item response theory. Frontiers in Psychology, 11, 1–8.CrossRef Dai, B., Zhang, W., Wang, Y., & Jian, X. (2020). Comparison of trust assessment scales based on item response theory. Frontiers in Psychology, 11, 1–8.CrossRef
Zurück zum Zitat Fuller, C. M., Simmering, M. J., Atinc, G., Atinc, Y., & Babin, B. J. (2016). Common methods variance detection in business research. Journal of Business Research, 69, 3192–3198.CrossRef Fuller, C. M., Simmering, M. J., Atinc, G., Atinc, Y., & Babin, B. J. (2016). Common methods variance detection in business research. Journal of Business Research, 69, 3192–3198.CrossRef
Zurück zum Zitat Hulland, J., Baumgartner, H., & Smith, K. M. (2018). Marketing survey research best practices: evidence and recommendations from a review of JAMS articles. Journal of the Academy of Marketing Science, 46(January), 92–108.CrossRef Hulland, J., Baumgartner, H., & Smith, K. M. (2018). Marketing survey research best practices: evidence and recommendations from a review of JAMS articles. Journal of the Academy of Marketing Science, 46(January), 92–108.CrossRef
Zurück zum Zitat Lance, C. E., Dawson, B., Birkelbach, D., & Hoffman, B. J. (2010). Method effects, measurement error, and substantive conclusions. Organizational Research Methods, 13(3), 435–455.CrossRef Lance, C. E., Dawson, B., Birkelbach, D., & Hoffman, B. J. (2010). Method effects, measurement error, and substantive conclusions. Organizational Research Methods, 13(3), 435–455.CrossRef
Zurück zum Zitat Lindell, M. K., & Whitney, D. J. (2001). Accounting for common method variance in cross-sectional designs. Journal of Applied Psychology, 86, 114–121.CrossRef Lindell, M. K., & Whitney, D. J. (2001). Accounting for common method variance in cross-sectional designs. Journal of Applied Psychology, 86, 114–121.CrossRef
Zurück zum Zitat MacKenzie, S. B., & Podsakoff, P. M. (2012). Common method bias in marketing: causes, mechanisms, and procedural remedies. Journal of Retailing, 88(4), 542–555.CrossRef MacKenzie, S. B., & Podsakoff, P. M. (2012). Common method bias in marketing: causes, mechanisms, and procedural remedies. Journal of Retailing, 88(4), 542–555.CrossRef
Zurück zum Zitat Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: a critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.CrossRef Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: a critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.CrossRef
Zurück zum Zitat Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569.CrossRef Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569.CrossRef
Zurück zum Zitat Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009). A tale of three perspectives: examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods, 12(4), 762–800.CrossRef Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009). A tale of three perspectives: examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods, 12(4), 762–800.CrossRef
Zurück zum Zitat Spector, P. E. (1987). Method variance as an artifact in self-reported affect and perceptions at work: myth or significant problem? Journal of Applied Psychology, 72(3), 438–444.CrossRef Spector, P. E. (1987). Method variance as an artifact in self-reported affect and perceptions at work: myth or significant problem? Journal of Applied Psychology, 72(3), 438–444.CrossRef
Zurück zum Zitat Spector, P. E. (2006). Method variance in organizational research. Organizational Research Methods, 9(2), 221–232.CrossRef Spector, P. E. (2006). Method variance in organizational research. Organizational Research Methods, 9(2), 221–232.CrossRef
Zurück zum Zitat Steenkamp, J.-B. E. M., de Jong, M., & Baumgartner, H. (2010). Socially desirable response tendencies in survey research. Journal of Marketing Research, 47(April), 199–214.CrossRef Steenkamp, J.-B. E. M., de Jong, M., & Baumgartner, H. (2010). Socially desirable response tendencies in survey research. Journal of Marketing Research, 47(April), 199–214.CrossRef
Zurück zum Zitat Viswanathan, M. (2005). Measurement error and research design. Thousand Oaks: Sage.CrossRef Viswanathan, M. (2005). Measurement error and research design. Thousand Oaks: Sage.CrossRef
Zurück zum Zitat Viswanathan, M., & Kayande, U. (2012). Common method bias, types of measurement error, and nature of measures. Journal of Retailing, 88(4), 556–562.CrossRef Viswanathan, M., & Kayande, U. (2012). Common method bias, types of measurement error, and nature of measures. Journal of Retailing, 88(4), 556–562.CrossRef
Zurück zum Zitat Weijters, B., Schillewaert, N., & Geuens, M. (2008). Assessing response styles across modes of data collection. Journal of the Academy of Marketing Science, 36(3), 409–422.CrossRef Weijters, B., Schillewaert, N., & Geuens, M. (2008). Assessing response styles across modes of data collection. Journal of the Academy of Marketing Science, 36(3), 409–422.CrossRef
Zurück zum Zitat Weijters, B., Geuens, M., & Schillewaert, N. (2009). The proximity effect: the role of inter-item distance on reverse-item bias. International Journal of Research in Marketing, 26, 2–12.CrossRef Weijters, B., Geuens, M., & Schillewaert, N. (2009). The proximity effect: the role of inter-item distance on reverse-item bias. International Journal of Research in Marketing, 26, 2–12.CrossRef
Zurück zum Zitat Weijters, B., Cabooter, E., & Schillewaert, N. (2010). The effect of rating scale format on response styles: the number of response categories and response category labels. International Journal of Research in Marketing, 27(September), 236–247.CrossRef Weijters, B., Cabooter, E., & Schillewaert, N. (2010). The effect of rating scale format on response styles: the number of response categories and response category labels. International Journal of Research in Marketing, 27(September), 236–247.CrossRef
Zurück zum Zitat Williams, L. J., & Brown, B. K. (1994). Method variance in organizational behavior and human resources research: effects on correlations, path coefficients, and hypothesis testing. Organizational Behavior and Human Decision Processes, 57, 185–209.CrossRef Williams, L. J., & Brown, B. K. (1994). Method variance in organizational behavior and human resources research: effects on correlations, path coefficients, and hypothesis testing. Organizational Behavior and Human Decision Processes, 57, 185–209.CrossRef
Zurück zum Zitat Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: reality of artifact? Journal of Applied Psychology, 74(3), 462–468.CrossRef Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: reality of artifact? Journal of Applied Psychology, 74(3), 462–468.CrossRef
Metadaten
Titel
The biasing effect of common method variance: some clarifications
verfasst von
Hans Baumgartner
Bert Weijters
Rik Pieters
Publikationsdatum
06.01.2021
Verlag
Springer US
Erschienen in
Journal of the Academy of Marketing Science / Ausgabe 2/2021
Print ISSN: 0092-0703
Elektronische ISSN: 1552-7824
DOI
https://doi.org/10.1007/s11747-020-00766-8

Weitere Artikel der Ausgabe 2/2021

Journal of the Academy of Marketing Science 2/2021 Zur Ausgabe