nach oben

Journal of Business and Psychology

Erschienen in:

06.08.2022 | Original Paper

Are Biasing Factors Idiosyncratic to Measures? A Comparison of Interpersonal Conflict, Organizational Constraints, and Workload

verfasst von: Paul E. Spector, Cheryl E. Gray, Christopher C. Rosen

Erschienen in: Journal of Business and Psychology | Ausgabe 5/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Widespread concern has been raised about the possibility of potential biasing factors influencing the measurement of organizational variables and distorting inferences and conclusions reached about them. Recent research calls for a measure-centric approach in which every measure is independently evaluated to assess what factor(s) may uniquely bias it. This paper examines three popular stressor measures from this perspective. Across three studies, we examine factors that may bias three popular measures of job stressors: The Interpersonal Conflict at Work Scale (ICAWS), the Organizational Constraints Scale (OCS), and the Quantitative Workload Inventory (QWI). The first study used a two-wave design to survey 276 MTurk workers to assess the three stressor scales, four strains, and five measures of potential bias sources: hostile attribution bias, negative affectivity, mood, neutral objects satisfaction, and social desirability. The second study used an experimental design with 439 MTurk workers who were randomly assigned to a positive, negative, or no mood induction condition to assess effects on means of the three stressor measures and their correlations with strains. The third study surveyed 161 employee-supervisor dyads to explore the convergence of results involving the three stressor measures across sources. Based on several forms of evidence we conclude that potential biasing factors affect the three stressor measures differently, supporting the merits of a measure centric approach, even among measures in the same domain.

Vorheriger Artikel Assessing Publication Bias: a 7-Step User’s Guide with Best-Practice Recommendations

Nächster Artikel Leader Inconsistency, Subjective Ambivalence, and Follower Outcomes

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Details about the ICAWS can be found at https://paulspector.com/assessments/pauls-no-cost-assessments/interpersonal-conflict-at-work-scale-icaws/

Details about the OCS can be found at https://paulspector.com/assessments/pauls-no-cost-assessments/organizational-constraints-scale-ocs/

Details about the QWI can be found at https://paulspector.com/assessments/pauls-no-cost-assessments/quantitative-workload-inventory-qwi/

Aguinis, H., Villamor, I., & Ramani, R. S. (2021). MTurk research: Review and recommendations. Journal of Management, 47(4), 823–837. https://doi.org/10.1177/0149206320969787CrossRef

An, M., Boyajian, M. E., & O’Brien, K. E. (2016). Perceived victimization as the mechanism underlying the relationship between work stressors and counterproductive work behaviors. Human Performance, 29(5), 347–361. https://doi.org/10.1080/08959285.2016.1172585CrossRef

Bal, A., & O'Brien, K. E. (2010, April 8–10). Field validation of the Hostile Atrributional Style Survey Society for Industrial and Organizational Psychology, Atlanta, GA, April 8–10.

Bless, H., Clore, G. L., Schwarz, N., Golisano, V., Rabe, C., & Wölk, M. (1996). Mood and the use of scripts: Does a happy mood really lead to mindlessness? Journal of Personality and Social Psychology, 71(4), 665–679. https://doi.org/10.1037/0022-3514.71.4.665CrossRefPubMed

Bowling, N. A., & Beehr, T. A. (2006). Workplace harassment from the victim’s perspective: A theoretical model and meta-analysis. Journal of Applied Psychology, 91(5), 998–1012. https://doi.org/10.1037/0021-9010.91.5.998CrossRefPubMed

Brief, A. P., Burke, M. J., George, J. M., Robinson, B. S., & Webster, J. (1988). Should negative affectivity remain an unmeasured variable in the study of job stress? Journal of Applied Psychology, 73(2), 193–198.CrossRefPubMed

Bruk-Lee, V., & Spector, P. E. (2006). The social stressors-counterproductive work behaviors link: Are conflicts with supervisors and coworkers the same? Journal of Occupational Health Psychology, 11(2), 145–156. https://doi.org/10.1037/1076-8998.11.2.145CrossRefPubMed

Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6(1), 3–5. http://www.jstor.org.ezproxy.lib.usf.edu/stable/41613414

Burke, M. J., Brief, A. P., & George, J. M. (1993). The role of negative affectivity in understanding relations between self-reports of stressors and strains: A comment on the applied psychology literature. Journal of Applied Psychology, 78(3), 402–412. https://doi.org/10.1037/0021-9010.78.3.402CrossRefPubMed

Cammann, C., Fichman, M., Jenkins, D., & Klesh, J. (1979). The Michigan Organizational Assessment Questionnaire. Unpublished manuscript, University of Michigan, Ann Arbor.

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016CrossRefPubMed

Castille, C. M., Kuyumcu, D., & Bennett, R. J. (2017). Prevailing to the peers’ detriment: Organizational constraints motivate Machiavellians to undermine their peers. Personality and Individual Differences, 104, 29–36. https://doi.org/10.1016/j.paid.2016.07.026CrossRef

Che, X. X., Zhou, Z. E., Kessler, S. R., & Spector, P. E. (2017). Stressors beget stressors: The effect of passive leadership on employee health through workload and work–family conflict. Work & Stress, 31(4), 338–354. https://doi.org/10.1080/02678373.2017.1317881CrossRef

Chen, P. Y., & Spector, P. E. (1991). Negative affectivity as the underlying cause of correlations between stressors and strains. Journal of Applied Psychology, 76(3), 398–407. https://doi.org/10.1037/0021-9010.76.3.398CrossRefPubMed

Chen, C., Wen, P., & Hu, C. (2017). Role of formal mentoring in protégés’ work-to-family conflict: A double-edged sword. Journal of Vocational Behavior, 100, 101–110. https://doi.org/10.1016/j.jvb.2017.03.004CrossRef

Cohen, T. R., Panter, A. T., & Turan, N. (2013). Predicting Counterproductive Work Behavior from Guilt Proneness. Journal of Business Ethics, 114(1), 45–53. https://doi.org/10.1007/s10551-012-1326-2CrossRef

Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349–354.CrossRefPubMed

Crowne, D. P., & Marlowe, D. (1964). The approval motive. John Wiley.

DeArmond, S., Matthews, R. A., & Bunk, J. (2014). Workload and procrastination: The roles of psychological detachment and fatigue. International Journal of Stress Management, 21(2), 137–161. https://doi.org/10.1037/a0034893CrossRef

Dodge, K. A., & Coie, J. D. (1987). Social-information-processing factors in reactive and proactive aggression in children’s peer groups. Journal of Personality and Social Psychology, 53(6), 1146–1158. https://doi.org/10.1037/0022-3514.53.6.1146CrossRefPubMed

Edwards, J. A., Guppy, A., & Cockerton, T. (2007). A longitudinal study exploring the relationships between occupational stressors, non-work stressors, and work performance. Work & Stress, 21(2), 99–116. https://doi.org/10.1080/02678370701466900CrossRef

Edwards, A. L. (1957). The social desirability variable in personality assessment and research. Dryden Press.

Epps, J., & Kendall, P. C. (1995). Hostile attributional bias in adults. Cognitive Therapy and Research, 19(2), 159–178. https://doi.org/10.1007/BF02229692CrossRef

Eschleman, K. J., & Bowling, N. A. (2011). A construct validation of the Neutral Objects Satisfaction Questionnaire (NOSQ). Journal of Business and Psychology, 26(4), 501–515. https://doi.org/10.1007/s10869-010-9206-1CrossRef

Fox, S., Spector, P. E., Goh, A., & Bruursema, K. (2007). Does your coworker know what you’re doing? Convergence of self- and peer-reports of counterproductive work behavior. International Journal of Stress Management, 14(1), 41–60. https://doi.org/10.1037/1072-5245.14.1.41CrossRef

Frese, M., & Zapf, D. (1988). Methodological issues in the study of work stress: Objective vs subjective measurement of work stress and the question of longitudinal studies. In C. L. Cooper & R. Payne (Eds.), Causes, coping and consequences of stress at work (pp. 375–411). John Wiley & Sons.

Gabriel, A. S., Podsakoff, N. P., Beal, D. J., Scott, B. A., Sonnentag, S., Trougakos, J. P., & Butts, M. M. (2019). Experience sampling methods: A discussion of critical trends and considerations for scholarly advancement. Organizational Research Methods, 22(4), 969–1006. https://doi.org/10.1177/1094428118802626CrossRef

Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C., & Gough, H. G. (2006). The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality, 40(1), 84–96. https://doi.org/10.1016/j.jrp.2005.08.007CrossRef

Gunn, R. L., & Finn, P. R. (2015). Applying a dual process model of self-regulation: The association between executive working memory capacity, negative urgency, and negative mood induction on pre-potent response inhibition. Personality and Individual Differences, 75, 210–215. https://doi.org/10.1016/j.paid.2014.11.033CrossRefPubMedPubMedCentral

Judge, T. A., & Bretz, R. D. (1993). Report on an alternative measure of affective disposition [Empirical Study]. Educational and Psychological Measurement, 53(4), 1095–1104. https://doi.org/10.1177/0013164493053004022CrossRef

Kim, M., & Beehr, T. A. (2018). Challenge and hindrance demands lead to employees’ health and behaviours through intrinsic motivation. Stress and Health, 34(3), 367–378. https://doi.org/10.1002/smi.2796CrossRefPubMed

Krauth-Gruber, S., & Ric, F. (2000). Affect and stereotypic thinking: A test of the mood-and-general-knowledge-model. Personality and Social Psychology Bulletin, 26(12), 1587–1597. https://doi.org/10.1177/01461672002612012CrossRef

Kuyumcu, D., & Dahling, J. J. (2014). Constraints for some, opportunities for others? Interactive and indirect effects of machiavellianism and organizational constraints on task performance ratings [journal article]. Journal of Business and Psychology, 29(2), 301–310. https://doi.org/10.1007/s10869-013-9314-9CrossRef

Liu, C., Nauta, M. M., Li, C., & Fan, J. (2010). Comparisons of organizational constraints and their relations to strains in China and the United States. Journal of Occupational Health Psychology, 15(4), 452–467. https://doi.org/10.1037/a0020721CrossRefPubMed

Mackinnon, A., Jorm, A. F., Christensen, H., Korten, A. E., Jacomb, P. A., & Rodgers, B. (1999). A short form of the Positive and Negative Affect Schedule: Evaluation of factorial validity and invariance across demographic variables in a community sample. Personality and Individual Differences, 27(3), 405–416. https://doi.org/10.1016/S0191-8869(98)00251-7CrossRef

Moorman, R. H., & Podsakoff, P. M. (1992). A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research. Journal of Occupational and Organizational Psychology, 65(2), 131–149.CrossRef

Narayanan, L., Menon, S., & Spector, P. (1999a). A cross-cultural comparison of job stressors and reactions among employees holding comparable jobs in two countries. International Journal of Stress Management, 6(3), 197–212. https://doi.org/10.1023/A:1021986709317CrossRef

Narayanan, L., Menon, S., & Spector, P. E. (1999b). Stress in the workplace: A comparison of gender and occupations. Journal of Organizational Behavior, 20(1), 63–73. https://doi.org/10.1002/%28SICI%291099-1379%28199901%2920:1%3C63::AID-JOB873%3E3.0.CO;2-JCrossRef

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. McGraw Hill.

Penney, L. M., & Spector, P. E. (2005). Job stress, incivility, and counterproductive work behavior (CWB): The moderating role of negative affectivity. Journal of Organizational Behavior, 26(7), 777–796. https://doi.org/10.1002/job.336CrossRef

Pindek, S., & Spector, P. E. (2016). Organizational constraints: A meta-analysis of a major stressor. Work & Stress, 30(1), 7–25. https://doi.org/10.1080/02678373.2015.1137376CrossRef

Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.CrossRefPubMed

Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569. https://doi.org/10.1146/annurev-psych-120710-100452CrossRefPubMed

Rau, R., Morling, K., & Rösler, U. (2010). Is there a relationship between major depression and both objectively assessed and perceived demands and control? Work & Stress, 24(1), 88-106. http://www.informaworld.com/https://doi.org/10.1080/02678371003661164

Skyrme, P. Y. T. (1992). The relationship of job stressors to work performance, intent to quit, and absenteeism of first line supervisors University of South Florida]. Tampa, FL.

Spector, P. E. (2021). Mastering the use of control variables: The Hierarchical Iterative Control (HIC) approach. Journal of Business and Psychology, 36(5), 737–750. https://doi.org/10.1007/s10869-020-09709-0CrossRef

Spector, P. E., & Jex, S. M. (1998). Development of four self-report measures of job stressors and strain: Interpersonal Conflict at Work Scale, Organizational Constraints Scale, Quantitative Workload Inventory, and Physical Symptoms Inventory. Journal of Occupational Health Psychology, 3(4), 356–367. https://doi.org/10.1037/1076-8998.3.4.356CrossRefPubMed

Spector, P. E., & Nixon, A. E. (2019). How often do I agree: An experimental test of item format method variance in stress measures. Occupational Health Science, 3, 125–143.CrossRef

Spector, P. E., Dwyer, D. J., & Jex, S. M. (1988). Relation of job stressors to affective, health, and performance outcomes: A comparison of multiple data sources. Journal of Applied Psychology, 73(1), 11–19. https://doi.org/10.1037/0021-9010.73.1.11CrossRefPubMed

Spector, P. E., Jex, S. M., & Chen, P. Y. (1995). Relations of incumbent affect-related personality traits with incumbent and objective measures of characteristics of jobs. Journal of Organizational Behavior, 16(1), 59–65. https://doi.org/10.1002/job.4030160108CrossRef

Spector, P. E., Zapf, D., Chen, P. Y., & Frese, M. (2000). Why negative affectivity should not be controlled in job stress research: Don’t throw out the baby with the bath water. Journal of Organizational Behavior, 21(1), 79–95. https://doi.org/10.1002/(SICI)1099-1379(200002)21:1%3c79::AID-JOB964%3e3.0.CO;2-GCrossRef

Spector, P. E., Bauer, J. A., & Fox, S. (2010). Measurement artifacts in the assessment of counterproductive work behavior and organizational citizenship behavior: Do we know what we think we know? Journal of Applied Psychology, 95(4), 781–790. https://doi.org/10.1037/a0019477CrossRefPubMed

Spector, P. E., Yang, L.-Q., & Zhou, Z. E. (2015). A longitudinal investigation of the role of violence prevention climate in exposure to workplace physical violence and verbal abuse. Work & Stress, 29(4), 325–340. https://doi.org/10.1080/02678373.2015.1076537CrossRef

Spector, P. E., Rosen, C. C., Richardson, H. A., Williams, L. J., & Johnson, R. E. (2019). A new perspective on method variance: A measure-centric approach. Journal of Management, 45(3), 855–880. https://doi.org/10.1177/0149206316687295CrossRef

Staw, B. M., & Cohen-Charash, Y. (2005). The dispositional approach to job satisfaction: More than a mirage, but not yet an oasis: Comment [Comment/Reply]. Journal of Organizational Behavior, 26(1), 59–78. https://doi.org/10.1002/job.299CrossRef

Strahan, R., & Gerbasi, K. C. (1972). Short, homogeneous version of the Marlow-Crowne social desirability scale [Article]. Journal of Clinical Psychology, 28(2), 191–193. http://search.ebscohost.com/login.aspx?direct=true&db=aph&AN=15847479&site=ehost-live

Watson, D., & Clark, L. A. (1984). Negative affectivity: The disposition to experience aversive emotional states. Psychological Bulletin, 96(3), 465–490. https://doi.org/10.1037/0033-2909.96.3.465CrossRefPubMed

Watson, D., Pennebaker, J. W., & Folger, R. (1986). Beyond negative affectivity: Measuring stress and satisfaction in the workplace. Journal of Organizational Behavior Management, 8(2), 141–157. https://doi.org/10.1300/J075v08n02_09CrossRef

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063CrossRefPubMed

Weitz, J. (1952). A neglected concept in the study of job satisfaction. Personnel Psychology, 5, 201–205. https://doi.org/10.1111/j.1744-6570.1952.tb01012.xCrossRef

Westermann, R., Spies, K., Stahl, G., & Hesse, F. W. (1996). Relative effectiveness and validity of mood induction procedures: A meta-analysis. European Journal of Social Psychology, 26(4), 557–580. https://doi.org/10.1002/(SICI)1099-0992(199607)26:4%3c557::AID-EJSP769%3e3.0.CO;2-4CrossRef

Williams, E. J. (1959). The comparison of regression variables. Journal of the Royal Statistical Society (series b), 21, 396–399.

Wood, D., Harms, P. D., Lowman, G. H., & DeSimone, J. A. (2017). Response speed and response consistency as mutually validating indicators of data quality in online samples. Social Psychological and Personality Science, 8(4), 454–464. https://doi.org/10.1177/1948550617703168CrossRef

Wu, L.-Z., Zhang, H., Chiu, R. K., Kwan, H. K., & He, X. (2014). Hostile attribution bias and negative reciprocity beliefs exacerbate incivility’s effects on interpersonal deviance. Journal of Business Ethics, 120(2), 189–199. https://doi.org/10.1007/s10551-013-1658-6CrossRef

Zhou, Z. E., Yan, Y., Che, X. X., & Meier, L. L. (2015). Effect of workplace incivility on end-of-work negative affect: Examining individual and organizational moderators in a daily diary study. Journal of Occupational Health Psychology, 20(1), 117–130. https://doi.org/10.1037/a0038167CrossRefPubMed

Titel: Are Biasing Factors Idiosyncratic to Measures? A Comparison of Interpersonal Conflict, Organizational Constraints, and Workload
verfasst von: Paul E. Spector
Cheryl E. Gray
Christopher C. Rosen
Publikationsdatum: 06.08.2022
Verlag: Springer US
Erschienen in: Journal of Business and Psychology / Ausgabe 5/2023
Print ISSN: 0889-3268
Elektronische ISSN: 1573-353X
DOI: https://doi.org/10.1007/s10869-022-09838-8

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 5/2023

Assessing Publication Bias: a 7-Step User’s Guide with Best-Practice Recommendations

The Development and Validation of an Interpersonal Distrust Scale

Leader Inconsistency, Subjective Ambivalence, and Follower Outcomes

Correction to: The Role of Time, Skill Emphasis, and Verifiability in Job Applicants’ Self‑Reported Skill and Experience

The Challenging and Hindering Potential of Time Pressure: Qualitative Job Demands as Suppressor Variables

How Software Agents Can Help to Coordinate Emergency Response Teams: Adaptive Team Performance Comparing Manual and Automated Team Communication