Is the Implicit Association Test Immune to Faking?
Abstract
Abstract. One of the main advantages of measures of automatic cognition is supposed to be that they are less susceptible to faking than explicit tests. It is an empirical question, however, to what degree these measures can be faked, and the response might well differ for different measures. We tested whether the Implicit Association Test (IAT, Greenwald, McGhee, & Schwartz, 1998) cannot be faked as easily as explicit measures of the same constructs. We chose the Big-Five dimensions conscientiousness and extraversion as the constructs of interest. The results show, indeed, that the IAT is much less susceptible to faking than questionnaire measures are, even if no selective faking of single dimensions of the questionnaire occurred. However, given limited experience, scores on the IAT, too, are susceptible to faking.
References
(2002). Double dissociation between implicit and explicit personality self-concept: The case of shy behavior. Journal of Personality and Social Psychology, 83, 380– 393
(2003). Fakability of an Implicit Association Test (IAT) and a new Implicit Association Procedure (IAP) for shyness. Manuscript submitted for publication .
(2001). Implicit attitudes can be measured. In H. L. Roediger, III & J. S. Nairne (Eds.), The nature of remembering: Essays in honor of Robert G. Crowder. Science conference series (pp. 117-150). Washington, DC: American Psychological Association.
(2001). Implicit attitudes towards homosexuality: Reliability, validity, and controllability of the IAT. Zeitschrift für Experimentelle Psychologie, 48, 145– 160
(1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1– 26
(1999). Beyond the Big Five. Personality and Individual Differences, 26, 511– 530
(2000). The “Big Two” Seelische Gesundheit und Verhaltenskontrolle: Zwei orthogonale Superfaktoren höherer Ordnung? [The “Big Two” psychological health and behavior test: Two orthogonal super factors of higher order?. Zeitschrift für Differentielle und Diagnostische Psychologie, 21, 113– 124
(1993). NEO-FFI. Neo-Fünf-Faktoren Inventar nach Costa und McCrae - deutsche Fassung. [NEO-FFI. Neo-Five-Factor inventory according to Costa and McCrae - German version. Göttingen, Germany: Hogrefe.
(2000). Stalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited?. Journal of Personality and Social Psychology, 79, 631– 643
(1985). Multivariate Varianzanalyse nach dem V-Kriterium (Multivariate variance analysis with the V criterium]. Psychologische Beiträge, 27, 127– 154
(2001). How do indirect measures of evaluation work? Evaluating the inference of prejudice in the Implicit Association Test. Journal of Personality and Social Psychology, 81, 760– 773
(1981). Aufmerksamkeits-Belastungs-Test d2. (Test of Attention d2]. Göttingen, Germany: Hogrefe.
(1955). Psychiatric screening of flying personnel; personality structure in objective tests: A study of 1,000 air force students in basic pilot training.. (Proj. No. 21-0202-0007. [Rep. No. 9]) USAF School of Aviation Medicine, 50, 50–
(1967). Objective personality and motivation tests: a theoretical introduction and practical compendium. Champaign, IL: University of Illinois Press.
(1977). Statistical power analysis for the behavioral sciences. (revised ed.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
(2001). Faking personality questionnaires in personnel selection. Journal of Management Development, 20, 729– 742
(2000). The NEO-FFI: Emerging British norms and an item-level analysis suggest N, A and C are more reliable than O and E. Personality and Individual Differences, 29, 907– 920
(2002). Predictive validity of an implicit association test for assessing anxiety. Journal of Personality and Social Psychology, 83, 1441– 1455
(2003). Implicit measures in social cognition: Their meaning and uses. Annual Review of Psychology, 54, 297– 327
(2003). Faking the IAT: Aided and unaided response control on the Implicit Association Test. Manuscript submitted for publication .
(1986). Response bias, social desirability and dissimulation. Personality & Individual Differences, 7, 385– 400
(1997). Knowing and faking one’s Five-Factor personality score. Journal of Personality Assessment, 69, 229– 243
(2001). Test-taking style, personality traits, and psychometric validity. In J. M. Collis & S. Messick (Eds.), Intelligence and personality: Bridging the gap in theory and measurement (pp. 289-304). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
(1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464– 1480
(2003). Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197– 216
(1979). Automatic and effortful processes in memory. Journal of Experimental Psychology: General, 108, 356– 388
(1990). Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581– 595
(1999). Interpreting the correlation between neuroticism and lie scale scores. Personality and Individual Differences, 26, 59– 63
(2003). Voluntary controllability of the Implicit Association Test (IAT). Social Psychology Quarterly, 66, 83– 96
(2001). How robust is the IAT? Measuring and manipulating implicit attitudes of East- and West-Germans. Zeitschrift für Experimentelle Psychologie, 48, 135– 144
(2001). Relations among the Implicit Association Test, discriminatory behavior, and explicit measures of racial attitudes. Journal of Experimental Social Psychology, 37, 435– 442
(1999). A Five-Factor theory of personality. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed.) (pp. 139-153). New York: The Guilford Press.
(2004). Method-specific variance in the Implicit Association Test. Journal of Personality and Social Psychology, 85, 1180– 1192
(1994). Validity of observer ratings of the Big Five personality factors. Journal of Applied Psychology, 79, 272– 280
(1985). Methods of coping with social desirability bias: A review. European Journal of Social Psychology, 15, 263– 280
(1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231– 259
(2001). Implicit attitudes and racism: Effects of word familiarity and frequency on the implicit association test. Social Cognition, 19, 97– 144
(1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634– 644
(2001). Prescriptive gender stereotypes and backlash toward agentic women. Journal of Social Issues, 57, 743– 762
(1999). Measuring the automatic components of prejudice: Flexibility and generality of the Implicit Association Test. Social Cognition, 17, 437– 465
(1999). The relationship between self-perceived personality and impression management on the NEO-FFI. Personality and Individual Differences, 27, 147– 154
(2001). Psychometric properties of the German version of the NEO-FFI in psychosomatic outpatients. Personality and Individual Differences, 31, 713– 722
(1995). NEO-Fünf-Faktoren Inventar [NEO-Big-Five Inevntory]. Borkenau, P. & Ostendorf, F. (Testrezension) Zeitschrift für Differentielle und Diagnostische Psychologie, 15, 237– 238
(2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology, 86, 943– 953
(1999). Mac-IAT [Computer program]. Trier, Germany: University of Trier.
Implicit and explicit attitudes towards lesbians and gay men. Journal of Homosexuality,
(in press)(2003). Implicit Association Test: Separating transsituationally stable and variable components of attitudes toward gay men. Experimental Psychology, 50, 33– 48
(2004). Veränderte Märkte, feminisiertes Management, neue Chancen? Der steinige Weg der Frauen in Führungspositionen [Changed markets, feminized management, new chances? Women’s stoney path to management positions]. In C. Baltes-Löhr, K. Hölz (Eds.), Gender-Perspektiven: interdisziplinär - transversal - aktuell (pp. 113-127). Frankfurt a. M., Germany: Peter Lang Verlag.
(2003). A two-factor model of reaction time differences in the Implicit Association Test. Manuscript submitted for publication .
(2004). Avoiding stimulus effects in the Implicit Association Test: The Concept Association Task. Manuscript submitted for publication .
(2004). Individuum oder Gruppe, Exemplar oder Kategorie? Ein Zweifaktorenmodell zur Erklärung der Reaktionszeitunterschiede im Implicit Association Test (IAT) [Individual or group, exemplar or category? A two-factor model for explaining the reaction-time differences in the IAT]. Zeitschrift für Psychologie, 212, 57– 65
(2001). Items’ cross-category associations as a confounding factor in the Implicit Association Test. Zeitschrift für Experimentelle Psychologie, 48, 123– 134
(2003). Predicting spontaneous behavior with Implicit Association Tests. Manuscript submitted for publication .
(1994). Response processes in social judgment. In R. S. Wyer, Jr. & T. K. Srull (Eds.), Handbook of social cognition (2nd ed.) (pp. 287-322). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
(2001). Implicit associations for fear-relevant stimuli among individuals with snake and spider fears. Journal of Abnormal Psychology, 110, 226– 235
(2001). Spontaneous prejudice in context: Variability in automatically activated attitudes. Journal of Personality and Social Psychology, 81, 815– 827