Skip to main content
Erschienen in: Journal of Business and Psychology 2/2011

01.06.2011

Computer Adaptive Testing (CAT): A Faster, Smarter, and More Secure Approach to Pre-Employment Testing

verfasst von: Tracy M. Kantrowitz, Craig R. Dawson, Michael S. Fetzer

Erschienen in: Journal of Business and Psychology | Ausgabe 2/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As the usage of unproctored Internet testing (UIT) rises, new methods of mitigating challenges associated with UIT have been proposed. We suggest that one of the most promising methods is computer adaptive testing (CAT), and is a major advancement in pre-employment testing. CAT combines science and technology to help deliver a targeted and secure testing experience. In this article, we describe the use of CAT in organizations and highlight examples of how CAT has been applied to the measurement of cognitive ability, knowledge, and personality traits. We also set out a research agenda that will advance the development and implementation of future CATs.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.CrossRef Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.CrossRef
Zurück zum Zitat Beaty, J. C., Dawson, C. R., Fallaw, S. S., & Kantrowitz, T. M. (2009). Recovering the scientist-practitioner model: How IOs should respond to UIT. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 58–63. Beaty, J. C., Dawson, C. R., Fallaw, S. S., & Kantrowitz, T. M. (2009). Recovering the scientist-practitioner model: How IOs should respond to UIT. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 58–63.
Zurück zum Zitat Beaty, J. C., Nye, C., Borneman, M., Kantrowitz, T. M., Drasgow, F., & Grauer, E. (2011). Proctored versus unproctored internet tests: Are unproctored tests as predictive of job performance? International Journal of Selection and Assessment, 19, 1–10.CrossRef Beaty, J. C., Nye, C., Borneman, M., Kantrowitz, T. M., Drasgow, F., & Grauer, E. (2011). Proctored versus unproctored internet tests: Are unproctored tests as predictive of job performance? International Journal of Selection and Assessment, 19, 1–10.CrossRef
Zurück zum Zitat Borman, W. C., Houston, J. S., Schneider, R. J., & Ferstl, K. L. (2005). Adaptive personality scales: The concept and initial validation results. Presented at the 47th International Military Testing Association Conference, Singapore. Borman, W. C., Houston, J. S., Schneider, R. J., & Ferstl, K. L. (2005). Adaptive personality scales: The concept and initial validation results. Presented at the 47th International Military Testing Association Conference, Singapore.
Zurück zum Zitat Drasgow, F., Chernyshenko, O.S., & Stark, S. (2010a). 75 years after Likert: Thurstone was right! Industrial and Organizational Psychologist, 465–476. Drasgow, F., Chernyshenko, O.S., & Stark, S. (2010a). 75 years after Likert: Thurstone was right! Industrial and Organizational Psychologist, 465–476.
Zurück zum Zitat Drasgow, F., Chernyshenko, O. S., & Stark, S. (2010b). Tailored Adaptive Personality Assessment System (TAPAS). Urbana, IL: Authors. Drasgow, F., Chernyshenko, O. S., & Stark, S. (2010b). Tailored Adaptive Personality Assessment System (TAPAS). Urbana, IL: Authors.
Zurück zum Zitat Dawson, C. R., Wade, K. R., & Daniell, S. (2009). Data driven selection: Development and program success measurement. In J. Steffensmeier (Chair), Data driven decisions: Merging I-O psychology methods and practice. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA. Dawson, C. R., Wade, K. R., & Daniell, S. (2009). Data driven selection: Development and program success measurement. In J. Steffensmeier (Chair), Data driven decisions: Merging I-O psychology methods and practice. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
Zurück zum Zitat Egberink, I. J. L., & Veldkamp, B. P. (2007). The development of a computerized adaptive test for integrity. Poster presented at the Conference on Computerized Adaptive Testing, Minneapolis, MN. Egberink, I. J. L., & Veldkamp, B. P. (2007). The development of a computerized adaptive test for integrity. Poster presented at the Conference on Computerized Adaptive Testing, Minneapolis, MN.
Zurück zum Zitat Fetzer, M. S. (2009). Validity and utility of computer adaptive testing in personnel selection. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA. Fetzer, M. S. (2009). Validity and utility of computer adaptive testing in personnel selection. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
Zurück zum Zitat Gibby, R., & McCloy, R. A. (2011). Computerized adaptive testing. In N. Tippins and S. Adler (Eds.), Technology enhanced assessments. San Francisco: Wiley. Gibby, R., & McCloy, R. A. (2011). Computerized adaptive testing. In N. Tippins and S. Adler (Eds.), Technology enhanced assessments. San Francisco: Wiley.
Zurück zum Zitat Gibby, R. E., Pratt, A. K., Biga, A., Sears, L. E., Gradshtein, M., Schlessman, B. (2010). Verification of unproctored online noncognitive and adaptive cognitive tests. In J. Weiner (Chair), Verification of unproctored online testing: Considerations and research. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Atlanta, GA. Gibby, R. E., Pratt, A. K., Biga, A., Sears, L. E., Gradshtein, M., Schlessman, B. (2010). Verification of unproctored online noncognitive and adaptive cognitive tests. In J. Weiner (Chair), Verification of unproctored online testing: Considerations and research. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.
Zurück zum Zitat Gutierrez, S. L., Grelle, D., & Borneman, M. (2009). Computer adaptive measures of cognitive ability: Validity and Utility. In M. S. Fetzer (Chair), Validity and utility of computer adaptive testing in personnel selection. Symposium conducted at the 24th annual Society for Industrial and Organizational Psychology conference, New Orleans, LA. Gutierrez, S. L., Grelle, D., & Borneman, M. (2009). Computer adaptive measures of cognitive ability: Validity and Utility. In M. S. Fetzer (Chair), Validity and utility of computer adaptive testing in personnel selection. Symposium conducted at the 24th annual Society for Industrial and Organizational Psychology conference, New Orleans, LA.
Zurück zum Zitat Hough, L. M., & Oswald, F. L. (2008). Personality testing and I-O psychology: Reflections, progress and prospects. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 272–290.CrossRef Hough, L. M., & Oswald, F. L. (2008). Personality testing and I-O psychology: Reflections, progress and prospects. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 272–290.CrossRef
Zurück zum Zitat Houston, J. S., Borman, W. C., Farmer, W. L., & Bearden, R. M. (2005). Development of the Enlisted Computer Adaptive Personality Scales (ENCAPS) for the United States Navy, Phase 2 (Institute Report #503). Minneapolis, MN: Personnel Decisions Research Institutes, Inc. Houston, J. S., Borman, W. C., Farmer, W. L., & Bearden, R. M. (2005). Development of the Enlisted Computer Adaptive Personality Scales (ENCAPS) for the United States Navy, Phase 2 (Institute Report #503). Minneapolis, MN: Personnel Decisions Research Institutes, Inc.
Zurück zum Zitat Hunter, J. E. (1983). A causal analysis of cognitive ability, job knowledge, job performance, and supervisor ratings. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory. London: Erlbaum. Hunter, J. E. (1983). A causal analysis of cognitive ability, job knowledge, job performance, and supervisor ratings. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory. London: Erlbaum.
Zurück zum Zitat Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.CrossRef Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.CrossRef
Zurück zum Zitat Kantrowitz, T. M., McLellan, R., Borman, W., Houston, J., & Schneider, R. (2009). Validation of computer adaptive personality scales for commercial use. In M. Fetzer (Chair) Validity and utility of computer adaptive testing in personnel selection. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA. Kantrowitz, T. M., McLellan, R., Borman, W., Houston, J., & Schneider, R. (2009). Validation of computer adaptive personality scales for commercial use. In M. Fetzer (Chair) Validity and utility of computer adaptive testing in personnel selection. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.
Zurück zum Zitat Kantrowitz, T. M., & Tuzinski, K. A. (2010). The ideal point model in action: How the use of computer adaptive personality scales benefits organizations. Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 507–510.CrossRef Kantrowitz, T. M., & Tuzinski, K. A. (2010). The ideal point model in action: How the use of computer adaptive personality scales benefits organizations. Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 507–510.CrossRef
Zurück zum Zitat Maynes, D. (2010). Research in test security: The latest research in test security data analysis. In Symposium presented at the 11th annual conference of the Association of Test Publishers, Orlando, FL. Maynes, D. (2010). Research in test security: The latest research in test security data analysis. In Symposium presented at the 11th annual conference of the Association of Test Publishers, Orlando, FL.
Zurück zum Zitat Mead, A. D., Fleischer, A., & Sergent, J. D. (2009). Multidimensional adaptive personality assessment: A real-data confirmation. Paper presented at the 2008 GMAC Conference on Computerized Adaptive Testing in Minneapolis, MN. Mead, A. D., Fleischer, A., & Sergent, J. D. (2009). Multidimensional adaptive personality assessment: A real-data confirmation. Paper presented at the 2008 GMAC Conference on Computerized Adaptive Testing in Minneapolis, MN.
Zurück zum Zitat Morgenson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmidt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729.CrossRef Morgenson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmidt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729.CrossRef
Zurück zum Zitat O’Connell. (2009, January 7). Tests for dwindling retail jobs spawns a culture of cheating, p. A1 O’Connell. (2009, January 7). Tests for dwindling retail jobs spawns a culture of cheating, p. A1
Zurück zum Zitat Ree, M. J., Earles, J. A., & Teachout, M. S. (1994). Predictive job performance: Not much more than g. Journal of Applied Psychology, 79, 518–524.CrossRef Ree, M. J., Earles, J. A., & Teachout, M. S. (1994). Predictive job performance: Not much more than g. Journal of Applied Psychology, 79, 518–524.CrossRef
Zurück zum Zitat Schmitt, N., & Chan, D. (1998). Personnel selection: A theoretical approach. Thousand Oaks, CA: Sage. Schmitt, N., & Chan, D. (1998). Personnel selection: A theoretical approach. Thousand Oaks, CA: Sage.
Zurück zum Zitat Schneider, R. J., Ferstl, K. L., Houston, J. S., Borman, W. C., Lords, A. O., & Bearden, R. M. (2006). Revision and expansion of Navy Computer Adaptive Personality Scales (NCAPS) (Institute Report #550). Minneapolis, MN: Personnel Decisions Research Institutes, Inc. Schneider, R. J., Ferstl, K. L., Houston, J. S., Borman, W. C., Lords, A. O., & Bearden, R. M. (2006). Revision and expansion of Navy Computer Adaptive Personality Scales (NCAPS) (Institute Report #550). Minneapolis, MN: Personnel Decisions Research Institutes, Inc.
Zurück zum Zitat Tippins, N. T. (2009). Internet alternatives to traditional proctored testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 2–10.CrossRef Tippins, N. T. (2009). Internet alternatives to traditional proctored testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 2–10.CrossRef
Zurück zum Zitat Tonidandel, S., Quiñones, M. A., & Adams, A. A. (2002). Computer adaptive testing: The impact of test characteristics on perceived performance and test takers’ reactions. Journal of Applied Psychology, 87, 320–332.PubMedCrossRef Tonidandel, S., Quiñones, M. A., & Adams, A. A. (2002). Computer adaptive testing: The impact of test characteristics on perceived performance and test takers’ reactions. Journal of Applied Psychology, 87, 320–332.PubMedCrossRef
Zurück zum Zitat Underhill, C. M., Lords, A. O., & Bearden, R. M. (2006, October). Fake resistance of a forced choice paired-comparisons personality measure. Paper presented at the Annual Meeting of the International Military Testing Association, Kingston, Canada. Underhill, C. M., Lords, A. O., & Bearden, R. M. (2006, October). Fake resistance of a forced choice paired-comparisons personality measure. Paper presented at the Annual Meeting of the International Military Testing Association, Kingston, Canada.
Metadaten
Titel
Computer Adaptive Testing (CAT): A Faster, Smarter, and More Secure Approach to Pre-Employment Testing
verfasst von
Tracy M. Kantrowitz
Craig R. Dawson
Michael S. Fetzer
Publikationsdatum
01.06.2011
Verlag
Springer US
Erschienen in
Journal of Business and Psychology / Ausgabe 2/2011
Print ISSN: 0889-3268
Elektronische ISSN: 1573-353X
DOI
https://doi.org/10.1007/s10869-011-9228-3

Weitere Artikel der Ausgabe 2/2011

Journal of Business and Psychology 2/2011 Zur Ausgabe