Skip to main content
Top
Published in: Journal of Business and Psychology 2/2011

01-06-2011

Computer Adaptive Testing (CAT): A Faster, Smarter, and More Secure Approach to Pre-Employment Testing

Authors: Tracy M. Kantrowitz, Craig R. Dawson, Michael S. Fetzer

Published in: Journal of Business and Psychology | Issue 2/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As the usage of unproctored Internet testing (UIT) rises, new methods of mitigating challenges associated with UIT have been proposed. We suggest that one of the most promising methods is computer adaptive testing (CAT), and is a major advancement in pre-employment testing. CAT combines science and technology to help deliver a targeted and secure testing experience. In this article, we describe the use of CAT in organizations and highlight examples of how CAT has been applied to the measurement of cognitive ability, knowledge, and personality traits. We also set out a research agenda that will advance the development and implementation of future CATs.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.CrossRef Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.CrossRef
go back to reference Beaty, J. C., Dawson, C. R., Fallaw, S. S., & Kantrowitz, T. M. (2009). Recovering the scientist-practitioner model: How IOs should respond to UIT. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 58–63. Beaty, J. C., Dawson, C. R., Fallaw, S. S., & Kantrowitz, T. M. (2009). Recovering the scientist-practitioner model: How IOs should respond to UIT. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 58–63.
go back to reference Beaty, J. C., Nye, C., Borneman, M., Kantrowitz, T. M., Drasgow, F., & Grauer, E. (2011). Proctored versus unproctored internet tests: Are unproctored tests as predictive of job performance? International Journal of Selection and Assessment, 19, 1–10.CrossRef Beaty, J. C., Nye, C., Borneman, M., Kantrowitz, T. M., Drasgow, F., & Grauer, E. (2011). Proctored versus unproctored internet tests: Are unproctored tests as predictive of job performance? International Journal of Selection and Assessment, 19, 1–10.CrossRef
go back to reference Borman, W. C., Houston, J. S., Schneider, R. J., & Ferstl, K. L. (2005). Adaptive personality scales: The concept and initial validation results. Presented at the 47th International Military Testing Association Conference, Singapore. Borman, W. C., Houston, J. S., Schneider, R. J., & Ferstl, K. L. (2005). Adaptive personality scales: The concept and initial validation results. Presented at the 47th International Military Testing Association Conference, Singapore.
go back to reference Drasgow, F., Chernyshenko, O.S., & Stark, S. (2010a). 75 years after Likert: Thurstone was right! Industrial and Organizational Psychologist, 465–476. Drasgow, F., Chernyshenko, O.S., & Stark, S. (2010a). 75 years after Likert: Thurstone was right! Industrial and Organizational Psychologist, 465–476.
go back to reference Drasgow, F., Chernyshenko, O. S., & Stark, S. (2010b). Tailored Adaptive Personality Assessment System (TAPAS). Urbana, IL: Authors. Drasgow, F., Chernyshenko, O. S., & Stark, S. (2010b). Tailored Adaptive Personality Assessment System (TAPAS). Urbana, IL: Authors.
go back to reference Dawson, C. R., Wade, K. R., & Daniell, S. (2009). Data driven selection: Development and program success measurement. In J. Steffensmeier (Chair), Data driven decisions: Merging I-O psychology methods and practice. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA. Dawson, C. R., Wade, K. R., & Daniell, S. (2009). Data driven selection: Development and program success measurement. In J. Steffensmeier (Chair), Data driven decisions: Merging I-O psychology methods and practice. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
go back to reference Egberink, I. J. L., & Veldkamp, B. P. (2007). The development of a computerized adaptive test for integrity. Poster presented at the Conference on Computerized Adaptive Testing, Minneapolis, MN. Egberink, I. J. L., & Veldkamp, B. P. (2007). The development of a computerized adaptive test for integrity. Poster presented at the Conference on Computerized Adaptive Testing, Minneapolis, MN.
go back to reference Fetzer, M. S. (2009). Validity and utility of computer adaptive testing in personnel selection. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA. Fetzer, M. S. (2009). Validity and utility of computer adaptive testing in personnel selection. Symposium presented at the 24th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
go back to reference Gibby, R., & McCloy, R. A. (2011). Computerized adaptive testing. In N. Tippins and S. Adler (Eds.), Technology enhanced assessments. San Francisco: Wiley. Gibby, R., & McCloy, R. A. (2011). Computerized adaptive testing. In N. Tippins and S. Adler (Eds.), Technology enhanced assessments. San Francisco: Wiley.
go back to reference Gibby, R. E., Pratt, A. K., Biga, A., Sears, L. E., Gradshtein, M., Schlessman, B. (2010). Verification of unproctored online noncognitive and adaptive cognitive tests. In J. Weiner (Chair), Verification of unproctored online testing: Considerations and research. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Atlanta, GA. Gibby, R. E., Pratt, A. K., Biga, A., Sears, L. E., Gradshtein, M., Schlessman, B. (2010). Verification of unproctored online noncognitive and adaptive cognitive tests. In J. Weiner (Chair), Verification of unproctored online testing: Considerations and research. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.
go back to reference Gutierrez, S. L., Grelle, D., & Borneman, M. (2009). Computer adaptive measures of cognitive ability: Validity and Utility. In M. S. Fetzer (Chair), Validity and utility of computer adaptive testing in personnel selection. Symposium conducted at the 24th annual Society for Industrial and Organizational Psychology conference, New Orleans, LA. Gutierrez, S. L., Grelle, D., & Borneman, M. (2009). Computer adaptive measures of cognitive ability: Validity and Utility. In M. S. Fetzer (Chair), Validity and utility of computer adaptive testing in personnel selection. Symposium conducted at the 24th annual Society for Industrial and Organizational Psychology conference, New Orleans, LA.
go back to reference Hough, L. M., & Oswald, F. L. (2008). Personality testing and I-O psychology: Reflections, progress and prospects. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 272–290.CrossRef Hough, L. M., & Oswald, F. L. (2008). Personality testing and I-O psychology: Reflections, progress and prospects. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 272–290.CrossRef
go back to reference Houston, J. S., Borman, W. C., Farmer, W. L., & Bearden, R. M. (2005). Development of the Enlisted Computer Adaptive Personality Scales (ENCAPS) for the United States Navy, Phase 2 (Institute Report #503). Minneapolis, MN: Personnel Decisions Research Institutes, Inc. Houston, J. S., Borman, W. C., Farmer, W. L., & Bearden, R. M. (2005). Development of the Enlisted Computer Adaptive Personality Scales (ENCAPS) for the United States Navy, Phase 2 (Institute Report #503). Minneapolis, MN: Personnel Decisions Research Institutes, Inc.
go back to reference Hunter, J. E. (1983). A causal analysis of cognitive ability, job knowledge, job performance, and supervisor ratings. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory. London: Erlbaum. Hunter, J. E. (1983). A causal analysis of cognitive ability, job knowledge, job performance, and supervisor ratings. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory. London: Erlbaum.
go back to reference Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.CrossRef Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.CrossRef
go back to reference Kantrowitz, T. M., McLellan, R., Borman, W., Houston, J., & Schneider, R. (2009). Validation of computer adaptive personality scales for commercial use. In M. Fetzer (Chair) Validity and utility of computer adaptive testing in personnel selection. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA. Kantrowitz, T. M., McLellan, R., Borman, W., Houston, J., & Schneider, R. (2009). Validation of computer adaptive personality scales for commercial use. In M. Fetzer (Chair) Validity and utility of computer adaptive testing in personnel selection. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.
go back to reference Kantrowitz, T. M., & Tuzinski, K. A. (2010). The ideal point model in action: How the use of computer adaptive personality scales benefits organizations. Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 507–510.CrossRef Kantrowitz, T. M., & Tuzinski, K. A. (2010). The ideal point model in action: How the use of computer adaptive personality scales benefits organizations. Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 507–510.CrossRef
go back to reference Maynes, D. (2010). Research in test security: The latest research in test security data analysis. In Symposium presented at the 11th annual conference of the Association of Test Publishers, Orlando, FL. Maynes, D. (2010). Research in test security: The latest research in test security data analysis. In Symposium presented at the 11th annual conference of the Association of Test Publishers, Orlando, FL.
go back to reference Mead, A. D., Fleischer, A., & Sergent, J. D. (2009). Multidimensional adaptive personality assessment: A real-data confirmation. Paper presented at the 2008 GMAC Conference on Computerized Adaptive Testing in Minneapolis, MN. Mead, A. D., Fleischer, A., & Sergent, J. D. (2009). Multidimensional adaptive personality assessment: A real-data confirmation. Paper presented at the 2008 GMAC Conference on Computerized Adaptive Testing in Minneapolis, MN.
go back to reference Morgenson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmidt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729.CrossRef Morgenson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K., & Schmidt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683–729.CrossRef
go back to reference O’Connell. (2009, January 7). Tests for dwindling retail jobs spawns a culture of cheating, p. A1 O’Connell. (2009, January 7). Tests for dwindling retail jobs spawns a culture of cheating, p. A1
go back to reference Ree, M. J., Earles, J. A., & Teachout, M. S. (1994). Predictive job performance: Not much more than g. Journal of Applied Psychology, 79, 518–524.CrossRef Ree, M. J., Earles, J. A., & Teachout, M. S. (1994). Predictive job performance: Not much more than g. Journal of Applied Psychology, 79, 518–524.CrossRef
go back to reference Schmitt, N., & Chan, D. (1998). Personnel selection: A theoretical approach. Thousand Oaks, CA: Sage. Schmitt, N., & Chan, D. (1998). Personnel selection: A theoretical approach. Thousand Oaks, CA: Sage.
go back to reference Schneider, R. J., Ferstl, K. L., Houston, J. S., Borman, W. C., Lords, A. O., & Bearden, R. M. (2006). Revision and expansion of Navy Computer Adaptive Personality Scales (NCAPS) (Institute Report #550). Minneapolis, MN: Personnel Decisions Research Institutes, Inc. Schneider, R. J., Ferstl, K. L., Houston, J. S., Borman, W. C., Lords, A. O., & Bearden, R. M. (2006). Revision and expansion of Navy Computer Adaptive Personality Scales (NCAPS) (Institute Report #550). Minneapolis, MN: Personnel Decisions Research Institutes, Inc.
go back to reference Tippins, N. T. (2009). Internet alternatives to traditional proctored testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 2–10.CrossRef Tippins, N. T. (2009). Internet alternatives to traditional proctored testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 2–10.CrossRef
go back to reference Tonidandel, S., Quiñones, M. A., & Adams, A. A. (2002). Computer adaptive testing: The impact of test characteristics on perceived performance and test takers’ reactions. Journal of Applied Psychology, 87, 320–332.PubMedCrossRef Tonidandel, S., Quiñones, M. A., & Adams, A. A. (2002). Computer adaptive testing: The impact of test characteristics on perceived performance and test takers’ reactions. Journal of Applied Psychology, 87, 320–332.PubMedCrossRef
go back to reference Underhill, C. M., Lords, A. O., & Bearden, R. M. (2006, October). Fake resistance of a forced choice paired-comparisons personality measure. Paper presented at the Annual Meeting of the International Military Testing Association, Kingston, Canada. Underhill, C. M., Lords, A. O., & Bearden, R. M. (2006, October). Fake resistance of a forced choice paired-comparisons personality measure. Paper presented at the Annual Meeting of the International Military Testing Association, Kingston, Canada.
Metadata
Title
Computer Adaptive Testing (CAT): A Faster, Smarter, and More Secure Approach to Pre-Employment Testing
Authors
Tracy M. Kantrowitz
Craig R. Dawson
Michael S. Fetzer
Publication date
01-06-2011
Publisher
Springer US
Published in
Journal of Business and Psychology / Issue 2/2011
Print ISSN: 0889-3268
Electronic ISSN: 1573-353X
DOI
https://doi.org/10.1007/s10869-011-9228-3

Other articles of this Issue 2/2011

Journal of Business and Psychology 2/2011 Go to the issue