Skip to main content

Innovative Item Types for Computerized Testing

  • Chapter
Computerized Adaptive Testing: Theory and Practice

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • ACT, Inc. (1995). Work keys. Iowa City, IA: Author.

    Google Scholar 

  • ACT, Inc. (1998). Assessing listening comprehension: A review of recent literature relevant to an LSAT Listening Component [Unpublished manuscript]. Newton, PA: Law School Admission Council.

    Google Scholar 

  • ACT, Inc. (1999). Technical Manual for the ESL Exam. Iowa City, IA: Author.

    Google Scholar 

  • Baker, E.L., & O’Neil, H.F., Jr. (1995). Computer technology futures for the improvement of assessment. Journal of Science Education and Technology, 4, 37–45.

    Article  Google Scholar 

  • Bejar, I. I. (1991). A methodology for scoring open-ended architectural design problems. Journal of Applied Psychology, 76, 522–532.

    Article  Google Scholar 

  • Bennett, R.E. (1998). Reinventing assessment. Princeton, NJ: Educational Testing Service.

    Google Scholar 

  • Bennett, R.E., & Bejar, I.I. (1999). Validity and automatedscoring: It’s not only the scoring. Educational Measurement: Issues and Practices, 17, 9–17.

    Google Scholar 

  • Bennett, R. E., Goodman, M., Hessinger, J., Ligget, J., Marshall, G., Kahn, H., & Zack, J. (1997). Using multimedia in large-scale computer-based testing programs. (Research Rep. No. RR-97-3). Princeton, NJ: Educational Testing Service.

    Google Scholar 

  • Bennett, R. E., & Sebrechts, M. M. (1997). A computer-based task for measuring the representational component of quantitative proficiency. Journal of Educational Measurement, 34, 64–77.

    Google Scholar 

  • Bennett, R.E., Steffen, M., Singley, M.K., Morley, M., & Jacquemin, D. (1997). Evaluating an automatically scorable, open-ended response type for measuring mathematical reasoning in computer-adaptive tests. Journal of Educational Measurement, 34, 162–176.

    Google Scholar 

  • Bennett, R. E., Morley, M., & Quardt, D. (1998, April). Three response types for broadening the conception of mathematical problem solving in computerized-adaptive tests. Paper presented at the annual meeting of the National Council of Measurement in Education, San Diego, CA.

    Google Scholar 

  • Booth, J. (1991). The key to valid computer-based testing: The user interface. European Review of Applied Psychology, 41, 281–293.

    Google Scholar 

  • Bosman, F., Hoogenboom, J., & Walpot, G. (1994). An interactive video test for pharmaceutical chemist’s assistants. Computers in Human Behavior, 10, 51–62.

    Article  Google Scholar 

  • Braun, H.I. (1994). Assessing technology in assessment. In E. L. Baker & H. F. O’Neil (Eds.), Technology assessment in education and training (pp. 231–246). Hillsdale, NJ: Lawrence Erlbaum Associates

    Google Scholar 

  • Braun, H.I., Bennett, R.E., Frye, D., & Soloway, E. (1990). Scoring constructed responses using expert systems. Journal of Educational Measurement, 27, 93–108.

    Article  Google Scholar 

  • Breland, H.M. (1998, April). Writing assessment through automated editing. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego.

    Google Scholar 

  • Bugbee, A. C., Jr., & Bernt, F. M. (1990). Testing by computer: Findings in six years of use. Journal of Research on Computing in Education, 23, 87–100.

    Google Scholar 

  • Burstein, J., Kukich, K., Wolff, S., Lu, C., & Chodorow, M. (1998, April). Computer analysis of essays. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego.

    Google Scholar 

  • Buxton, W.A.S. (1987). There’s more to interaction than meets the eye: Some issues in manual input. In R. M. Baecker & W. A. S. Buxton (Eds.) Readings in human-computer interaction: A multidisciplinary approach (pp.366–375). San Mateo, CA: Morgan Kaufmann.

    Google Scholar 

  • Clauser, B.E., Margolis, M.J., Clyman, S.G., & Ross, L.P. (1997). Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches. Journal of Educational Measurement, 34, 141–161.

    Article  Google Scholar 

  • Clauser, B.E., Ross, L.P., Clyman, S.G., Rose, K.M., Margolis, M.J., Nungester, R.J., Piemme, T.E., Chang, L., El-Bayoumi, G., Malakoff, G.L., & Pincetl, P.S. (1997). Development of a scoring algorithm to replace expert rating for scoring a complex performance-based assessment. Applied Measurement in Education, 10, 345–358.

    Google Scholar 

  • Davey, T., Godwin, J., & Mittelholtz, D. (1997). Developing and scoring an innovative computerized writing assessment. Journal of Educational Measurement, 34, 21–41.

    Article  Google Scholar 

  • Dodd, B. G., & Fitzpatrick, S.J. (1998). Alternatives for scoring computer-based tests. Paper presented at the ETS Colloquium on Computer-based testing: Building the foundation for future assessments, Philadelphia, PA.

    Google Scholar 

  • Drasgow, F., Olson-Buchanan, J. B., & Moberg, P. J. (1999). Development of an interactive video assessment: Trials and tribulations. In F. Drasgow & J. B. Olson-Buchanan, (Eds.), Innovations in computerized assessment (pp 177–196). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • ETS. (1998). Computer-Based TOEFL Score User Guide. Princeton, NJ: Author.

    Google Scholar 

  • Fitch, W. T., & Kramer, G. (1994). Sonifying the body electric: Superiority of an auditory over a visual display in a complex, multivariate system. In G. Kramer (Ed.), Auditory Display (pp. 307–325). Reading, MA: Addison-Wesley.

    Google Scholar 

  • French, A., & Godwin, J. (1996, April). Using multimedia technology to create innovative items. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY.

    Google Scholar 

  • Gaver, W. W. (1989). The SonicFinder: An interface that uses auditory icons. Human-Computer Interaction, 4, 67–94.

    Article  Google Scholar 

  • Gruber, J. S. (1998, October). Groupthink [Interview with James Kramer, Head of Virtual Technologies, Inc.]. Wired, 168–169.

    Google Scholar 

  • Godwin, J. (1999, April). Designing the ACT ESL Listening Test. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.

    Google Scholar 

  • Koch, D. A. (1993). Testing goes graphical. Journal of Interactive Instruction Development, 5, 14–21.

    Google Scholar 

  • Luecht, R. M., & Clauser, B. E. (1998, September). Test models for complex computer-based testing. Paper presented at the ETS Colloquium on Computer-based testing: Building the foundation for future assessments, Philadelphia, PA.

    Google Scholar 

  • Martinez, M. E. (1991). A comparison of multiple choice and constructed figural response items. Journal of Educational Measurement, 28, 131–145.

    Article  Google Scholar 

  • Martinez, M. E. (1993). Item formats and mental abilities in biology assessment. Journal of Computers in Mathematics and Science Teaching, 12, 289–301.

    Google Scholar 

  • Martinez, M.E., & Bennett, R.E. (1992). A review of automatically scorable constructed-response item types for large-scale assessment. Applied Measurement in Education, 5, 151–169.

    Google Scholar 

  • Nissan, S. (1999, April). Incorporating sound, visuals, and text for TOEFL on computer. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.

    Google Scholar 

  • Olson-Buchanan, J. B., Drasgow, F., Moberg, P. J., Mead, A. D., Keenan, P.A., & Donovan, M.A. (1998). Interactive video assessment of conflict resolution skills. Personnel Psychology, 51, 1–24.

    Google Scholar 

  • O’Neill, K., & Folk, V. (1996, April). Innovative CBT item formats in a teacher licensing program. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY.

    Google Scholar 

  • Page, E.B., & Petersen N.S. (1995). The computer moves into essay grading: Updating the ancient test. Phi Delta Kappa, 76, 561–565.

    Google Scholar 

  • Parshall, C. G. (1999, February). Audio CBTs: Measuring more through the use of speech and non-speech sound. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.

    Google Scholar 

  • Parshall, C. G., Balizet, S., & Treder, D. W. (1998, July). Using an audio computer-bastd progress exam to test the listening skills of non-native speakers. Paper presented at the Simposio Sobre Tecnologias Educativas: Enseñanza para el Siglo XXI (Symposium on Educational Technology: Teaching for the 21st Century), Mèrida, Venezuela.

    Google Scholar 

  • Parshall, C. G., Stewart, R, & Ritter, J. (1996, April). Innovations: Sound, graphics, and alternative response modes. Paper presented at the annual meeting of the National Council on Measurement in Education, New York.

    Google Scholar 

  • Perlman, M., Berger, K., & Tyler, L. (1993). An application of multimedia software to standardized testing in music. (Research Rep. No. 93-36) Princeton, NJ: EducationalTesting Service.

    Google Scholar 

  • Shavelson, R. J., Baxter, G. P., & Pine, J. (1992). Performance assessments: Political rhetoric and measurement reality. Educational Researcher, 21, 22–27.

    Google Scholar 

  • Shea, J. A., Norcini, J. J., Baranowski, R. A., Langdon, L. O., & Popp, R. L. (1992). A comparison of video and print formats in the assessment of skill in interpreting cardiovascular motion studies. Evaluation and the Health Professions, 15, 325–340.

    Google Scholar 

  • Stone, B. (1998, March). Focus on technology: Are you talking to me? Newsweek, 85–86.

    Google Scholar 

  • Taggart, W. R. (1995). Certifying pilots: Implications for medicine and for the future. In E. L. Mancall & P. G. Bashook (Eds.), Assessing clinical reasoning: The oral examination and alternative methods (pp. 175–182). Evanston, IL: American Board of Medical Specialties.

    Google Scholar 

  • Vicino, F. L., & Moreno, K. E. (1997). Human factors in the CAT system: A pilot study. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 157–160). Washington, DC: APA.

    Google Scholar 

  • Vispoel, W. P., & Coffman, D. (1992). Computerized adaptive testing of music-related skills. Bulletin of the Council for Research in Music Education, 112, 29–49.

    Google Scholar 

  • Vispoel, W. P., Wang, T., & Bleiler, T. (1997). Computerized adaptive and fixed-item testing of music listening skill: A comparison of efficiency, precision, and concurrent validity. Journal of Educational Measurement, 34, 43–63.

    Article  Google Scholar 

  • Williams, V. S. L., Sweeny, S. F., & Bethke, A. D. (1999, April). The development and cognitive laboratory evaluation of an audio-assisted computer-adaptive test for eight-grade mathematics. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Kluwer Academic Publishers

About this chapter

Cite this chapter

Parshall, C.G., Davey, T., Pashley, P.J. (2000). Innovative Item Types for Computerized Testing. In: van der Linden, W.J., Glas, G.A. (eds) Computerized Adaptive Testing: Theory and Practice. Springer, Dordrecht. https://doi.org/10.1007/0-306-47531-6_7

Download citation

  • DOI: https://doi.org/10.1007/0-306-47531-6_7

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-0-7923-6425-2

  • Online ISBN: 978-0-306-47531-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics