Skip to main content

2017 | Buch

Computerized Adaptive and Multistage Testing with R

Using Packages catR and mstR

insite
SUCHEN

Über dieses Buch

The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic.

The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education.
Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.

Inhaltsverzeichnis

Frontmatter
Chapter 1. Overview of Adaptive Testing
Abstract
In this book, we provide a general overview of computerized adaptive tests (CAT) and multistage tests (MST), as well as item response theory (IRT). We briefly discuss the important concepts associated with CATs and MSTs. We then introduce the R open source software packages catR and mstR for CAT and MST simulations, and provide examples on how to use catR and mstR for simulations.
David Magis, Duanli Yan, Alina A. von Davier
Chapter 2. An Overview of Item Response Theory
Abstract
An important component of both CAT and MST is the use of item response theory (IRT) as an underlying framework for item bank calibration, ability estimation, and item/module selection. In this chapter, we present a brief overview of this theory, by providing key information and introducing appropriate notation for use in subsequent chapters. Only topics and contents directly related to adaptive and multistage testing will be covered in this chapter; appropriate references for further reading are therefore also mentioned.
David Magis, Duanli Yan, Alina A. von Davier

Item-Level Computerized Adaptive Testing

Frontmatter
Chapter 3. An Overview of Computerized Adaptive Testing
Abstract
In this chapter, we present a brief overview of computerized adaptive testing theory, including test design, test assembly, item bank, item selection, scoring and equating, content balance, item exposure and security. We also provide a summary of the IRT-based item selection process with a list of the commonly used item selection methods, as well as a brief outline of the tree-based adaptive testing.
David Magis, Duanli Yan, Alina A. von Davier
Chapter 4. Simulations of Computerized Adaptive Tests
Abstract
In this chapter, we describe the R package catR that contains most CAT options and routines currently developed. Its general architecture is presented and most important R functions are explained and illustrated. Focus is put on detailing the input arguments and output values of the main functions, as well as the relationships between them and their accurate use in adaptive and non-adaptive contexts.
David Magis, Duanli Yan, Alina A. von Davier
Chapter 5. Examples of Simulations Using catR
Abstract
The previous chapter focused on the description of the R package catR as a tool for simulation studies on CAT processes. This chapter presents several practical illustrations of catR using two real item banks, one for dichotomously scored items and one for polytomously scored items. After a brief description of both item banks, several examples are displayed with the same organization.
David Magis, Duanli Yan, Alina A. von Davier

Computerized Multistage Testing

Frontmatter
Chapter 6. An Overview of Computerized Multistage Testing
Abstract
In this chapter, we present a brief overview of computerized multistage testing theory, including test design, test assembly, item bank, module selection, routing, scoring and linking, and exposure and security. We also provide a summary of the IRT-based module selection process, as well as the tree-based multistage testing.
David Magis, Duanli Yan, Alina A. von Davier
Chapter 7. Simulations of Computerized Multistage Tests
Abstract
In the first part of this book, focus was put on computerized adaptive testing and the R package catR was presented as a tool to simulate CAT patterns and scenarios. In the context of multistage testing, the R package mstR was developed in a similar spirit. This chapter provides a brief description of mstR, with emphasis on main differences between mstR and catR for specific MST purposes.
David Magis, Duanli Yan, Alina A. von Davier
Chapter 8. Examples of Simulations Using mstR
Abstract
In this chapter, we present several examples of using the R package mstR which is similar to CAT but specific for MST. We then implement a study with several MST designs, and an empirical comparison of MST versus CAT.
David Magis, Duanli Yan, Alina A. von Davier
Backmatter
Metadaten
Titel
Computerized Adaptive and Multistage Testing with R
verfasst von
David Magis
Dr. Duanli Yan
Alina A. von Davier
Copyright-Jahr
2017
Electronic ISBN
978-3-319-69218-0
Print ISBN
978-3-319-69217-3
DOI
https://doi.org/10.1007/978-3-319-69218-0