On-the-Fly Assembled Multistage Adaptive Testing

Yi Zheng, Hua Hua Chang

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Recently, multistage testing (MST) has been adopted by several important large-scale testing programs and become popular among practitioners and researchers. Stemming from the decades of history of computerized adaptive testing (CAT), the rapidly growing MST alleviates several major problems of earlier CAT applications. Nevertheless, MST is only one among all possible solutions to these problems. This article presents a new adaptive testing design, “on-the-fly assembled multistage adaptive testing” (OMST), which combines the benefits of CAT and MST and offsets their limitations. Moreover, OMST also provides some unique advantages over both CAT and MST. A simulation study was conducted to compare OMST with MST and CAT, and the results demonstrated the promising features of OMST. Finally, the “Discussion” section provides suggestions on possible future adaptive testing designs based on the OMST framework, which could provide great flexibility for adaptive tests in the digital future and open an avenue for all types of hybrid designs based on the different needs of specific tests.

Original languageEnglish (US)
Pages (from-to)104-118
Number of pages15
JournalApplied Psychological Measurement
Volume39
Issue number2
DOIs
StatePublished - Mar 14 2015

Fingerprint

Research Personnel
flexibility
simulation
history

Keywords

  • computerized adaptive testing
  • multistage testing
  • test assembly

ASJC Scopus subject areas

  • Psychology (miscellaneous)
  • Social Sciences (miscellaneous)

Cite this

On-the-Fly Assembled Multistage Adaptive Testing. / Zheng, Yi; Chang, Hua Hua.

In: Applied Psychological Measurement, Vol. 39, No. 2, 14.03.2015, p. 104-118.

Research output: Contribution to journalArticle

Zheng, Yi ; Chang, Hua Hua. / On-the-Fly Assembled Multistage Adaptive Testing. In: Applied Psychological Measurement. 2015 ; Vol. 39, No. 2. pp. 104-118.
@article{ec07b66700e84d998d8e8054ec7c9472,
title = "On-the-Fly Assembled Multistage Adaptive Testing",
abstract = "Recently, multistage testing (MST) has been adopted by several important large-scale testing programs and become popular among practitioners and researchers. Stemming from the decades of history of computerized adaptive testing (CAT), the rapidly growing MST alleviates several major problems of earlier CAT applications. Nevertheless, MST is only one among all possible solutions to these problems. This article presents a new adaptive testing design, “on-the-fly assembled multistage adaptive testing” (OMST), which combines the benefits of CAT and MST and offsets their limitations. Moreover, OMST also provides some unique advantages over both CAT and MST. A simulation study was conducted to compare OMST with MST and CAT, and the results demonstrated the promising features of OMST. Finally, the “Discussion” section provides suggestions on possible future adaptive testing designs based on the OMST framework, which could provide great flexibility for adaptive tests in the digital future and open an avenue for all types of hybrid designs based on the different needs of specific tests.",
keywords = "computerized adaptive testing, multistage testing, test assembly",
author = "Yi Zheng and Chang, {Hua Hua}",
year = "2015",
month = "3",
day = "14",
doi = "10.1177/0146621614544519",
language = "English (US)",
volume = "39",
pages = "104--118",
journal = "Applied Psychological Measurement",
issn = "0146-6216",
publisher = "SAGE Publications Inc.",
number = "2",

}

TY - JOUR

T1 - On-the-Fly Assembled Multistage Adaptive Testing

AU - Zheng, Yi

AU - Chang, Hua Hua

PY - 2015/3/14

Y1 - 2015/3/14

N2 - Recently, multistage testing (MST) has been adopted by several important large-scale testing programs and become popular among practitioners and researchers. Stemming from the decades of history of computerized adaptive testing (CAT), the rapidly growing MST alleviates several major problems of earlier CAT applications. Nevertheless, MST is only one among all possible solutions to these problems. This article presents a new adaptive testing design, “on-the-fly assembled multistage adaptive testing” (OMST), which combines the benefits of CAT and MST and offsets their limitations. Moreover, OMST also provides some unique advantages over both CAT and MST. A simulation study was conducted to compare OMST with MST and CAT, and the results demonstrated the promising features of OMST. Finally, the “Discussion” section provides suggestions on possible future adaptive testing designs based on the OMST framework, which could provide great flexibility for adaptive tests in the digital future and open an avenue for all types of hybrid designs based on the different needs of specific tests.

AB - Recently, multistage testing (MST) has been adopted by several important large-scale testing programs and become popular among practitioners and researchers. Stemming from the decades of history of computerized adaptive testing (CAT), the rapidly growing MST alleviates several major problems of earlier CAT applications. Nevertheless, MST is only one among all possible solutions to these problems. This article presents a new adaptive testing design, “on-the-fly assembled multistage adaptive testing” (OMST), which combines the benefits of CAT and MST and offsets their limitations. Moreover, OMST also provides some unique advantages over both CAT and MST. A simulation study was conducted to compare OMST with MST and CAT, and the results demonstrated the promising features of OMST. Finally, the “Discussion” section provides suggestions on possible future adaptive testing designs based on the OMST framework, which could provide great flexibility for adaptive tests in the digital future and open an avenue for all types of hybrid designs based on the different needs of specific tests.

KW - computerized adaptive testing

KW - multistage testing

KW - test assembly

UR - http://www.scopus.com/inward/record.url?scp=84922784120&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84922784120&partnerID=8YFLogxK

U2 - 10.1177/0146621614544519

DO - 10.1177/0146621614544519

M3 - Article

VL - 39

SP - 104

EP - 118

JO - Applied Psychological Measurement

JF - Applied Psychological Measurement

SN - 0146-6216

IS - 2

ER -