Online Calibration of Polytomous Items Under the Generalized Partial Credit Model

Research output: Contribution to journalArticle

4 Scopus citations

Abstract

Online calibration is a technology-enhanced architecture for item calibration in computerized adaptive tests (CATs). Many CATs are administered continuously over a long term and rely on large item banks. To ensure test validity, these item banks need to be frequently replenished with new items, and these new items need to be pretested before being used operationally. Online calibration dynamically embeds pretest items in operational tests and calibrates their parameters as response data are gradually obtained through the continuous test administration. This study extends existing formulas, procedures, and algorithms for dichotomous item response theory models to the generalized partial credit model, a popular model for items scored in more than two categories. A simulation study was conducted to investigate the developed algorithms and procedures under a variety of conditions, including two estimation algorithms, three pretest item selection methods, three seeding locations, two numbers of score categories, and three calibration sample sizes. Results demonstrated acceptable estimation accuracy of the two estimation algorithms in some of the simulated conditions. A variety of findings were also revealed for the interacted effects of included factors, and recommendations were made respectively.

Original languageEnglish (US)
Pages (from-to)434-450
Number of pages17
JournalApplied Psychological Measurement
Volume40
Issue number6
DOIs
StatePublished - Sep 1 2016

    Fingerprint

Keywords

  • computerized adaptive testing
  • generalized partial credit model
  • online calibration
  • polytomous IRT models

ASJC Scopus subject areas

  • Social Sciences (miscellaneous)
  • Psychology (miscellaneous)

Cite this