Asymptotically Normally Distributed Person Fit Indices for Detecting Spuriously High Scores on Difficult Items

Yan Xia, Yi Zheng

Research output: Contribution to journalArticle

Abstract

Snijders developed a family of person fit indices that asymptotically follow the standard normal distribution, when the ability parameter is estimated. So far, (Formula presented.), U*, W*, (Formula presented.), and (Formula presented.) from this family have been proposed in previous literature. One common property shared by (Formula presented.), U*, and W* (also (Formula presented.) and (Formula presented.) in some specific conditions) is that they employ symmetric weight functions and thus identify spurious scores on both easy and difficult items in the same manner. However, when the purpose is to detect only the spuriously high scores on difficult items, such as cheating, guessing, and having item preknowledge, using symmetric weight functions may jeopardize the detection rates of the target aberrant response patterns. By specifying two types of asymmetric weight functions, this study proposes SHa(λ)* (λ = 1/2 or 1) and SHb(β)* (β = 2 or 3) based on Snijders’s framework to specifically detect spuriously high scores on difficult items. Two simulation studies were carried out to investigate the Type I error rates and empirical power of SHa(λ)* and SHb(β)*, compared with (Formula presented.), U*, W*, (Formula presented.), and (Formula presented.). The empirical results demonstrated satisfactory performance of the proposed indices. Recommendations were also made on the choice of different person fit indices based on specific purposes.

Original languageEnglish (US)
JournalApplied Psychological Measurement
DOIs
StateAccepted/In press - Sep 1 2017

    Fingerprint

Keywords

  • asymptotically standard normal distribution
  • item response theory
  • person fit statistic

ASJC Scopus subject areas

  • Social Sciences (miscellaneous)
  • Psychology (miscellaneous)

Cite this