TY - JOUR
T1 - Impact of DIF on General Factor Mean Comparisons for Bifactor, Ordinal Data
AU - Liu, Yixing
AU - Thompson, Marilyn S.
N1 - Funding Information:
We appreciate suggestions and feedback on this research received from Roy Levy and Holly O’Rourke from Arizona State University.
Publisher Copyright:
© 2021 Taylor & Francis Group, LLC.
PY - 2022
Y1 - 2022
N2 - A simulation study was conducted to explore the impact of differential item functioning (DIF) on general factor difference estimation for bifactor, ordinal data. Common analysis misspecifications in which the generated bifactor data with DIF were fitted using models with equality constraints on noninvariant item parameters were compared under data generation conditions varying by sample size, number of response categories, effect size of the general factor mean difference, and the position and the magnitude of DIF. Estimation bias in the general factor mean difference resulting from ignoring DIF mainly depended on the type of parameters with DIF. When ignoring DIF in threshold parameters, very substantial estimation bias was produced, and Type I error rates (powers) were inflated for many conditions. In contrast, when ignoring DIF in general factor loadings, a little estimation bias was produced; when ignoring DIF in specific factor loadings, almost no estimation bias was produced. All Type I error rates fell within required limits when DIF was present in factor loadings, and powers were not influenced by ignoring DIF in factor loadings.
AB - A simulation study was conducted to explore the impact of differential item functioning (DIF) on general factor difference estimation for bifactor, ordinal data. Common analysis misspecifications in which the generated bifactor data with DIF were fitted using models with equality constraints on noninvariant item parameters were compared under data generation conditions varying by sample size, number of response categories, effect size of the general factor mean difference, and the position and the magnitude of DIF. Estimation bias in the general factor mean difference resulting from ignoring DIF mainly depended on the type of parameters with DIF. When ignoring DIF in threshold parameters, very substantial estimation bias was produced, and Type I error rates (powers) were inflated for many conditions. In contrast, when ignoring DIF in general factor loadings, a little estimation bias was produced; when ignoring DIF in specific factor loadings, almost no estimation bias was produced. All Type I error rates fell within required limits when DIF was present in factor loadings, and powers were not influenced by ignoring DIF in factor loadings.
KW - bifactor models
KW - differential item functioning
KW - general factor mean difference
KW - multiple-group categorical CFA
KW - ordinal data
UR - http://www.scopus.com/inward/record.url?scp=85109609153&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85109609153&partnerID=8YFLogxK
U2 - 10.1080/00220973.2021.1926895
DO - 10.1080/00220973.2021.1926895
M3 - Article
AN - SCOPUS:85109609153
SN - 0022-0973
VL - 90
SP - 981
EP - 1002
JO - Journal of Experimental Education
JF - Journal of Experimental Education
IS - 4
ER -