A diagnostic procedure to detect departures from local independence in item response theory models

Michael Edwards, Carrie R. Houts

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Item response theory (IRT) is a widely used measurement model. When considering its use in education, health outcomes, and psychology, it is likely to be one of the most impactful psychometric models in existence. IRT has many advantages over classical test theory-based measurement models. For these advantages to hold in practice, strong assumptions must be satisfied. One of these assumptions, local independence, is the focus of the work described here. Local independence is the assumption that, conditional on the latent variable(s), item responses are unrelated to one another (i.e., independent). Stated another way, local independence implies that the only thing causing items to covary is the modeled latent variable(s). Violations of this assumption, quite aptly titled local dependence, can have serious consequences for the estimated parameters. A new diagnostic is proposed, based on parameter stability in an item-level jackknife resampling procedure. We review the ideas underlying the new diagnostic and how it is computed before covering some simulated and real examples demonstrating its effectiveness.

Original languageEnglish (US)
Pages (from-to)138-149
Number of pages12
JournalPsychological Methods
Volume23
Issue number1
DOIs
StatePublished - Mar 1 2018
Externally publishedYes

Fingerprint

Behavioral Medicine
Psychometrics
Education

Keywords

  • Diagnostics
  • Item Response Theory
  • Local Dependence
  • Local Independence

ASJC Scopus subject areas

  • Psychology (miscellaneous)

Cite this

A diagnostic procedure to detect departures from local independence in item response theory models. / Edwards, Michael; Houts, Carrie R.

In: Psychological Methods, Vol. 23, No. 1, 01.03.2018, p. 138-149.

Research output: Contribution to journalArticle

@article{e8745a2c0ab5467da330ca1998f40859,
title = "A diagnostic procedure to detect departures from local independence in item response theory models",
abstract = "Item response theory (IRT) is a widely used measurement model. When considering its use in education, health outcomes, and psychology, it is likely to be one of the most impactful psychometric models in existence. IRT has many advantages over classical test theory-based measurement models. For these advantages to hold in practice, strong assumptions must be satisfied. One of these assumptions, local independence, is the focus of the work described here. Local independence is the assumption that, conditional on the latent variable(s), item responses are unrelated to one another (i.e., independent). Stated another way, local independence implies that the only thing causing items to covary is the modeled latent variable(s). Violations of this assumption, quite aptly titled local dependence, can have serious consequences for the estimated parameters. A new diagnostic is proposed, based on parameter stability in an item-level jackknife resampling procedure. We review the ideas underlying the new diagnostic and how it is computed before covering some simulated and real examples demonstrating its effectiveness.",
keywords = "Diagnostics, Item Response Theory, Local Dependence, Local Independence",
author = "Michael Edwards and Houts, {Carrie R.}",
year = "2018",
month = "3",
day = "1",
doi = "10.1037/met0000121",
language = "English (US)",
volume = "23",
pages = "138--149",
journal = "Psychological Methods",
issn = "1082-989X",
publisher = "American Psychological Association Inc.",
number = "1",

}

TY - JOUR

T1 - A diagnostic procedure to detect departures from local independence in item response theory models

AU - Edwards, Michael

AU - Houts, Carrie R.

PY - 2018/3/1

Y1 - 2018/3/1

N2 - Item response theory (IRT) is a widely used measurement model. When considering its use in education, health outcomes, and psychology, it is likely to be one of the most impactful psychometric models in existence. IRT has many advantages over classical test theory-based measurement models. For these advantages to hold in practice, strong assumptions must be satisfied. One of these assumptions, local independence, is the focus of the work described here. Local independence is the assumption that, conditional on the latent variable(s), item responses are unrelated to one another (i.e., independent). Stated another way, local independence implies that the only thing causing items to covary is the modeled latent variable(s). Violations of this assumption, quite aptly titled local dependence, can have serious consequences for the estimated parameters. A new diagnostic is proposed, based on parameter stability in an item-level jackknife resampling procedure. We review the ideas underlying the new diagnostic and how it is computed before covering some simulated and real examples demonstrating its effectiveness.

AB - Item response theory (IRT) is a widely used measurement model. When considering its use in education, health outcomes, and psychology, it is likely to be one of the most impactful psychometric models in existence. IRT has many advantages over classical test theory-based measurement models. For these advantages to hold in practice, strong assumptions must be satisfied. One of these assumptions, local independence, is the focus of the work described here. Local independence is the assumption that, conditional on the latent variable(s), item responses are unrelated to one another (i.e., independent). Stated another way, local independence implies that the only thing causing items to covary is the modeled latent variable(s). Violations of this assumption, quite aptly titled local dependence, can have serious consequences for the estimated parameters. A new diagnostic is proposed, based on parameter stability in an item-level jackknife resampling procedure. We review the ideas underlying the new diagnostic and how it is computed before covering some simulated and real examples demonstrating its effectiveness.

KW - Diagnostics

KW - Item Response Theory

KW - Local Dependence

KW - Local Independence

UR - http://www.scopus.com/inward/record.url?scp=85016710165&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016710165&partnerID=8YFLogxK

U2 - 10.1037/met0000121

DO - 10.1037/met0000121

M3 - Article

VL - 23

SP - 138

EP - 149

JO - Psychological Methods

JF - Psychological Methods

SN - 1082-989X

IS - 1

ER -