Interpreting Probabilistic Classifications From Diagnostic Psychometric Models

Laine Bradshaw, Roy Levy

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Although much research has been conducted on the psychometric properties of cognitive diagnostic models, they are only recently being used in operational settings to provide results to examinees and other stakeholders. Using this newer class of models in practice comes with a fresh challenge for diagnostic assessment developers: effectively reporting results and supporting end users to accurately interpret results. Achieving the goal of communicating results in a way that leads users of the assessment to make accurate interpretations requires a prerequisite step that cannot be taken for granted. The assessment developers must first accurately interpret results from a psychometric, or measurement, standpoint. Through this article, we seek to begin a discussion about reasonable interpretations of the results that classification-based models provide about examinees. Interpretations from published research and ongoing practice show different—and sometimes conflicting—ways to interpret these results. This article seeks to formalize a comparison, critique, and discussion among the interpretations. Before beginning this discussion, we first present background on the results provided by classification-based models regarding the examinees. We then structure our discussion around key questions an assessment development team needs to answer themselves prior to constructing reports and interpretative guides for end users of the assessment.

Original languageEnglish (US)
Pages (from-to)79-88
Number of pages10
JournalEducational Measurement: Issues and Practice
Volume38
Issue number2
DOIs
StatePublished - Jun 1 2019

Keywords

  • cognitive diagnosis models
  • diagnostic classification models
  • diagnostic model reporting
  • probabilistic classification
  • score interpretation

ASJC Scopus subject areas

  • Education

Fingerprint Dive into the research topics of 'Interpreting Probabilistic Classifications From Diagnostic Psychometric Models'. Together they form a unique fingerprint.

Cite this