Investigating Psychometric Isomorphism for Traditional and Performance-Based Assessment

Derek M. Fay, Roy Levy, Vandhana Mehta

Research output: Contribution to journalArticle

Abstract

A common practice in educational assessment is to construct multiple forms of an assessment that consists of tasks with similar psychometric properties. This study utilizes a Bayesian multilevel item response model and descriptive graphical representations to evaluate the psychometric similarity of variations of the same task. These approaches for describing the psychometric similarity of task variants were applied to two different types of assessments (one traditional assessment and one performance-based assessment) with markedly different response formats. Due to the general nature of the multilevel item response model and graphical approaches that were utilized, the methods used for this work can readily be applied to many assessment contexts for the purposes of evaluating the psychometric similarity of tasks.

Original languageEnglish (US)
Pages (from-to)52-77
Number of pages26
JournalJournal of Educational Measurement
Volume55
Issue number1
DOIs
StatePublished - Mar 1 2018

Fingerprint

Psychometrics
psychometrics
performance
Educational Measurement

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology
  • Applied Psychology
  • Psychology (miscellaneous)

Cite this

Investigating Psychometric Isomorphism for Traditional and Performance-Based Assessment. / Fay, Derek M.; Levy, Roy; Mehta, Vandhana.

In: Journal of Educational Measurement, Vol. 55, No. 1, 01.03.2018, p. 52-77.

Research output: Contribution to journalArticle

@article{e67208b280d24fb59fd3a4a931fb7440,
title = "Investigating Psychometric Isomorphism for Traditional and Performance-Based Assessment",
abstract = "A common practice in educational assessment is to construct multiple forms of an assessment that consists of tasks with similar psychometric properties. This study utilizes a Bayesian multilevel item response model and descriptive graphical representations to evaluate the psychometric similarity of variations of the same task. These approaches for describing the psychometric similarity of task variants were applied to two different types of assessments (one traditional assessment and one performance-based assessment) with markedly different response formats. Due to the general nature of the multilevel item response model and graphical approaches that were utilized, the methods used for this work can readily be applied to many assessment contexts for the purposes of evaluating the psychometric similarity of tasks.",
author = "Fay, {Derek M.} and Roy Levy and Vandhana Mehta",
year = "2018",
month = "3",
day = "1",
doi = "10.1111/jedm.12163",
language = "English (US)",
volume = "55",
pages = "52--77",
journal = "Journal of Educational Measurement",
issn = "0022-0655",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - Investigating Psychometric Isomorphism for Traditional and Performance-Based Assessment

AU - Fay, Derek M.

AU - Levy, Roy

AU - Mehta, Vandhana

PY - 2018/3/1

Y1 - 2018/3/1

N2 - A common practice in educational assessment is to construct multiple forms of an assessment that consists of tasks with similar psychometric properties. This study utilizes a Bayesian multilevel item response model and descriptive graphical representations to evaluate the psychometric similarity of variations of the same task. These approaches for describing the psychometric similarity of task variants were applied to two different types of assessments (one traditional assessment and one performance-based assessment) with markedly different response formats. Due to the general nature of the multilevel item response model and graphical approaches that were utilized, the methods used for this work can readily be applied to many assessment contexts for the purposes of evaluating the psychometric similarity of tasks.

AB - A common practice in educational assessment is to construct multiple forms of an assessment that consists of tasks with similar psychometric properties. This study utilizes a Bayesian multilevel item response model and descriptive graphical representations to evaluate the psychometric similarity of variations of the same task. These approaches for describing the psychometric similarity of task variants were applied to two different types of assessments (one traditional assessment and one performance-based assessment) with markedly different response formats. Due to the general nature of the multilevel item response model and graphical approaches that were utilized, the methods used for this work can readily be applied to many assessment contexts for the purposes of evaluating the psychometric similarity of tasks.

UR - http://www.scopus.com/inward/record.url?scp=85042707529&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85042707529&partnerID=8YFLogxK

U2 - 10.1111/jedm.12163

DO - 10.1111/jedm.12163

M3 - Article

VL - 55

SP - 52

EP - 77

JO - Journal of Educational Measurement

JF - Journal of Educational Measurement

SN - 0022-0655

IS - 1

ER -