An empirical bayes approach to subscore augmentation: How much strength can we borrow?

Michael Edwards, Jack L. Vevea

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

This article examines a subscore augmentation procedure. The approach uses empirical Bayes adjustments and is intended to improve the overall accuracy of measurement when information is scant. Simulations examined the impact of the method on subscale scores in a variety of realistic conditions. The authors focused on two popular scoring methods: summed scores and item response theory scale scores for summed scores. Simulation conditions included number of subscales, length (hence, reliability) of subscales, and the underlying correlations between scales. To examine the relative performance of the augmented scales, the authors computed root mean square error, reliability, percentage correctly identified as falling within specific proficiency ranges, and the percentage of simulated individuals for whom the augmented score was closer to the true score than was the nonaugmented score. The general findings and limitations of the study are discussed and areas for future research are suggested.

Original languageEnglish (US)
Pages (from-to)241-259
Number of pages19
JournalJournal of Educational and Behavioral Statistics
Volume31
Issue number3
DOIs
StatePublished - Sep 1 2006
Externally publishedYes

Fingerprint

simulation
performance

Keywords

  • Ability estimation
  • Empirical Bayes
  • Item response theory
  • Subscore augmentation

ASJC Scopus subject areas

  • Education
  • Social Sciences (miscellaneous)

Cite this

An empirical bayes approach to subscore augmentation : How much strength can we borrow? / Edwards, Michael; Vevea, Jack L.

In: Journal of Educational and Behavioral Statistics, Vol. 31, No. 3, 01.09.2006, p. 241-259.

Research output: Contribution to journalArticle

@article{844897effd4d4b568dee506846cbbb23,
title = "An empirical bayes approach to subscore augmentation: How much strength can we borrow?",
abstract = "This article examines a subscore augmentation procedure. The approach uses empirical Bayes adjustments and is intended to improve the overall accuracy of measurement when information is scant. Simulations examined the impact of the method on subscale scores in a variety of realistic conditions. The authors focused on two popular scoring methods: summed scores and item response theory scale scores for summed scores. Simulation conditions included number of subscales, length (hence, reliability) of subscales, and the underlying correlations between scales. To examine the relative performance of the augmented scales, the authors computed root mean square error, reliability, percentage correctly identified as falling within specific proficiency ranges, and the percentage of simulated individuals for whom the augmented score was closer to the true score than was the nonaugmented score. The general findings and limitations of the study are discussed and areas for future research are suggested.",
keywords = "Ability estimation, Empirical Bayes, Item response theory, Subscore augmentation",
author = "Michael Edwards and Vevea, {Jack L.}",
year = "2006",
month = "9",
day = "1",
doi = "10.3102/10769986031003241",
language = "English (US)",
volume = "31",
pages = "241--259",
journal = "Journal of Educational and Behavioral Statistics",
issn = "1076-9986",
publisher = "SAGE Publications Inc.",
number = "3",

}

TY - JOUR

T1 - An empirical bayes approach to subscore augmentation

T2 - How much strength can we borrow?

AU - Edwards, Michael

AU - Vevea, Jack L.

PY - 2006/9/1

Y1 - 2006/9/1

N2 - This article examines a subscore augmentation procedure. The approach uses empirical Bayes adjustments and is intended to improve the overall accuracy of measurement when information is scant. Simulations examined the impact of the method on subscale scores in a variety of realistic conditions. The authors focused on two popular scoring methods: summed scores and item response theory scale scores for summed scores. Simulation conditions included number of subscales, length (hence, reliability) of subscales, and the underlying correlations between scales. To examine the relative performance of the augmented scales, the authors computed root mean square error, reliability, percentage correctly identified as falling within specific proficiency ranges, and the percentage of simulated individuals for whom the augmented score was closer to the true score than was the nonaugmented score. The general findings and limitations of the study are discussed and areas for future research are suggested.

AB - This article examines a subscore augmentation procedure. The approach uses empirical Bayes adjustments and is intended to improve the overall accuracy of measurement when information is scant. Simulations examined the impact of the method on subscale scores in a variety of realistic conditions. The authors focused on two popular scoring methods: summed scores and item response theory scale scores for summed scores. Simulation conditions included number of subscales, length (hence, reliability) of subscales, and the underlying correlations between scales. To examine the relative performance of the augmented scales, the authors computed root mean square error, reliability, percentage correctly identified as falling within specific proficiency ranges, and the percentage of simulated individuals for whom the augmented score was closer to the true score than was the nonaugmented score. The general findings and limitations of the study are discussed and areas for future research are suggested.

KW - Ability estimation

KW - Empirical Bayes

KW - Item response theory

KW - Subscore augmentation

UR - http://www.scopus.com/inward/record.url?scp=33750161672&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750161672&partnerID=8YFLogxK

U2 - 10.3102/10769986031003241

DO - 10.3102/10769986031003241

M3 - Article

AN - SCOPUS:33750161672

VL - 31

SP - 241

EP - 259

JO - Journal of Educational and Behavioral Statistics

JF - Journal of Educational and Behavioral Statistics

SN - 1076-9986

IS - 3

ER -