A Comparison of Item-Level and Scale-Level Multiple Imputation for Questionnaire Batteries

Amanda C. Gottschall, Stephen West, Craig K. Enders

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

Behavioral science researchers routinely use scale scores that sum or average a set of questionnaire items to address their substantive questions. A researcher applying multiple imputation to incomplete questionnaire data can either impute the incomplete items prior to computing scale scores or impute the scale scores directly from other scale scores. This study used a Monte Carlo simulation to assess the impact of imputation method on the bias and efficiency of scale-level parameter estimates, including scale score means, between-scale correlations, and regression coefficients. Although the choice of imputation approach had no influence on the bias of scale-level parameter estimates, it had a substantial impact on efficiency, such that item-level imputation consistently produced a meaningful power advantage. The simulation results clearly supported the use of item-level imputation. To illustrate the differences between item- and scale-level imputation, we examined predictors of 7th-grade academic self-efficacy in a sample of 595 low-income Mexican Origin adolescents in a planned missingness design. The results of the empirical data analysis were consistent with those of the simulation and also suggested that researchers should be cautious when implementing planned missing data designs that necessitate scale-level imputation.

Original languageEnglish (US)
Pages (from-to)1-25
Number of pages25
JournalMultivariate Behavioral Research
Volume47
Issue number1
DOIs
StatePublished - Feb 2012

Fingerprint

Multiple Imputation
Battery
Questionnaire
Research Personnel
Imputation
Behavioral Sciences
Self Efficacy
Surveys and Questionnaires
Self-efficacy
Regression Coefficient
Missing Data
Correlation coefficient
Estimate
Predictors
Data analysis
Simulation
Monte Carlo Simulation

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Statistics and Probability
  • Arts and Humanities (miscellaneous)

Cite this

A Comparison of Item-Level and Scale-Level Multiple Imputation for Questionnaire Batteries. / Gottschall, Amanda C.; West, Stephen; Enders, Craig K.

In: Multivariate Behavioral Research, Vol. 47, No. 1, 02.2012, p. 1-25.

Research output: Contribution to journalArticle

@article{e0ae0bd8dfa940c4926bcb66961d2cc1,
title = "A Comparison of Item-Level and Scale-Level Multiple Imputation for Questionnaire Batteries",
abstract = "Behavioral science researchers routinely use scale scores that sum or average a set of questionnaire items to address their substantive questions. A researcher applying multiple imputation to incomplete questionnaire data can either impute the incomplete items prior to computing scale scores or impute the scale scores directly from other scale scores. This study used a Monte Carlo simulation to assess the impact of imputation method on the bias and efficiency of scale-level parameter estimates, including scale score means, between-scale correlations, and regression coefficients. Although the choice of imputation approach had no influence on the bias of scale-level parameter estimates, it had a substantial impact on efficiency, such that item-level imputation consistently produced a meaningful power advantage. The simulation results clearly supported the use of item-level imputation. To illustrate the differences between item- and scale-level imputation, we examined predictors of 7th-grade academic self-efficacy in a sample of 595 low-income Mexican Origin adolescents in a planned missingness design. The results of the empirical data analysis were consistent with those of the simulation and also suggested that researchers should be cautious when implementing planned missing data designs that necessitate scale-level imputation.",
author = "Gottschall, {Amanda C.} and Stephen West and Enders, {Craig K.}",
year = "2012",
month = "2",
doi = "10.1080/00273171.2012.640589",
language = "English (US)",
volume = "47",
pages = "1--25",
journal = "Multivariate Behavioral Research",
issn = "0027-3171",
publisher = "Psychology Press Ltd",
number = "1",

}

TY - JOUR

T1 - A Comparison of Item-Level and Scale-Level Multiple Imputation for Questionnaire Batteries

AU - Gottschall, Amanda C.

AU - West, Stephen

AU - Enders, Craig K.

PY - 2012/2

Y1 - 2012/2

N2 - Behavioral science researchers routinely use scale scores that sum or average a set of questionnaire items to address their substantive questions. A researcher applying multiple imputation to incomplete questionnaire data can either impute the incomplete items prior to computing scale scores or impute the scale scores directly from other scale scores. This study used a Monte Carlo simulation to assess the impact of imputation method on the bias and efficiency of scale-level parameter estimates, including scale score means, between-scale correlations, and regression coefficients. Although the choice of imputation approach had no influence on the bias of scale-level parameter estimates, it had a substantial impact on efficiency, such that item-level imputation consistently produced a meaningful power advantage. The simulation results clearly supported the use of item-level imputation. To illustrate the differences between item- and scale-level imputation, we examined predictors of 7th-grade academic self-efficacy in a sample of 595 low-income Mexican Origin adolescents in a planned missingness design. The results of the empirical data analysis were consistent with those of the simulation and also suggested that researchers should be cautious when implementing planned missing data designs that necessitate scale-level imputation.

AB - Behavioral science researchers routinely use scale scores that sum or average a set of questionnaire items to address their substantive questions. A researcher applying multiple imputation to incomplete questionnaire data can either impute the incomplete items prior to computing scale scores or impute the scale scores directly from other scale scores. This study used a Monte Carlo simulation to assess the impact of imputation method on the bias and efficiency of scale-level parameter estimates, including scale score means, between-scale correlations, and regression coefficients. Although the choice of imputation approach had no influence on the bias of scale-level parameter estimates, it had a substantial impact on efficiency, such that item-level imputation consistently produced a meaningful power advantage. The simulation results clearly supported the use of item-level imputation. To illustrate the differences between item- and scale-level imputation, we examined predictors of 7th-grade academic self-efficacy in a sample of 595 low-income Mexican Origin adolescents in a planned missingness design. The results of the empirical data analysis were consistent with those of the simulation and also suggested that researchers should be cautious when implementing planned missing data designs that necessitate scale-level imputation.

UR - http://www.scopus.com/inward/record.url?scp=84857244266&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84857244266&partnerID=8YFLogxK

U2 - 10.1080/00273171.2012.640589

DO - 10.1080/00273171.2012.640589

M3 - Article

AN - SCOPUS:84857244266

VL - 47

SP - 1

EP - 25

JO - Multivariate Behavioral Research

JF - Multivariate Behavioral Research

SN - 0027-3171

IS - 1

ER -