Investigating the Function of Content and Argumentation Items in a Science Test: A Multidimensional Approach

Shih Ying Yao, Mark Wilson, Joseph Henderson, Jonathan Osborne

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

The latest national science framework has formally stated the need for developing assessments that test both students' content knowledge and scientific practices. In response to this call, a science assessment that consists of (a) content items that measure students' understanding of a grade eight physics topic and (b) argumentation items that measure students' argumentation competency has been developed. This paper investigated the function of these content and argumentation items with a multidimensional measurement framework from two perspectives. First, we performed a dimensionality analysis to investigate whether the relationship between the content and argumentation items conformed to test deign. Second, we conducted a differential item functioning analysis in the multidimensional framework to examine if any content or argumentation item unfairly favored students with an advanced level of English literacy. Methods and findings of this study could inform future research on the validation of assessments measuring higher-order and complex abilities.

Original languageEnglish (US)
Pages (from-to)171-192
Number of pages22
JournalJournal of Applied Measurement
Volume16
Issue number2
StatePublished - 2015

Fingerprint

Students
Aptitude
Needs Assessment
Physics
Literacy

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Investigating the Function of Content and Argumentation Items in a Science Test : A Multidimensional Approach. / Yao, Shih Ying; Wilson, Mark; Henderson, Joseph; Osborne, Jonathan.

In: Journal of Applied Measurement, Vol. 16, No. 2, 2015, p. 171-192.

Research output: Contribution to journalArticle

@article{d8788fbef65846e487f4fd0cdc374290,
title = "Investigating the Function of Content and Argumentation Items in a Science Test: A Multidimensional Approach",
abstract = "The latest national science framework has formally stated the need for developing assessments that test both students' content knowledge and scientific practices. In response to this call, a science assessment that consists of (a) content items that measure students' understanding of a grade eight physics topic and (b) argumentation items that measure students' argumentation competency has been developed. This paper investigated the function of these content and argumentation items with a multidimensional measurement framework from two perspectives. First, we performed a dimensionality analysis to investigate whether the relationship between the content and argumentation items conformed to test deign. Second, we conducted a differential item functioning analysis in the multidimensional framework to examine if any content or argumentation item unfairly favored students with an advanced level of English literacy. Methods and findings of this study could inform future research on the validation of assessments measuring higher-order and complex abilities.",
author = "Yao, {Shih Ying} and Mark Wilson and Joseph Henderson and Jonathan Osborne",
year = "2015",
language = "English (US)",
volume = "16",
pages = "171--192",
journal = "Journal of Applied Measurement",
issn = "1529-7713",
publisher = "JAM Press",
number = "2",

}

TY - JOUR

T1 - Investigating the Function of Content and Argumentation Items in a Science Test

T2 - A Multidimensional Approach

AU - Yao, Shih Ying

AU - Wilson, Mark

AU - Henderson, Joseph

AU - Osborne, Jonathan

PY - 2015

Y1 - 2015

N2 - The latest national science framework has formally stated the need for developing assessments that test both students' content knowledge and scientific practices. In response to this call, a science assessment that consists of (a) content items that measure students' understanding of a grade eight physics topic and (b) argumentation items that measure students' argumentation competency has been developed. This paper investigated the function of these content and argumentation items with a multidimensional measurement framework from two perspectives. First, we performed a dimensionality analysis to investigate whether the relationship between the content and argumentation items conformed to test deign. Second, we conducted a differential item functioning analysis in the multidimensional framework to examine if any content or argumentation item unfairly favored students with an advanced level of English literacy. Methods and findings of this study could inform future research on the validation of assessments measuring higher-order and complex abilities.

AB - The latest national science framework has formally stated the need for developing assessments that test both students' content knowledge and scientific practices. In response to this call, a science assessment that consists of (a) content items that measure students' understanding of a grade eight physics topic and (b) argumentation items that measure students' argumentation competency has been developed. This paper investigated the function of these content and argumentation items with a multidimensional measurement framework from two perspectives. First, we performed a dimensionality analysis to investigate whether the relationship between the content and argumentation items conformed to test deign. Second, we conducted a differential item functioning analysis in the multidimensional framework to examine if any content or argumentation item unfairly favored students with an advanced level of English literacy. Methods and findings of this study could inform future research on the validation of assessments measuring higher-order and complex abilities.

UR - http://www.scopus.com/inward/record.url?scp=84937511965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937511965&partnerID=8YFLogxK

M3 - Article

C2 - 26075666

AN - SCOPUS:84937511965

VL - 16

SP - 171

EP - 192

JO - Journal of Applied Measurement

JF - Journal of Applied Measurement

SN - 1529-7713

IS - 2

ER -