Where's the difficulty in standardized reading tests

The passage or the question?

Yasuhiro Ozuru, Michael Rowe, Tenaha O'Reilly, Danielle McNamara

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

The purpose of this investigation was to examine the extent to which item and text characteristics predict item difficulty on the comprehension portion of the Gates-MacGinitie Reading Tests for the 7th-9th and 10th-12th grade levels. Detailed item-based analyses were performed on 192 comprehension questions on the basis of the cognitive processing model framework proposed by Embretson and colleagues (Embretson & Wetzel, 1987). Item difficulty was analyzed in terms of various passage features (e.g., word frequency and number of propositions) and individual-question characteristics (e.g., abstractness and degree of inferential processing), using hierarchical linear modeling. The results indicated that the difficulty of the items in the test for the 7th-9th grade level is primarily influenced by text features-in particular, vocabulary difficulty-whereas the difficulty of the items in the test for the 10th-12th grade level is less systematically influenced by text features.

Original languageEnglish (US)
Pages (from-to)1001-1015
Number of pages15
JournalBehavior Research Methods
Volume40
Issue number4
DOIs
StatePublished - Nov 2008
Externally publishedYes

Fingerprint

Reading
Vocabulary
Grade Level
Hierarchical Linear Modeling
Processing Model
Cognitive Processing
Word Frequency
Abstractness

ASJC Scopus subject areas

  • Psychology(all)
  • Psychology (miscellaneous)
  • Experimental and Cognitive Psychology

Cite this

Where's the difficulty in standardized reading tests : The passage or the question? / Ozuru, Yasuhiro; Rowe, Michael; O'Reilly, Tenaha; McNamara, Danielle.

In: Behavior Research Methods, Vol. 40, No. 4, 11.2008, p. 1001-1015.

Research output: Contribution to journalArticle

Ozuru, Yasuhiro ; Rowe, Michael ; O'Reilly, Tenaha ; McNamara, Danielle. / Where's the difficulty in standardized reading tests : The passage or the question?. In: Behavior Research Methods. 2008 ; Vol. 40, No. 4. pp. 1001-1015.
@article{ac8dc2ef62b04acd8210523571cc7a1d,
title = "Where's the difficulty in standardized reading tests: The passage or the question?",
abstract = "The purpose of this investigation was to examine the extent to which item and text characteristics predict item difficulty on the comprehension portion of the Gates-MacGinitie Reading Tests for the 7th-9th and 10th-12th grade levels. Detailed item-based analyses were performed on 192 comprehension questions on the basis of the cognitive processing model framework proposed by Embretson and colleagues (Embretson & Wetzel, 1987). Item difficulty was analyzed in terms of various passage features (e.g., word frequency and number of propositions) and individual-question characteristics (e.g., abstractness and degree of inferential processing), using hierarchical linear modeling. The results indicated that the difficulty of the items in the test for the 7th-9th grade level is primarily influenced by text features-in particular, vocabulary difficulty-whereas the difficulty of the items in the test for the 10th-12th grade level is less systematically influenced by text features.",
author = "Yasuhiro Ozuru and Michael Rowe and Tenaha O'Reilly and Danielle McNamara",
year = "2008",
month = "11",
doi = "10.3758/BRM.40.4.1001",
language = "English (US)",
volume = "40",
pages = "1001--1015",
journal = "Behavior Research Methods, Instruments, and Computers",
issn = "1554-351X",
publisher = "Springer New York",
number = "4",

}

TY - JOUR

T1 - Where's the difficulty in standardized reading tests

T2 - The passage or the question?

AU - Ozuru, Yasuhiro

AU - Rowe, Michael

AU - O'Reilly, Tenaha

AU - McNamara, Danielle

PY - 2008/11

Y1 - 2008/11

N2 - The purpose of this investigation was to examine the extent to which item and text characteristics predict item difficulty on the comprehension portion of the Gates-MacGinitie Reading Tests for the 7th-9th and 10th-12th grade levels. Detailed item-based analyses were performed on 192 comprehension questions on the basis of the cognitive processing model framework proposed by Embretson and colleagues (Embretson & Wetzel, 1987). Item difficulty was analyzed in terms of various passage features (e.g., word frequency and number of propositions) and individual-question characteristics (e.g., abstractness and degree of inferential processing), using hierarchical linear modeling. The results indicated that the difficulty of the items in the test for the 7th-9th grade level is primarily influenced by text features-in particular, vocabulary difficulty-whereas the difficulty of the items in the test for the 10th-12th grade level is less systematically influenced by text features.

AB - The purpose of this investigation was to examine the extent to which item and text characteristics predict item difficulty on the comprehension portion of the Gates-MacGinitie Reading Tests for the 7th-9th and 10th-12th grade levels. Detailed item-based analyses were performed on 192 comprehension questions on the basis of the cognitive processing model framework proposed by Embretson and colleagues (Embretson & Wetzel, 1987). Item difficulty was analyzed in terms of various passage features (e.g., word frequency and number of propositions) and individual-question characteristics (e.g., abstractness and degree of inferential processing), using hierarchical linear modeling. The results indicated that the difficulty of the items in the test for the 7th-9th grade level is primarily influenced by text features-in particular, vocabulary difficulty-whereas the difficulty of the items in the test for the 10th-12th grade level is less systematically influenced by text features.

UR - http://www.scopus.com/inward/record.url?scp=58149401323&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=58149401323&partnerID=8YFLogxK

U2 - 10.3758/BRM.40.4.1001

DO - 10.3758/BRM.40.4.1001

M3 - Article

VL - 40

SP - 1001

EP - 1015

JO - Behavior Research Methods, Instruments, and Computers

JF - Behavior Research Methods, Instruments, and Computers

SN - 1554-351X

IS - 4

ER -