Can today’s standardized achievement tests yield instructionally useful data? Challenges, promises and the state of the art

W. James Popham, David Berliner, Neal M. Kingston, Susan H. Fuhrman, Steven M. Ladd, Jeffrey Charbonneau, Madhabi Chatterji

Research output: Contribution to journalArticle

3 Scopus citations

Abstract

Purpose – Against a backdrop of high-stakes assessment policies in the USA, this paper explores the challenges, promises and the “state of the art” with regard to designing standardized achievement tests and educational assessment systems that are instructionally useful. Authors deliberate on the consequences of using inappropriately designed tests, and in particular tests that are insensitive to instruction, for teacher and/or school evaluation purposes.

Methodology/approach – The method used is a “moderated policy discussion”. The six invited commentaries represent voices of leading education scholars and measurement experts, juxtaposed against views of a prominent leader and nationally recognized teacher from two American education systems. The discussion is moderated with introductory and concluding remarks from the guest editor, and is excerpted from a recent blog published by Education Week. References and author biographies are presented at the end of the article.

Findings – In the education assessment profession, there is a promising movement toward more research and development on standardized assessment systems that are instructionally sensitive and useful for classroom teaching. However, the distinctions among different types of tests vis-à-vis their purposes are often unclear to policymakers, educators and other test users, leading to test misuses. The authors underscore issues related to validity, ethics and consequences when inappropriately designed tests are used in high-stakes policy contexts, offering recommendations for the design of instructionally sensitive tests and more comprehensive assessment systems that can serve a broader set of educational evaluation needs. As instructionally informative tests are developed and formalized, their psychometric quality and utility in school and teacher evaluation models must also be evaluated.

Originality/value – Featuring perspectives of scholars, measurement experts and educators “on the ground”, this article presents an open and balanced exchange of technical, applied and policy issues surrounding “instructionally sensitive” test design and use, along with other types of assessments needed to create comprehensive educational evaluation systems.

Original languageEnglish (US)
Pages (from-to)303-318
Number of pages16
JournalQuality Assurance in Education
Volume22
Issue number4
DOIs
StatePublished - Aug 26 2014

Keywords

  • Assessment for instruction
  • Criterion-referenced testing
  • Educational accountability
  • Norm-referenced testing
  • School evaluation
  • Standardized tests
  • Teacher evaluation

ASJC Scopus subject areas

  • Education

Fingerprint Dive into the research topics of 'Can today’s standardized achievement tests yield instructionally useful data? Challenges, promises and the state of the art'. Together they form a unique fingerprint.

  • Cite this