Working with error and uncertainty to increase measurement validity

Audrey Beardsley, Joshua H. Barnett

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Over the previous two decades, the era of accountability has amplified efforts to measure educational effectiveness more than Edward Thorndike, the father of educational measurement, likely would have imagined. Expressly, the measurement structure for evaluating educational effectiveness continues to rely increasingly on one sole indicator - performance on state-endorsed, large-scaled tests - and the use of these test scores in isolation of other indicators that also capture what it means to be effective. This manuscript describes unresolved questions in educational measurement and provides recommendations to increase measurement validity along both quantitative and qualitative dimensions to move towards a more holistic and appropriate system of measuring educational effectiveness. As Thorndike would have put it, we shall be aided, not hindered, by these tests.

Original languageEnglish (US)
Pages (from-to)369-379
Number of pages11
JournalEducational Assessment, Evaluation and Accountability
Volume24
Issue number4
DOIs
StatePublished - Nov 2012

Fingerprint

uncertainty
social isolation
father
responsibility
Uncertainty
Education
performance

Keywords

  • Accountability, research methodology
  • Assessment
  • Policy analysis
  • Validity/reliability

ASJC Scopus subject areas

  • Education
  • Organizational Behavior and Human Resource Management

Cite this

Working with error and uncertainty to increase measurement validity. / Beardsley, Audrey; Barnett, Joshua H.

In: Educational Assessment, Evaluation and Accountability, Vol. 24, No. 4, 11.2012, p. 369-379.

Research output: Contribution to journalArticle

@article{8acb298ab2574f3185bde2e4e3e101c4,
title = "Working with error and uncertainty to increase measurement validity",
abstract = "Over the previous two decades, the era of accountability has amplified efforts to measure educational effectiveness more than Edward Thorndike, the father of educational measurement, likely would have imagined. Expressly, the measurement structure for evaluating educational effectiveness continues to rely increasingly on one sole indicator - performance on state-endorsed, large-scaled tests - and the use of these test scores in isolation of other indicators that also capture what it means to be effective. This manuscript describes unresolved questions in educational measurement and provides recommendations to increase measurement validity along both quantitative and qualitative dimensions to move towards a more holistic and appropriate system of measuring educational effectiveness. As Thorndike would have put it, we shall be aided, not hindered, by these tests.",
keywords = "Accountability, research methodology, Assessment, Policy analysis, Validity/reliability",
author = "Audrey Beardsley and Barnett, {Joshua H.}",
year = "2012",
month = "11",
doi = "10.1007/s11092-012-9146-6",
language = "English (US)",
volume = "24",
pages = "369--379",
journal = "Educational Assessment, Evaluation and Accountability",
issn = "1874-8597",
publisher = "Springer Netherlands",
number = "4",

}

TY - JOUR

T1 - Working with error and uncertainty to increase measurement validity

AU - Beardsley, Audrey

AU - Barnett, Joshua H.

PY - 2012/11

Y1 - 2012/11

N2 - Over the previous two decades, the era of accountability has amplified efforts to measure educational effectiveness more than Edward Thorndike, the father of educational measurement, likely would have imagined. Expressly, the measurement structure for evaluating educational effectiveness continues to rely increasingly on one sole indicator - performance on state-endorsed, large-scaled tests - and the use of these test scores in isolation of other indicators that also capture what it means to be effective. This manuscript describes unresolved questions in educational measurement and provides recommendations to increase measurement validity along both quantitative and qualitative dimensions to move towards a more holistic and appropriate system of measuring educational effectiveness. As Thorndike would have put it, we shall be aided, not hindered, by these tests.

AB - Over the previous two decades, the era of accountability has amplified efforts to measure educational effectiveness more than Edward Thorndike, the father of educational measurement, likely would have imagined. Expressly, the measurement structure for evaluating educational effectiveness continues to rely increasingly on one sole indicator - performance on state-endorsed, large-scaled tests - and the use of these test scores in isolation of other indicators that also capture what it means to be effective. This manuscript describes unresolved questions in educational measurement and provides recommendations to increase measurement validity along both quantitative and qualitative dimensions to move towards a more holistic and appropriate system of measuring educational effectiveness. As Thorndike would have put it, we shall be aided, not hindered, by these tests.

KW - Accountability, research methodology

KW - Assessment

KW - Policy analysis

KW - Validity/reliability

UR - http://www.scopus.com/inward/record.url?scp=84869886261&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869886261&partnerID=8YFLogxK

U2 - 10.1007/s11092-012-9146-6

DO - 10.1007/s11092-012-9146-6

M3 - Article

AN - SCOPUS:84869886261

VL - 24

SP - 369

EP - 379

JO - Educational Assessment, Evaluation and Accountability

JF - Educational Assessment, Evaluation and Accountability

SN - 1874-8597

IS - 4

ER -