Teacher-Level Value-Added Models on Trial: Empirical and Pragmatic Issues of Concern Across Five Court Cases

Audrey Beardsley, Kevin Close

Research output: Contribution to journalArticle

Abstract

Ongoing or recently completed across the United States are a series of lawsuits via which teacher plaintiffs are contesting how they are being evaluated using value-added models (VAMs) as part of states’/districts’ teacher accountability systems. To investigate the empirical and pragmatic matters addressed in court, researchers conducted a case study analysis of the documents submitted for five such cases. Researchers framed analyses using measurement concepts resident within the Standards for Educational and Psychological Testing, given issues with (a) reliability, (b) validity, (c) bias, (d) transparency, and (e) fairness, with emphases also on (f) whether VAMs are being used to make consequential decisions using concrete (e.g., not arbitrary) evidence, and (g) whether VAMs’ unintended consequences are also of legal pertinence and concern.

Original languageEnglish (US)
JournalEducational Policy
DOIs
StatePublished - Jan 1 2019

Fingerprint

value added
pragmatics
teacher
lawsuit
fairness
transparency
district
resident
responsibility
trend
evidence

Keywords

  • accountability
  • education policy
  • educational reform
  • evaluation and assessment
  • legal issues
  • policy implementation
  • teacher quality

ASJC Scopus subject areas

  • Education

Cite this

@article{d97fd6bd36314204b175361c2aec9fc3,
title = "Teacher-Level Value-Added Models on Trial: Empirical and Pragmatic Issues of Concern Across Five Court Cases",
abstract = "Ongoing or recently completed across the United States are a series of lawsuits via which teacher plaintiffs are contesting how they are being evaluated using value-added models (VAMs) as part of states’/districts’ teacher accountability systems. To investigate the empirical and pragmatic matters addressed in court, researchers conducted a case study analysis of the documents submitted for five such cases. Researchers framed analyses using measurement concepts resident within the Standards for Educational and Psychological Testing, given issues with (a) reliability, (b) validity, (c) bias, (d) transparency, and (e) fairness, with emphases also on (f) whether VAMs are being used to make consequential decisions using concrete (e.g., not arbitrary) evidence, and (g) whether VAMs’ unintended consequences are also of legal pertinence and concern.",
keywords = "accountability, education policy, educational reform, evaluation and assessment, legal issues, policy implementation, teacher quality",
author = "Audrey Beardsley and Kevin Close",
year = "2019",
month = "1",
day = "1",
doi = "10.1177/0895904819843593",
language = "English (US)",
journal = "Educational Policy",
issn = "0895-9048",
publisher = "SAGE Publications Inc.",

}

TY - JOUR

T1 - Teacher-Level Value-Added Models on Trial

T2 - Empirical and Pragmatic Issues of Concern Across Five Court Cases

AU - Beardsley, Audrey

AU - Close, Kevin

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Ongoing or recently completed across the United States are a series of lawsuits via which teacher plaintiffs are contesting how they are being evaluated using value-added models (VAMs) as part of states’/districts’ teacher accountability systems. To investigate the empirical and pragmatic matters addressed in court, researchers conducted a case study analysis of the documents submitted for five such cases. Researchers framed analyses using measurement concepts resident within the Standards for Educational and Psychological Testing, given issues with (a) reliability, (b) validity, (c) bias, (d) transparency, and (e) fairness, with emphases also on (f) whether VAMs are being used to make consequential decisions using concrete (e.g., not arbitrary) evidence, and (g) whether VAMs’ unintended consequences are also of legal pertinence and concern.

AB - Ongoing or recently completed across the United States are a series of lawsuits via which teacher plaintiffs are contesting how they are being evaluated using value-added models (VAMs) as part of states’/districts’ teacher accountability systems. To investigate the empirical and pragmatic matters addressed in court, researchers conducted a case study analysis of the documents submitted for five such cases. Researchers framed analyses using measurement concepts resident within the Standards for Educational and Psychological Testing, given issues with (a) reliability, (b) validity, (c) bias, (d) transparency, and (e) fairness, with emphases also on (f) whether VAMs are being used to make consequential decisions using concrete (e.g., not arbitrary) evidence, and (g) whether VAMs’ unintended consequences are also of legal pertinence and concern.

KW - accountability

KW - education policy

KW - educational reform

KW - evaluation and assessment

KW - legal issues

KW - policy implementation

KW - teacher quality

UR - http://www.scopus.com/inward/record.url?scp=85064832836&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064832836&partnerID=8YFLogxK

U2 - 10.1177/0895904819843593

DO - 10.1177/0895904819843593

M3 - Article

JO - Educational Policy

JF - Educational Policy

SN - 0895-9048

ER -