Median Growth Percentiles (MGPs): Assessment of Intertemporal Stability and Correlations with Observational Scores

Research output: Contribution to journalArticle

Abstract

While states are no longer required to set up teacher evaluation systems based in significant part on student test scores, quite a few continue to use value-added (VAMs) or student growth percentile (SGP) models for that purpose. In this study, we analyzed three years of teacher data to illustrate the performance of teachers’ median growth percentiles (MGPs)). We found MGP’s consistency over time to be comparable with the existing estimates from the value-added models (VAMs). Additionally, we found that MGPs do not substantively agree with another measure of teacher quality–teachers’ observational scores. These findings suggest that caution should be exercised when teacher’s MGPs, as well as VAMs, are used in teacher evaluation system to make high-stakes decisions such as merit pay, tenure, or teacher contract termination. Our findings about the correlation of MGPs with observational scores support the idea of the multidimensional nature of teacher effectiveness construct.

Original languageEnglish (US)
Pages (from-to)139-155
Number of pages17
JournalEducational Assessment
Volume23
Issue number2
DOIs
StatePublished - Apr 3 2018

Fingerprint

teacher
value added
evaluation
student
performance

ASJC Scopus subject areas

  • Education

Cite this

@article{439ab7d806984a50b9902aebdabe30eb,
title = "Median Growth Percentiles (MGPs): Assessment of Intertemporal Stability and Correlations with Observational Scores",
abstract = "While states are no longer required to set up teacher evaluation systems based in significant part on student test scores, quite a few continue to use value-added (VAMs) or student growth percentile (SGP) models for that purpose. In this study, we analyzed three years of teacher data to illustrate the performance of teachers’ median growth percentiles (MGPs)). We found MGP’s consistency over time to be comparable with the existing estimates from the value-added models (VAMs). Additionally, we found that MGPs do not substantively agree with another measure of teacher quality–teachers’ observational scores. These findings suggest that caution should be exercised when teacher’s MGPs, as well as VAMs, are used in teacher evaluation system to make high-stakes decisions such as merit pay, tenure, or teacher contract termination. Our findings about the correlation of MGPs with observational scores support the idea of the multidimensional nature of teacher effectiveness construct.",
author = "Margarita Pivovarova and Audrey Beardsley",
year = "2018",
month = "4",
day = "3",
doi = "10.1080/10627197.2018.1449634",
language = "English (US)",
volume = "23",
pages = "139--155",
journal = "Educational Assessment",
issn = "1062-7197",
publisher = "Routledge",
number = "2",

}

TY - JOUR

T1 - Median Growth Percentiles (MGPs)

T2 - Assessment of Intertemporal Stability and Correlations with Observational Scores

AU - Pivovarova, Margarita

AU - Beardsley, Audrey

PY - 2018/4/3

Y1 - 2018/4/3

N2 - While states are no longer required to set up teacher evaluation systems based in significant part on student test scores, quite a few continue to use value-added (VAMs) or student growth percentile (SGP) models for that purpose. In this study, we analyzed three years of teacher data to illustrate the performance of teachers’ median growth percentiles (MGPs)). We found MGP’s consistency over time to be comparable with the existing estimates from the value-added models (VAMs). Additionally, we found that MGPs do not substantively agree with another measure of teacher quality–teachers’ observational scores. These findings suggest that caution should be exercised when teacher’s MGPs, as well as VAMs, are used in teacher evaluation system to make high-stakes decisions such as merit pay, tenure, or teacher contract termination. Our findings about the correlation of MGPs with observational scores support the idea of the multidimensional nature of teacher effectiveness construct.

AB - While states are no longer required to set up teacher evaluation systems based in significant part on student test scores, quite a few continue to use value-added (VAMs) or student growth percentile (SGP) models for that purpose. In this study, we analyzed three years of teacher data to illustrate the performance of teachers’ median growth percentiles (MGPs)). We found MGP’s consistency over time to be comparable with the existing estimates from the value-added models (VAMs). Additionally, we found that MGPs do not substantively agree with another measure of teacher quality–teachers’ observational scores. These findings suggest that caution should be exercised when teacher’s MGPs, as well as VAMs, are used in teacher evaluation system to make high-stakes decisions such as merit pay, tenure, or teacher contract termination. Our findings about the correlation of MGPs with observational scores support the idea of the multidimensional nature of teacher effectiveness construct.

UR - http://www.scopus.com/inward/record.url?scp=85043710552&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85043710552&partnerID=8YFLogxK

U2 - 10.1080/10627197.2018.1449634

DO - 10.1080/10627197.2018.1449634

M3 - Article

VL - 23

SP - 139

EP - 155

JO - Educational Assessment

JF - Educational Assessment

SN - 1062-7197

IS - 2

ER -