Setting Proficiency Standards for School Leadership Assessment: An Examination of Cut Score Decision Making

Xiu Chen Cravens, Ellen B. Goldring, Andrew C. Porter, Morgan S. Polikoff, Joseph Murphy, Stephen Elliott

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Purpose: Performance evaluation informs professional development and helps school personnel improve student learning. Although psychometric literature indicates that a rational, sound, and coherent standard-setting process adds to the credibility of an assessment, few studies have empirically examined the decision-making process. This article sheds light on the inner workings of setting cut scores for leadership proficiency from the deliberative perspectives of expert-panel participants, including principals, teachers, district supervisors, and researchers. Research Design: Qualitative methods are used to observe and document a standards-setting process as it takes place and to analyze the results. Findings: The findings indicate that setting cut scores for principal leadership proficiency is a cognitively demanding but achievable process for effective implementation of carefully designed procedures. The study also provides insight regarding the influence of external factors, such as backgrounds of panelists, consideration of school contexts, and concerns about consequence during the standard-setting deliberation.

Original languageEnglish (US)
Pages (from-to)124-160
Number of pages37
JournalEducational Administration Quarterly
Volume49
Issue number1
DOIs
StatePublished - Feb 2013

Fingerprint

leadership
decision making
examination
school
deliberation
qualitative method
psychometrics
credibility
decision-making process
research planning
personnel
expert
district
teacher
evaluation
learning
performance
student
literature

Keywords

  • assessment
  • cut score
  • evaluation
  • proficiency standard
  • school leadership
  • standard setting

ASJC Scopus subject areas

  • Education
  • Public Administration

Cite this

Setting Proficiency Standards for School Leadership Assessment : An Examination of Cut Score Decision Making. / Cravens, Xiu Chen; Goldring, Ellen B.; Porter, Andrew C.; Polikoff, Morgan S.; Murphy, Joseph; Elliott, Stephen.

In: Educational Administration Quarterly, Vol. 49, No. 1, 02.2013, p. 124-160.

Research output: Contribution to journalArticle

Cravens, Xiu Chen ; Goldring, Ellen B. ; Porter, Andrew C. ; Polikoff, Morgan S. ; Murphy, Joseph ; Elliott, Stephen. / Setting Proficiency Standards for School Leadership Assessment : An Examination of Cut Score Decision Making. In: Educational Administration Quarterly. 2013 ; Vol. 49, No. 1. pp. 124-160.
@article{3e99f0895e4a45afbe75ea502b517f00,
title = "Setting Proficiency Standards for School Leadership Assessment: An Examination of Cut Score Decision Making",
abstract = "Purpose: Performance evaluation informs professional development and helps school personnel improve student learning. Although psychometric literature indicates that a rational, sound, and coherent standard-setting process adds to the credibility of an assessment, few studies have empirically examined the decision-making process. This article sheds light on the inner workings of setting cut scores for leadership proficiency from the deliberative perspectives of expert-panel participants, including principals, teachers, district supervisors, and researchers. Research Design: Qualitative methods are used to observe and document a standards-setting process as it takes place and to analyze the results. Findings: The findings indicate that setting cut scores for principal leadership proficiency is a cognitively demanding but achievable process for effective implementation of carefully designed procedures. The study also provides insight regarding the influence of external factors, such as backgrounds of panelists, consideration of school contexts, and concerns about consequence during the standard-setting deliberation.",
keywords = "assessment, cut score, evaluation, proficiency standard, school leadership, standard setting",
author = "Cravens, {Xiu Chen} and Goldring, {Ellen B.} and Porter, {Andrew C.} and Polikoff, {Morgan S.} and Joseph Murphy and Stephen Elliott",
year = "2013",
month = "2",
doi = "10.1177/0013161X12455330",
language = "English (US)",
volume = "49",
pages = "124--160",
journal = "Educational Administration Quarterly",
issn = "0013-161X",
publisher = "SAGE Publications Inc.",
number = "1",

}

TY - JOUR

T1 - Setting Proficiency Standards for School Leadership Assessment

T2 - An Examination of Cut Score Decision Making

AU - Cravens, Xiu Chen

AU - Goldring, Ellen B.

AU - Porter, Andrew C.

AU - Polikoff, Morgan S.

AU - Murphy, Joseph

AU - Elliott, Stephen

PY - 2013/2

Y1 - 2013/2

N2 - Purpose: Performance evaluation informs professional development and helps school personnel improve student learning. Although psychometric literature indicates that a rational, sound, and coherent standard-setting process adds to the credibility of an assessment, few studies have empirically examined the decision-making process. This article sheds light on the inner workings of setting cut scores for leadership proficiency from the deliberative perspectives of expert-panel participants, including principals, teachers, district supervisors, and researchers. Research Design: Qualitative methods are used to observe and document a standards-setting process as it takes place and to analyze the results. Findings: The findings indicate that setting cut scores for principal leadership proficiency is a cognitively demanding but achievable process for effective implementation of carefully designed procedures. The study also provides insight regarding the influence of external factors, such as backgrounds of panelists, consideration of school contexts, and concerns about consequence during the standard-setting deliberation.

AB - Purpose: Performance evaluation informs professional development and helps school personnel improve student learning. Although psychometric literature indicates that a rational, sound, and coherent standard-setting process adds to the credibility of an assessment, few studies have empirically examined the decision-making process. This article sheds light on the inner workings of setting cut scores for leadership proficiency from the deliberative perspectives of expert-panel participants, including principals, teachers, district supervisors, and researchers. Research Design: Qualitative methods are used to observe and document a standards-setting process as it takes place and to analyze the results. Findings: The findings indicate that setting cut scores for principal leadership proficiency is a cognitively demanding but achievable process for effective implementation of carefully designed procedures. The study also provides insight regarding the influence of external factors, such as backgrounds of panelists, consideration of school contexts, and concerns about consequence during the standard-setting deliberation.

KW - assessment

KW - cut score

KW - evaluation

KW - proficiency standard

KW - school leadership

KW - standard setting

UR - http://www.scopus.com/inward/record.url?scp=84872431523&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872431523&partnerID=8YFLogxK

U2 - 10.1177/0013161X12455330

DO - 10.1177/0013161X12455330

M3 - Article

AN - SCOPUS:84872431523

VL - 49

SP - 124

EP - 160

JO - Educational Administration Quarterly

JF - Educational Administration Quarterly

SN - 0013-161X

IS - 1

ER -