Cross-informant agreement of children's social-emotional skills: An investigation of ratings by teachers, parents, and students from a nationally representative sample

Frank M. Gresham, Stephen Elliott, Sarah Metallo, Shelby Byrd, Elizabeth Wilson, Kaitlan Cassidy

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

This study examines the agreement across informant pairs of teachers, parents, and students regarding the students’ social-emotional learning (SEL) competencies. Two student subsamples representative of the social skills improvement system (SSIS) SEL edition rating forms national standardization sample were examined: first, 168 students (3rd to 12th grades) with ratings by three informants (a teacher, a parent, and the student him/herself) and a second group of 164 students who had ratings by two raters in a similar role—two parents or two teachers. To assess interrater agreements, two methods were employed: calculation of q correlations among pairs of raters and effect size indices to capture the extant rater pairs differed in their assessments of social-emotional skills. The empirical results indicated that pairs of different types of informants exhibited greater than chance levels of agreement as indexed by significant interrater correlations; teacher–parent informants showed higher correlations than teacher–student or parent–student pairs across all SEL competency domains assessed, and pairs of similar informants exhibited significantly higher correlations than pairs of dissimilar informants. Study limitations are identified and future research needs outlined.

Original languageEnglish (US)
Pages (from-to)208-223
Number of pages16
JournalPsychology in the Schools
Volume55
Issue number2
DOIs
StatePublished - Feb 1 2018

Fingerprint

parents
Parents
rating
Students
teacher
student
Learning
learning
social system
edition
Social Skills
school grade
Group

Keywords

  • cross-informant agreement
  • social emotional learning
  • SSIS SEL edition

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology

Cite this

Cross-informant agreement of children's social-emotional skills : An investigation of ratings by teachers, parents, and students from a nationally representative sample. / Gresham, Frank M.; Elliott, Stephen; Metallo, Sarah; Byrd, Shelby; Wilson, Elizabeth; Cassidy, Kaitlan.

In: Psychology in the Schools, Vol. 55, No. 2, 01.02.2018, p. 208-223.

Research output: Contribution to journalArticle

@article{389001603c854bd39ee4275128b7d738,
title = "Cross-informant agreement of children's social-emotional skills: An investigation of ratings by teachers, parents, and students from a nationally representative sample",
abstract = "This study examines the agreement across informant pairs of teachers, parents, and students regarding the students’ social-emotional learning (SEL) competencies. Two student subsamples representative of the social skills improvement system (SSIS) SEL edition rating forms national standardization sample were examined: first, 168 students (3rd to 12th grades) with ratings by three informants (a teacher, a parent, and the student him/herself) and a second group of 164 students who had ratings by two raters in a similar role—two parents or two teachers. To assess interrater agreements, two methods were employed: calculation of q correlations among pairs of raters and effect size indices to capture the extant rater pairs differed in their assessments of social-emotional skills. The empirical results indicated that pairs of different types of informants exhibited greater than chance levels of agreement as indexed by significant interrater correlations; teacher–parent informants showed higher correlations than teacher–student or parent–student pairs across all SEL competency domains assessed, and pairs of similar informants exhibited significantly higher correlations than pairs of dissimilar informants. Study limitations are identified and future research needs outlined.",
keywords = "cross-informant agreement, social emotional learning, SSIS SEL edition",
author = "Gresham, {Frank M.} and Stephen Elliott and Sarah Metallo and Shelby Byrd and Elizabeth Wilson and Kaitlan Cassidy",
year = "2018",
month = "2",
day = "1",
doi = "10.1002/pits.22101",
language = "English (US)",
volume = "55",
pages = "208--223",
journal = "Psychology in the Schools",
issn = "0033-3085",
publisher = "Wiley-Liss Inc.",
number = "2",

}

TY - JOUR

T1 - Cross-informant agreement of children's social-emotional skills

T2 - An investigation of ratings by teachers, parents, and students from a nationally representative sample

AU - Gresham, Frank M.

AU - Elliott, Stephen

AU - Metallo, Sarah

AU - Byrd, Shelby

AU - Wilson, Elizabeth

AU - Cassidy, Kaitlan

PY - 2018/2/1

Y1 - 2018/2/1

N2 - This study examines the agreement across informant pairs of teachers, parents, and students regarding the students’ social-emotional learning (SEL) competencies. Two student subsamples representative of the social skills improvement system (SSIS) SEL edition rating forms national standardization sample were examined: first, 168 students (3rd to 12th grades) with ratings by three informants (a teacher, a parent, and the student him/herself) and a second group of 164 students who had ratings by two raters in a similar role—two parents or two teachers. To assess interrater agreements, two methods were employed: calculation of q correlations among pairs of raters and effect size indices to capture the extant rater pairs differed in their assessments of social-emotional skills. The empirical results indicated that pairs of different types of informants exhibited greater than chance levels of agreement as indexed by significant interrater correlations; teacher–parent informants showed higher correlations than teacher–student or parent–student pairs across all SEL competency domains assessed, and pairs of similar informants exhibited significantly higher correlations than pairs of dissimilar informants. Study limitations are identified and future research needs outlined.

AB - This study examines the agreement across informant pairs of teachers, parents, and students regarding the students’ social-emotional learning (SEL) competencies. Two student subsamples representative of the social skills improvement system (SSIS) SEL edition rating forms national standardization sample were examined: first, 168 students (3rd to 12th grades) with ratings by three informants (a teacher, a parent, and the student him/herself) and a second group of 164 students who had ratings by two raters in a similar role—two parents or two teachers. To assess interrater agreements, two methods were employed: calculation of q correlations among pairs of raters and effect size indices to capture the extant rater pairs differed in their assessments of social-emotional skills. The empirical results indicated that pairs of different types of informants exhibited greater than chance levels of agreement as indexed by significant interrater correlations; teacher–parent informants showed higher correlations than teacher–student or parent–student pairs across all SEL competency domains assessed, and pairs of similar informants exhibited significantly higher correlations than pairs of dissimilar informants. Study limitations are identified and future research needs outlined.

KW - cross-informant agreement

KW - social emotional learning

KW - SSIS SEL edition

UR - http://www.scopus.com/inward/record.url?scp=85039553722&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039553722&partnerID=8YFLogxK

U2 - 10.1002/pits.22101

DO - 10.1002/pits.22101

M3 - Article

AN - SCOPUS:85039553722

VL - 55

SP - 208

EP - 223

JO - Psychology in the Schools

JF - Psychology in the Schools

SN - 0033-3085

IS - 2

ER -