Cross-Informant Agreement for Ratings for Social Skill and Problem Behavior Ratings

An Investigation of the Social Skills Improvement System-Rating Scales

Frank M. Gresham, Stephen Elliott, Clayton R. Cook, Michael J. Vance, Ryan Kettler

Research output: Contribution to journalArticle

102 Citations (Scopus)

Abstract

One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System-Rating Scales (SSIS-RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS-RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS-RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father-mother, teacher-teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait-multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.

Original languageEnglish (US)
Pages (from-to)157-166
Number of pages10
JournalPsychological Assessment
Volume22
Issue number1
DOIs
StatePublished - Mar 2010
Externally publishedYes

Fingerprint

Social Problems
Students
Fathers
Caregivers
Parents
Mothers
Research
Social Skills
Problem Behavior

Keywords

  • Convergent validity
  • Discriminant validity
  • Social skills

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Clinical Psychology

Cite this

Cross-Informant Agreement for Ratings for Social Skill and Problem Behavior Ratings : An Investigation of the Social Skills Improvement System-Rating Scales. / Gresham, Frank M.; Elliott, Stephen; Cook, Clayton R.; Vance, Michael J.; Kettler, Ryan.

In: Psychological Assessment, Vol. 22, No. 1, 03.2010, p. 157-166.

Research output: Contribution to journalArticle

@article{bdc7139036a54b1ab870da5821d22a7c,
title = "Cross-Informant Agreement for Ratings for Social Skill and Problem Behavior Ratings: An Investigation of the Social Skills Improvement System-Rating Scales",
abstract = "One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System-Rating Scales (SSIS-RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS-RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS-RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father-mother, teacher-teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait-multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.",
keywords = "Convergent validity, Discriminant validity, Social skills",
author = "Gresham, {Frank M.} and Stephen Elliott and Cook, {Clayton R.} and Vance, {Michael J.} and Ryan Kettler",
year = "2010",
month = "3",
doi = "10.1037/a0018124",
language = "English (US)",
volume = "22",
pages = "157--166",
journal = "Psychological Assessment",
issn = "1040-3590",
publisher = "American Psychological Association Inc.",
number = "1",

}

TY - JOUR

T1 - Cross-Informant Agreement for Ratings for Social Skill and Problem Behavior Ratings

T2 - An Investigation of the Social Skills Improvement System-Rating Scales

AU - Gresham, Frank M.

AU - Elliott, Stephen

AU - Cook, Clayton R.

AU - Vance, Michael J.

AU - Kettler, Ryan

PY - 2010/3

Y1 - 2010/3

N2 - One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System-Rating Scales (SSIS-RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS-RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS-RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father-mother, teacher-teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait-multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.

AB - One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System-Rating Scales (SSIS-RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS-RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS-RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father-mother, teacher-teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait-multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.

KW - Convergent validity

KW - Discriminant validity

KW - Social skills

UR - http://www.scopus.com/inward/record.url?scp=77950215240&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77950215240&partnerID=8YFLogxK

U2 - 10.1037/a0018124

DO - 10.1037/a0018124

M3 - Article

VL - 22

SP - 157

EP - 166

JO - Psychological Assessment

JF - Psychological Assessment

SN - 1040-3590

IS - 1

ER -