Understanding the art and science of implementation in the SAAF efficacy trial

Cady Berkel, Velma Mc Bride Murry, Kathryn J. Roulston, Gene H. Brody

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Purpose: The purpose of this paper is to demonstrate the importance of considering both fidelity and adaptation in assessing the implementation of evidence-based programs. Design/methodology/approach: The current study employs a multi-method strategy to understand two dimensions of implementation (fidelity and adaptation) in the Strong African American Families (SAAF) program. Data were video recordings of program delivery and pre-test and post-test interviews from the efficacy trial. Multilevel regression in Mplus was used to assess the impact of fidelity to the manual, coded by independent observers, on racial socialization outcomes. One activity on racial socialization, a core component of the program, was selected for an in-depth examination using conversation analysis (a qualitative method of analyzing talk in interactions). Findings: Results of the quantitative analyses demonstrated that fidelity of the selected activity was associated with increases in parent's use of racial socialization from pre-test to post-test, but only when participant attendance was included in the model. Results of the qualitative analyses demonstrated that facilitators were making adaptations to the session and that these adaptations appeared to be in line with cultural competence. Research limitations/implications: The development of quantitative fidelity measures can be problematic, with many decision points to consider. The current study contributes to the evidence base to develop a quantitative measure of adaptation for family-based parenting programs. Originality/value: Many researchers examining implementation of evidence-based programs consider fidelity and adaptation to be polar ends of a single spectrum. This paper provides evidence for the importance of examining each independently.

Original languageEnglish (US)
Pages (from-to)297-323
Number of pages27
JournalHealth Education
Volume113
Issue number4
DOIs
StatePublished - Jun 1 2013

Fingerprint

Socialization
Art
African Americans
science
socialization
Cultural Competency
Video Recording
Parenting
evidence
Parents
Research Personnel
Interviews
family program
conversation analysis
video recording
Research
qualitative method
American
parents
regression

Keywords

  • Adaptation
  • African Americans
  • Evidence base
  • Fidelity
  • Implementation
  • Mixed method
  • Parenting
  • Prevention
  • Programs
  • Qualitative
  • Quantitative methods
  • Rural

ASJC Scopus subject areas

  • Education
  • Public Health, Environmental and Occupational Health

Cite this

Understanding the art and science of implementation in the SAAF efficacy trial. / Berkel, Cady; Murry, Velma Mc Bride; Roulston, Kathryn J.; Brody, Gene H.

In: Health Education, Vol. 113, No. 4, 01.06.2013, p. 297-323.

Research output: Contribution to journalArticle

Berkel, Cady ; Murry, Velma Mc Bride ; Roulston, Kathryn J. ; Brody, Gene H. / Understanding the art and science of implementation in the SAAF efficacy trial. In: Health Education. 2013 ; Vol. 113, No. 4. pp. 297-323.
@article{cc50fd84e5a94529b0b050568e35d940,
title = "Understanding the art and science of implementation in the SAAF efficacy trial",
abstract = "Purpose: The purpose of this paper is to demonstrate the importance of considering both fidelity and adaptation in assessing the implementation of evidence-based programs. Design/methodology/approach: The current study employs a multi-method strategy to understand two dimensions of implementation (fidelity and adaptation) in the Strong African American Families (SAAF) program. Data were video recordings of program delivery and pre-test and post-test interviews from the efficacy trial. Multilevel regression in Mplus was used to assess the impact of fidelity to the manual, coded by independent observers, on racial socialization outcomes. One activity on racial socialization, a core component of the program, was selected for an in-depth examination using conversation analysis (a qualitative method of analyzing talk in interactions). Findings: Results of the quantitative analyses demonstrated that fidelity of the selected activity was associated with increases in parent's use of racial socialization from pre-test to post-test, but only when participant attendance was included in the model. Results of the qualitative analyses demonstrated that facilitators were making adaptations to the session and that these adaptations appeared to be in line with cultural competence. Research limitations/implications: The development of quantitative fidelity measures can be problematic, with many decision points to consider. The current study contributes to the evidence base to develop a quantitative measure of adaptation for family-based parenting programs. Originality/value: Many researchers examining implementation of evidence-based programs consider fidelity and adaptation to be polar ends of a single spectrum. This paper provides evidence for the importance of examining each independently.",
keywords = "Adaptation, African Americans, Evidence base, Fidelity, Implementation, Mixed method, Parenting, Prevention, Programs, Qualitative, Quantitative methods, Rural",
author = "Cady Berkel and Murry, {Velma Mc Bride} and Roulston, {Kathryn J.} and Brody, {Gene H.}",
year = "2013",
month = "6",
day = "1",
doi = "10.1108/09654281311329240",
language = "English (US)",
volume = "113",
pages = "297--323",
journal = "Health Education",
issn = "0965-4283",
publisher = "Emerald Group Publishing Ltd.",
number = "4",

}

TY - JOUR

T1 - Understanding the art and science of implementation in the SAAF efficacy trial

AU - Berkel, Cady

AU - Murry, Velma Mc Bride

AU - Roulston, Kathryn J.

AU - Brody, Gene H.

PY - 2013/6/1

Y1 - 2013/6/1

N2 - Purpose: The purpose of this paper is to demonstrate the importance of considering both fidelity and adaptation in assessing the implementation of evidence-based programs. Design/methodology/approach: The current study employs a multi-method strategy to understand two dimensions of implementation (fidelity and adaptation) in the Strong African American Families (SAAF) program. Data were video recordings of program delivery and pre-test and post-test interviews from the efficacy trial. Multilevel regression in Mplus was used to assess the impact of fidelity to the manual, coded by independent observers, on racial socialization outcomes. One activity on racial socialization, a core component of the program, was selected for an in-depth examination using conversation analysis (a qualitative method of analyzing talk in interactions). Findings: Results of the quantitative analyses demonstrated that fidelity of the selected activity was associated with increases in parent's use of racial socialization from pre-test to post-test, but only when participant attendance was included in the model. Results of the qualitative analyses demonstrated that facilitators were making adaptations to the session and that these adaptations appeared to be in line with cultural competence. Research limitations/implications: The development of quantitative fidelity measures can be problematic, with many decision points to consider. The current study contributes to the evidence base to develop a quantitative measure of adaptation for family-based parenting programs. Originality/value: Many researchers examining implementation of evidence-based programs consider fidelity and adaptation to be polar ends of a single spectrum. This paper provides evidence for the importance of examining each independently.

AB - Purpose: The purpose of this paper is to demonstrate the importance of considering both fidelity and adaptation in assessing the implementation of evidence-based programs. Design/methodology/approach: The current study employs a multi-method strategy to understand two dimensions of implementation (fidelity and adaptation) in the Strong African American Families (SAAF) program. Data were video recordings of program delivery and pre-test and post-test interviews from the efficacy trial. Multilevel regression in Mplus was used to assess the impact of fidelity to the manual, coded by independent observers, on racial socialization outcomes. One activity on racial socialization, a core component of the program, was selected for an in-depth examination using conversation analysis (a qualitative method of analyzing talk in interactions). Findings: Results of the quantitative analyses demonstrated that fidelity of the selected activity was associated with increases in parent's use of racial socialization from pre-test to post-test, but only when participant attendance was included in the model. Results of the qualitative analyses demonstrated that facilitators were making adaptations to the session and that these adaptations appeared to be in line with cultural competence. Research limitations/implications: The development of quantitative fidelity measures can be problematic, with many decision points to consider. The current study contributes to the evidence base to develop a quantitative measure of adaptation for family-based parenting programs. Originality/value: Many researchers examining implementation of evidence-based programs consider fidelity and adaptation to be polar ends of a single spectrum. This paper provides evidence for the importance of examining each independently.

KW - Adaptation

KW - African Americans

KW - Evidence base

KW - Fidelity

KW - Implementation

KW - Mixed method

KW - Parenting

KW - Prevention

KW - Programs

KW - Qualitative

KW - Quantitative methods

KW - Rural

UR - http://www.scopus.com/inward/record.url?scp=84879162572&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84879162572&partnerID=8YFLogxK

U2 - 10.1108/09654281311329240

DO - 10.1108/09654281311329240

M3 - Article

AN - SCOPUS:84879162572

VL - 113

SP - 297

EP - 323

JO - Health Education

JF - Health Education

SN - 0965-4283

IS - 4

ER -