An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation

Laura B. Sample McMeeking, Carole Basile, R. Brian Cobb

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.

Original languageEnglish (US)
Pages (from-to)508-516
Number of pages9
JournalEvaluation and Program Planning
Volume35
Issue number4
DOIs
StatePublished - Nov 2012
Externally publishedYes

Fingerprint

Organizational Models
organizational model
evaluation
Research
Evaluation
Theory-based evaluation
staffing
science
integrity
appeal
personnel
money
research project
responsibility
planning

Keywords

  • Logic models
  • Organizational model
  • Program evaluation
  • Theory based evaluation

ASJC Scopus subject areas

  • Business and International Management
  • Strategy and Management
  • Public Health, Environmental and Occupational Health
  • Social Psychology
  • Geography, Planning and Development

Cite this

An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation. / Sample McMeeking, Laura B.; Basile, Carole; Brian Cobb, R.

In: Evaluation and Program Planning, Vol. 35, No. 4, 11.2012, p. 508-516.

Research output: Contribution to journalArticle

@article{67220c2ac3b24cae8cb98b163fe947c3,
title = "An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation",
abstract = "Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.",
keywords = "Logic models, Organizational model, Program evaluation, Theory based evaluation",
author = "{Sample McMeeking}, {Laura B.} and Carole Basile and {Brian Cobb}, R.",
year = "2012",
month = "11",
doi = "10.1016/j.evalprogplan.2012.04.003",
language = "English (US)",
volume = "35",
pages = "508--516",
journal = "Evaluation and Program Planning",
issn = "0149-7189",
publisher = "Elsevier Limited",
number = "4",

}

TY - JOUR

T1 - An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation

AU - Sample McMeeking, Laura B.

AU - Basile, Carole

AU - Brian Cobb, R.

PY - 2012/11

Y1 - 2012/11

N2 - Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.

AB - Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.

KW - Logic models

KW - Organizational model

KW - Program evaluation

KW - Theory based evaluation

UR - http://www.scopus.com/inward/record.url?scp=84860861181&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860861181&partnerID=8YFLogxK

U2 - 10.1016/j.evalprogplan.2012.04.003

DO - 10.1016/j.evalprogplan.2012.04.003

M3 - Article

VL - 35

SP - 508

EP - 516

JO - Evaluation and Program Planning

JF - Evaluation and Program Planning

SN - 0149-7189

IS - 4

ER -