Sample Selection in Randomized Experiments: A New Method Using Propensity Score Stratified Sampling

Elizabeth Tipton, Larry Hedges, Michael Vaden-Kiernan, Geoffrey Borman, Kate Sullivan, Sarah Caverly

Research output: Contribution to journalArticlepeer-review

39 Scopus citations

Abstract

Randomized experiments are often seen as the "gold standard" for causal research. Despite the fact that experiments use random assignment to treatment conditions, units are seldom selected into the experiment using probability sampling. Very little research on experimental design has focused on how to make generalizations to well-defined populations or on how units should be selected into an experiment to facilitate generalization. This article addresses the problem of sample selection in experiments by providing a method for selecting the sample so that the population and sample are similar in composition. The method begins by requiring that the inference population and eligibility criteria for the study are well defined before study recruitment begins. When the inference population and population of eligible units differs, the article provides a method for sample recruitment based on stratified selection on a propensity score. The article situates the problem within the example of how to select districts for two scale-up experiments currently in recruitment.

Original languageEnglish (US)
Pages (from-to)114-135
Number of pages22
JournalJournal of Research on Educational Effectiveness
Volume7
Issue number1
DOIs
StatePublished - Jan 2014
Externally publishedYes

Keywords

  • Experimental design
  • recruitment
  • sampling
  • scale-up
  • stratified

ASJC Scopus subject areas

  • Education

Fingerprint

Dive into the research topics of 'Sample Selection in Randomized Experiments: A New Method Using Propensity Score Stratified Sampling'. Together they form a unique fingerprint.

Cite this