Random without replacement is not random: Caveat emptor

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

The vast majority of psychology labs rely on prepackaged software applications (e.g., E-Prime) for the programming of experiments. These programs are often used for stimulus selection, and many use a selection method referred to as random without replacement. We demonstrate how random without replacement deviates from random selection, and we detail selection biases that result. We also demonstrate, in a simple experiment, how these selection biases, if left unchecked, can influence behavior. Recommendations for reducing the impact of these biases on performance when random without replacement is used are discussed.

Original languageEnglish (US)
Pages (from-to)961-968
Number of pages8
JournalBehavior Research Methods
Volume40
Issue number4
DOIs
StatePublished - Nov 1 2008
Externally publishedYes

Fingerprint

Selection Bias
Software
Psychology
Replacement
Experiment

ASJC Scopus subject areas

  • Psychology(all)
  • Psychology (miscellaneous)
  • Experimental and Cognitive Psychology

Cite this

Random without replacement is not random : Caveat emptor. / Blais, Christopher.

In: Behavior Research Methods, Vol. 40, No. 4, 01.11.2008, p. 961-968.

Research output: Contribution to journalArticle

@article{91fc430e74074d92acc2b112a8b7b5c1,
title = "Random without replacement is not random: Caveat emptor",
abstract = "The vast majority of psychology labs rely on prepackaged software applications (e.g., E-Prime) for the programming of experiments. These programs are often used for stimulus selection, and many use a selection method referred to as random without replacement. We demonstrate how random without replacement deviates from random selection, and we detail selection biases that result. We also demonstrate, in a simple experiment, how these selection biases, if left unchecked, can influence behavior. Recommendations for reducing the impact of these biases on performance when random without replacement is used are discussed.",
author = "Christopher Blais",
year = "2008",
month = "11",
day = "1",
doi = "10.3758/BRM.40.4.961",
language = "English (US)",
volume = "40",
pages = "961--968",
journal = "Behavior Research Methods, Instruments, and Computers",
issn = "1554-351X",
publisher = "Springer New York",
number = "4",

}

TY - JOUR

T1 - Random without replacement is not random

T2 - Caveat emptor

AU - Blais, Christopher

PY - 2008/11/1

Y1 - 2008/11/1

N2 - The vast majority of psychology labs rely on prepackaged software applications (e.g., E-Prime) for the programming of experiments. These programs are often used for stimulus selection, and many use a selection method referred to as random without replacement. We demonstrate how random without replacement deviates from random selection, and we detail selection biases that result. We also demonstrate, in a simple experiment, how these selection biases, if left unchecked, can influence behavior. Recommendations for reducing the impact of these biases on performance when random without replacement is used are discussed.

AB - The vast majority of psychology labs rely on prepackaged software applications (e.g., E-Prime) for the programming of experiments. These programs are often used for stimulus selection, and many use a selection method referred to as random without replacement. We demonstrate how random without replacement deviates from random selection, and we detail selection biases that result. We also demonstrate, in a simple experiment, how these selection biases, if left unchecked, can influence behavior. Recommendations for reducing the impact of these biases on performance when random without replacement is used are discussed.

UR - http://www.scopus.com/inward/record.url?scp=58149395252&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=58149395252&partnerID=8YFLogxK

U2 - 10.3758/BRM.40.4.961

DO - 10.3758/BRM.40.4.961

M3 - Article

C2 - 19001387

AN - SCOPUS:58149395252

VL - 40

SP - 961

EP - 968

JO - Behavior Research Methods, Instruments, and Computers

JF - Behavior Research Methods, Instruments, and Computers

SN - 1554-351X

IS - 4

ER -