Invalidity of True Experiments: Self–Report Pretest Biases

Leona S. Aiken, Stephen West

Research output: Contribution to journalArticle

51 Citations (Scopus)

Abstract

The validity of true experiments is threatened by a class of self-report biases that affect all respondents at pretest but which are diminished by treatment, yielding noncomparable treated and control subjects at posttest. These biases include inaccurate self-evaluations due to (a) lack of understanding of dimensions of self-rating, (b) unconscious needs to rationalize sources of severe emotional distress, (c) distressed or altered states (e.g., drug states) that lower the ability to report accurately, and (d) deliberate impression management in service of accessing desired treatment. They are detectable via external criteria, special conditions of measurement, and retrospective pretests, and may be lessened in several ways. Unchecked, they produce treatment by self-report bias interactions that undermine the validity of even true experiments.

Original languageEnglish (US)
Pages (from-to)374-390
Number of pages17
JournalEvaluation Review
Volume14
Issue number4
DOIs
StatePublished - 1990

Fingerprint

invalidity
experiment
trend
rating
drug
lack
ability
interaction
evaluation
management
Self-report
Experiment

ASJC Scopus subject areas

  • Social Sciences(all)
  • Arts and Humanities (miscellaneous)

Cite this

Invalidity of True Experiments : Self–Report Pretest Biases. / Aiken, Leona S.; West, Stephen.

In: Evaluation Review, Vol. 14, No. 4, 1990, p. 374-390.

Research output: Contribution to journalArticle

@article{7d722c4c7c3e4970915ad7ca685db946,
title = "Invalidity of True Experiments: Self–Report Pretest Biases",
abstract = "The validity of true experiments is threatened by a class of self-report biases that affect all respondents at pretest but which are diminished by treatment, yielding noncomparable treated and control subjects at posttest. These biases include inaccurate self-evaluations due to (a) lack of understanding of dimensions of self-rating, (b) unconscious needs to rationalize sources of severe emotional distress, (c) distressed or altered states (e.g., drug states) that lower the ability to report accurately, and (d) deliberate impression management in service of accessing desired treatment. They are detectable via external criteria, special conditions of measurement, and retrospective pretests, and may be lessened in several ways. Unchecked, they produce treatment by self-report bias interactions that undermine the validity of even true experiments.",
author = "Aiken, {Leona S.} and Stephen West",
year = "1990",
doi = "10.1177/0193841X9001400403",
language = "English (US)",
volume = "14",
pages = "374--390",
journal = "Evaluation Review",
issn = "0193-841X",
publisher = "SAGE Publications Inc.",
number = "4",

}

TY - JOUR

T1 - Invalidity of True Experiments

T2 - Self–Report Pretest Biases

AU - Aiken, Leona S.

AU - West, Stephen

PY - 1990

Y1 - 1990

N2 - The validity of true experiments is threatened by a class of self-report biases that affect all respondents at pretest but which are diminished by treatment, yielding noncomparable treated and control subjects at posttest. These biases include inaccurate self-evaluations due to (a) lack of understanding of dimensions of self-rating, (b) unconscious needs to rationalize sources of severe emotional distress, (c) distressed or altered states (e.g., drug states) that lower the ability to report accurately, and (d) deliberate impression management in service of accessing desired treatment. They are detectable via external criteria, special conditions of measurement, and retrospective pretests, and may be lessened in several ways. Unchecked, they produce treatment by self-report bias interactions that undermine the validity of even true experiments.

AB - The validity of true experiments is threatened by a class of self-report biases that affect all respondents at pretest but which are diminished by treatment, yielding noncomparable treated and control subjects at posttest. These biases include inaccurate self-evaluations due to (a) lack of understanding of dimensions of self-rating, (b) unconscious needs to rationalize sources of severe emotional distress, (c) distressed or altered states (e.g., drug states) that lower the ability to report accurately, and (d) deliberate impression management in service of accessing desired treatment. They are detectable via external criteria, special conditions of measurement, and retrospective pretests, and may be lessened in several ways. Unchecked, they produce treatment by self-report bias interactions that undermine the validity of even true experiments.

UR - http://www.scopus.com/inward/record.url?scp=84973839494&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84973839494&partnerID=8YFLogxK

U2 - 10.1177/0193841X9001400403

DO - 10.1177/0193841X9001400403

M3 - Article

AN - SCOPUS:84973839494

VL - 14

SP - 374

EP - 390

JO - Evaluation Review

JF - Evaluation Review

SN - 0193-841X

IS - 4

ER -