A review of empirical research related to the use of small quantitative samples in clinical outcome scale development

Carrie R. Houts, Michael Edwards, R. J. Wirth, Linda S. Deal

Research output: Contribution to journalReview article

5 Citations (Scopus)

Abstract

Introduction: There has been a notable increase in the advocacy of using small-sample designs as an initial quantitative assessment of item and scale performance during the scale development process. This is particularly true in the development of clinical outcome assessments (COAs), where Rasch analysis has been advanced as an appropriate statistical tool for evaluating the developing COAs using a small sample. Methods: We review the benefits such methods are purported to offer from both a practical and statistical standpoint and detail several problematic areas, including both practical and statistical theory concerns, with respect to the use of quantitative methods, including Rasch-consistent methods, with small samples. Conclusions: The feasibility of obtaining accurate information and the potential negative impacts of misusing large-sample statistical methods with small samples during COA development are discussed.

Original languageEnglish (US)
Pages (from-to)2685-2691
Number of pages7
JournalQuality of Life Research
Volume25
Issue number11
DOIs
StatePublished - Nov 1 2016
Externally publishedYes

Fingerprint

Empirical Research
Outcome Assessment (Health Care)

Keywords

  • Clinical outcome assessment
  • Item response theory
  • Rasch measurement theory
  • Small-sample analyses

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

A review of empirical research related to the use of small quantitative samples in clinical outcome scale development. / Houts, Carrie R.; Edwards, Michael; Wirth, R. J.; Deal, Linda S.

In: Quality of Life Research, Vol. 25, No. 11, 01.11.2016, p. 2685-2691.

Research output: Contribution to journalReview article

@article{111c5e7f1340426db2bbd974042d4bc9,
title = "A review of empirical research related to the use of small quantitative samples in clinical outcome scale development",
abstract = "Introduction: There has been a notable increase in the advocacy of using small-sample designs as an initial quantitative assessment of item and scale performance during the scale development process. This is particularly true in the development of clinical outcome assessments (COAs), where Rasch analysis has been advanced as an appropriate statistical tool for evaluating the developing COAs using a small sample. Methods: We review the benefits such methods are purported to offer from both a practical and statistical standpoint and detail several problematic areas, including both practical and statistical theory concerns, with respect to the use of quantitative methods, including Rasch-consistent methods, with small samples. Conclusions: The feasibility of obtaining accurate information and the potential negative impacts of misusing large-sample statistical methods with small samples during COA development are discussed.",
keywords = "Clinical outcome assessment, Item response theory, Rasch measurement theory, Small-sample analyses",
author = "Houts, {Carrie R.} and Michael Edwards and Wirth, {R. J.} and Deal, {Linda S.}",
year = "2016",
month = "11",
day = "1",
doi = "10.1007/s11136-016-1364-9",
language = "English (US)",
volume = "25",
pages = "2685--2691",
journal = "Quality of Life Research",
issn = "0962-9343",
publisher = "Springer Netherlands",
number = "11",

}

TY - JOUR

T1 - A review of empirical research related to the use of small quantitative samples in clinical outcome scale development

AU - Houts, Carrie R.

AU - Edwards, Michael

AU - Wirth, R. J.

AU - Deal, Linda S.

PY - 2016/11/1

Y1 - 2016/11/1

N2 - Introduction: There has been a notable increase in the advocacy of using small-sample designs as an initial quantitative assessment of item and scale performance during the scale development process. This is particularly true in the development of clinical outcome assessments (COAs), where Rasch analysis has been advanced as an appropriate statistical tool for evaluating the developing COAs using a small sample. Methods: We review the benefits such methods are purported to offer from both a practical and statistical standpoint and detail several problematic areas, including both practical and statistical theory concerns, with respect to the use of quantitative methods, including Rasch-consistent methods, with small samples. Conclusions: The feasibility of obtaining accurate information and the potential negative impacts of misusing large-sample statistical methods with small samples during COA development are discussed.

AB - Introduction: There has been a notable increase in the advocacy of using small-sample designs as an initial quantitative assessment of item and scale performance during the scale development process. This is particularly true in the development of clinical outcome assessments (COAs), where Rasch analysis has been advanced as an appropriate statistical tool for evaluating the developing COAs using a small sample. Methods: We review the benefits such methods are purported to offer from both a practical and statistical standpoint and detail several problematic areas, including both practical and statistical theory concerns, with respect to the use of quantitative methods, including Rasch-consistent methods, with small samples. Conclusions: The feasibility of obtaining accurate information and the potential negative impacts of misusing large-sample statistical methods with small samples during COA development are discussed.

KW - Clinical outcome assessment

KW - Item response theory

KW - Rasch measurement theory

KW - Small-sample analyses

UR - http://www.scopus.com/inward/record.url?scp=84978152812&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978152812&partnerID=8YFLogxK

U2 - 10.1007/s11136-016-1364-9

DO - 10.1007/s11136-016-1364-9

M3 - Review article

C2 - 27412522

AN - SCOPUS:84978152812

VL - 25

SP - 2685

EP - 2691

JO - Quality of Life Research

JF - Quality of Life Research

SN - 0962-9343

IS - 11

ER -