A monte carlo simulation study of the reliability of intraindividual variability

Ryne Estabrook, Kevin Grimm, Ryan P. Bowles

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

Recent research has seen intraindividual variability become a useful technique to incorporate trial-to-trial variability into many types of psychological studies. Intraindividual variability, as measured by individual standard deviations (ISDs), has shown unique prediction to several types of positive and negative outcomes (Ram, Rabbit, Stollery, & Nesselroade, 2005). One unanswered question regarding measuring intraindividual variability is its reliability and the conditions under which optimal reliability is achieved. Monte Carlo simulation studies were conducted to determine the reliability of the ISD as compared with the intraindividual mean. The results indicate that ISDs generally have poor reliability and are sensitive to insufficient measurement occasions, poor test reliability, and unfavorable amounts and distributions of variability in the population. Secondary analysis of psychological data shows that use of individual standard deviations in unfavorable conditions leads to a marked reduction in statistical power, although careful adherence to underlying statistical assumptions allows their use as a basic research tool.

Original languageEnglish (US)
Pages (from-to)560-576
Number of pages17
JournalPsychology and Aging
Volume27
Issue number3
DOIs
StatePublished - 2012
Externally publishedYes

Fingerprint

Psychology
Research
Rabbits
Population

Keywords

  • Individual differences
  • Intraindividual variability
  • ISD
  • Reliability

ASJC Scopus subject areas

  • Aging
  • Geriatrics and Gerontology
  • Social Psychology

Cite this

A monte carlo simulation study of the reliability of intraindividual variability. / Estabrook, Ryne; Grimm, Kevin; Bowles, Ryan P.

In: Psychology and Aging, Vol. 27, No. 3, 2012, p. 560-576.

Research output: Contribution to journalArticle

Estabrook, Ryne ; Grimm, Kevin ; Bowles, Ryan P. / A monte carlo simulation study of the reliability of intraindividual variability. In: Psychology and Aging. 2012 ; Vol. 27, No. 3. pp. 560-576.
@article{2326e64210344856bbff8a3c58dc5b17,
title = "A monte carlo simulation study of the reliability of intraindividual variability",
abstract = "Recent research has seen intraindividual variability become a useful technique to incorporate trial-to-trial variability into many types of psychological studies. Intraindividual variability, as measured by individual standard deviations (ISDs), has shown unique prediction to several types of positive and negative outcomes (Ram, Rabbit, Stollery, & Nesselroade, 2005). One unanswered question regarding measuring intraindividual variability is its reliability and the conditions under which optimal reliability is achieved. Monte Carlo simulation studies were conducted to determine the reliability of the ISD as compared with the intraindividual mean. The results indicate that ISDs generally have poor reliability and are sensitive to insufficient measurement occasions, poor test reliability, and unfavorable amounts and distributions of variability in the population. Secondary analysis of psychological data shows that use of individual standard deviations in unfavorable conditions leads to a marked reduction in statistical power, although careful adherence to underlying statistical assumptions allows their use as a basic research tool.",
keywords = "Individual differences, Intraindividual variability, ISD, Reliability",
author = "Ryne Estabrook and Kevin Grimm and Bowles, {Ryan P.}",
year = "2012",
doi = "10.1037/a0026669",
language = "English (US)",
volume = "27",
pages = "560--576",
journal = "Psychology and Aging",
issn = "0882-7974",
publisher = "American Psychological Association Inc.",
number = "3",

}

TY - JOUR

T1 - A monte carlo simulation study of the reliability of intraindividual variability

AU - Estabrook, Ryne

AU - Grimm, Kevin

AU - Bowles, Ryan P.

PY - 2012

Y1 - 2012

N2 - Recent research has seen intraindividual variability become a useful technique to incorporate trial-to-trial variability into many types of psychological studies. Intraindividual variability, as measured by individual standard deviations (ISDs), has shown unique prediction to several types of positive and negative outcomes (Ram, Rabbit, Stollery, & Nesselroade, 2005). One unanswered question regarding measuring intraindividual variability is its reliability and the conditions under which optimal reliability is achieved. Monte Carlo simulation studies were conducted to determine the reliability of the ISD as compared with the intraindividual mean. The results indicate that ISDs generally have poor reliability and are sensitive to insufficient measurement occasions, poor test reliability, and unfavorable amounts and distributions of variability in the population. Secondary analysis of psychological data shows that use of individual standard deviations in unfavorable conditions leads to a marked reduction in statistical power, although careful adherence to underlying statistical assumptions allows their use as a basic research tool.

AB - Recent research has seen intraindividual variability become a useful technique to incorporate trial-to-trial variability into many types of psychological studies. Intraindividual variability, as measured by individual standard deviations (ISDs), has shown unique prediction to several types of positive and negative outcomes (Ram, Rabbit, Stollery, & Nesselroade, 2005). One unanswered question regarding measuring intraindividual variability is its reliability and the conditions under which optimal reliability is achieved. Monte Carlo simulation studies were conducted to determine the reliability of the ISD as compared with the intraindividual mean. The results indicate that ISDs generally have poor reliability and are sensitive to insufficient measurement occasions, poor test reliability, and unfavorable amounts and distributions of variability in the population. Secondary analysis of psychological data shows that use of individual standard deviations in unfavorable conditions leads to a marked reduction in statistical power, although careful adherence to underlying statistical assumptions allows their use as a basic research tool.

KW - Individual differences

KW - Intraindividual variability

KW - ISD

KW - Reliability

UR - http://www.scopus.com/inward/record.url?scp=84868258212&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84868258212&partnerID=8YFLogxK

U2 - 10.1037/a0026669

DO - 10.1037/a0026669

M3 - Article

VL - 27

SP - 560

EP - 576

JO - Psychology and Aging

JF - Psychology and Aging

SN - 0882-7974

IS - 3

ER -