The (Lack of) Replication of Self-Reported Mindfulness as a Mechanism of Change in Mindfulness-Based Relapse Prevention for Substance Use Disorders

Yu Yu Hsiao, Davood Tofighi, Eric S. Kruger, M. Lee Van Horn, David Mackinnon, Katie Witkiewitz

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The development and evaluation of mindfulness-based interventions for a variety of psychological and medical disorders have grown exponentially over the past 20 years. Yet, calls for increasing the rigor of mindfulness research and recognition of the difficulties of conducting research on the topic of mindfulness have also increased. One of the major difficulties is the measurement of mindfulness, with varying definitions across studies and ambiguity with respect to the meaning of mindfulness. There is also concern about the reproducibility of findings given few attempts at replication. The current secondary analysis addressed the issue of reproducibility and robustness of the construct of self-reported mindfulness across two separate randomized clinical trials of mindfulness-based relapse prevention (MBRP), as an aftercare treatment for substance use disorder. Specifically, we tested the robustness of our previously published findings, which identified a latent construct of mindfulness as a significant mediator of the effect of MBRP on reducing craving following treatment. First, we attempted to replicate the findings in a separate randomized clinical trial of MBRP. Second, we conducted sensitivity analyses to test the assumption of the no-omitted confounder bias in a mediation model. The effect of MBRP on self-reported mindfulness and overall mediation effect failed to replicate in a new sample. The effect of self-reported mindfulness in predicting craving following treatment did replicate and was robust to the no-omitted confounder bias. The results of this work shine a light on the difficulties in the measurement of mindfulness and the importance of examining the robustness of findings.

Original languageEnglish (US)
Pages (from-to)724-736
Number of pages13
JournalMindfulness
Volume10
Issue number4
DOIs
StatePublished - Apr 15 2019

Fingerprint

Mindfulness
relapse
Secondary Prevention
Substance-Related Disorders
lack
mediation
after-care
secondary analysis
trend
evaluation
Randomized Controlled Trials
Aftercare
Research
Reproducibility of Results

Keywords

  • Craving
  • Mediation
  • Mindfulness
  • Mindfulness-based relapse prevention
  • Replicability
  • Reproducibility
  • Sensitivity analyses
  • Substance use disorder

ASJC Scopus subject areas

  • Social Psychology
  • Health(social science)
  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Applied Psychology

Cite this

The (Lack of) Replication of Self-Reported Mindfulness as a Mechanism of Change in Mindfulness-Based Relapse Prevention for Substance Use Disorders. / Hsiao, Yu Yu; Tofighi, Davood; Kruger, Eric S.; Lee Van Horn, M.; Mackinnon, David; Witkiewitz, Katie.

In: Mindfulness, Vol. 10, No. 4, 15.04.2019, p. 724-736.

Research output: Contribution to journalArticle

Hsiao, Yu Yu ; Tofighi, Davood ; Kruger, Eric S. ; Lee Van Horn, M. ; Mackinnon, David ; Witkiewitz, Katie. / The (Lack of) Replication of Self-Reported Mindfulness as a Mechanism of Change in Mindfulness-Based Relapse Prevention for Substance Use Disorders. In: Mindfulness. 2019 ; Vol. 10, No. 4. pp. 724-736.
@article{9acf1216be5d4fd8926dbe823b23558d,
title = "The (Lack of) Replication of Self-Reported Mindfulness as a Mechanism of Change in Mindfulness-Based Relapse Prevention for Substance Use Disorders",
abstract = "The development and evaluation of mindfulness-based interventions for a variety of psychological and medical disorders have grown exponentially over the past 20 years. Yet, calls for increasing the rigor of mindfulness research and recognition of the difficulties of conducting research on the topic of mindfulness have also increased. One of the major difficulties is the measurement of mindfulness, with varying definitions across studies and ambiguity with respect to the meaning of mindfulness. There is also concern about the reproducibility of findings given few attempts at replication. The current secondary analysis addressed the issue of reproducibility and robustness of the construct of self-reported mindfulness across two separate randomized clinical trials of mindfulness-based relapse prevention (MBRP), as an aftercare treatment for substance use disorder. Specifically, we tested the robustness of our previously published findings, which identified a latent construct of mindfulness as a significant mediator of the effect of MBRP on reducing craving following treatment. First, we attempted to replicate the findings in a separate randomized clinical trial of MBRP. Second, we conducted sensitivity analyses to test the assumption of the no-omitted confounder bias in a mediation model. The effect of MBRP on self-reported mindfulness and overall mediation effect failed to replicate in a new sample. The effect of self-reported mindfulness in predicting craving following treatment did replicate and was robust to the no-omitted confounder bias. The results of this work shine a light on the difficulties in the measurement of mindfulness and the importance of examining the robustness of findings.",
keywords = "Craving, Mediation, Mindfulness, Mindfulness-based relapse prevention, Replicability, Reproducibility, Sensitivity analyses, Substance use disorder",
author = "Hsiao, {Yu Yu} and Davood Tofighi and Kruger, {Eric S.} and {Lee Van Horn}, M. and David Mackinnon and Katie Witkiewitz",
year = "2019",
month = "4",
day = "15",
doi = "10.1007/s12671-018-1023-z",
language = "English (US)",
volume = "10",
pages = "724--736",
journal = "Mindfulness",
issn = "1868-8527",
publisher = "Springer Verlag",
number = "4",

}

TY - JOUR

T1 - The (Lack of) Replication of Self-Reported Mindfulness as a Mechanism of Change in Mindfulness-Based Relapse Prevention for Substance Use Disorders

AU - Hsiao, Yu Yu

AU - Tofighi, Davood

AU - Kruger, Eric S.

AU - Lee Van Horn, M.

AU - Mackinnon, David

AU - Witkiewitz, Katie

PY - 2019/4/15

Y1 - 2019/4/15

N2 - The development and evaluation of mindfulness-based interventions for a variety of psychological and medical disorders have grown exponentially over the past 20 years. Yet, calls for increasing the rigor of mindfulness research and recognition of the difficulties of conducting research on the topic of mindfulness have also increased. One of the major difficulties is the measurement of mindfulness, with varying definitions across studies and ambiguity with respect to the meaning of mindfulness. There is also concern about the reproducibility of findings given few attempts at replication. The current secondary analysis addressed the issue of reproducibility and robustness of the construct of self-reported mindfulness across two separate randomized clinical trials of mindfulness-based relapse prevention (MBRP), as an aftercare treatment for substance use disorder. Specifically, we tested the robustness of our previously published findings, which identified a latent construct of mindfulness as a significant mediator of the effect of MBRP on reducing craving following treatment. First, we attempted to replicate the findings in a separate randomized clinical trial of MBRP. Second, we conducted sensitivity analyses to test the assumption of the no-omitted confounder bias in a mediation model. The effect of MBRP on self-reported mindfulness and overall mediation effect failed to replicate in a new sample. The effect of self-reported mindfulness in predicting craving following treatment did replicate and was robust to the no-omitted confounder bias. The results of this work shine a light on the difficulties in the measurement of mindfulness and the importance of examining the robustness of findings.

AB - The development and evaluation of mindfulness-based interventions for a variety of psychological and medical disorders have grown exponentially over the past 20 years. Yet, calls for increasing the rigor of mindfulness research and recognition of the difficulties of conducting research on the topic of mindfulness have also increased. One of the major difficulties is the measurement of mindfulness, with varying definitions across studies and ambiguity with respect to the meaning of mindfulness. There is also concern about the reproducibility of findings given few attempts at replication. The current secondary analysis addressed the issue of reproducibility and robustness of the construct of self-reported mindfulness across two separate randomized clinical trials of mindfulness-based relapse prevention (MBRP), as an aftercare treatment for substance use disorder. Specifically, we tested the robustness of our previously published findings, which identified a latent construct of mindfulness as a significant mediator of the effect of MBRP on reducing craving following treatment. First, we attempted to replicate the findings in a separate randomized clinical trial of MBRP. Second, we conducted sensitivity analyses to test the assumption of the no-omitted confounder bias in a mediation model. The effect of MBRP on self-reported mindfulness and overall mediation effect failed to replicate in a new sample. The effect of self-reported mindfulness in predicting craving following treatment did replicate and was robust to the no-omitted confounder bias. The results of this work shine a light on the difficulties in the measurement of mindfulness and the importance of examining the robustness of findings.

KW - Craving

KW - Mediation

KW - Mindfulness

KW - Mindfulness-based relapse prevention

KW - Replicability

KW - Reproducibility

KW - Sensitivity analyses

KW - Substance use disorder

UR - http://www.scopus.com/inward/record.url?scp=85063037381&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063037381&partnerID=8YFLogxK

U2 - 10.1007/s12671-018-1023-z

DO - 10.1007/s12671-018-1023-z

M3 - Article

VL - 10

SP - 724

EP - 736

JO - Mindfulness

JF - Mindfulness

SN - 1868-8527

IS - 4

ER -