Multilevel Mediation With Small Samples

A Cautionary Note on the Multilevel Structural Equation Modeling Framework

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89% of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75% of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.

Original languageEnglish (US)
Pages (from-to)609-625
Number of pages17
JournalStructural Equation Modeling
Volume24
Issue number4
DOIs
StatePublished - Jul 4 2017
Externally publishedYes

Fingerprint

Structural Equation Modeling
Mediation
Small Sample
mediation
Multilevel Models
Sample Size
study requirements
Model Complexity
Framework
Structural equation modeling
Small sample
Requirements
performance
flexibility
Flexibility
Multilevel models
simulation
lack

Keywords

  • multilevel mediation
  • multilevel SEM
  • small sample

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Modeling and Simulation
  • Sociology and Political Science
  • Economics, Econometrics and Finance(all)

Cite this

@article{bf370572b7d34840afb143b6fd334fc4,
title = "Multilevel Mediation With Small Samples: A Cautionary Note on the Multilevel Structural Equation Modeling Framework",
abstract = "Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89{\%} of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75{\%} of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.",
keywords = "multilevel mediation, multilevel SEM, small sample",
author = "Daniel McNeish",
year = "2017",
month = "7",
day = "4",
doi = "10.1080/10705511.2017.1280797",
language = "English (US)",
volume = "24",
pages = "609--625",
journal = "Structural Equation Modeling",
issn = "1070-5511",
publisher = "Psychology Press Ltd",
number = "4",

}

TY - JOUR

T1 - Multilevel Mediation With Small Samples

T2 - A Cautionary Note on the Multilevel Structural Equation Modeling Framework

AU - McNeish, Daniel

PY - 2017/7/4

Y1 - 2017/7/4

N2 - Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89% of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75% of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.

AB - Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89% of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75% of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.

KW - multilevel mediation

KW - multilevel SEM

KW - small sample

UR - http://www.scopus.com/inward/record.url?scp=85013945005&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85013945005&partnerID=8YFLogxK

U2 - 10.1080/10705511.2017.1280797

DO - 10.1080/10705511.2017.1280797

M3 - Article

VL - 24

SP - 609

EP - 625

JO - Structural Equation Modeling

JF - Structural Equation Modeling

SN - 1070-5511

IS - 4

ER -