Abstract
Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89% of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75% of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 609-625 |
| Number of pages | 17 |
| Journal | Structural Equation Modeling |
| Volume | 24 |
| Issue number | 4 |
| DOIs | |
| State | Published - Jul 4 2017 |
| Externally published | Yes |
Fingerprint
Keywords
- multilevel mediation
- multilevel SEM
- small sample
ASJC Scopus subject areas
- Decision Sciences(all)
- Modeling and Simulation
- Sociology and Political Science
- Economics, Econometrics and Finance(all)
Cite this
Multilevel Mediation With Small Samples : A Cautionary Note on the Multilevel Structural Equation Modeling Framework. / McNeish, Daniel.
In: Structural Equation Modeling, Vol. 24, No. 4, 04.07.2017, p. 609-625.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Multilevel Mediation With Small Samples
T2 - A Cautionary Note on the Multilevel Structural Equation Modeling Framework
AU - McNeish, Daniel
PY - 2017/7/4
Y1 - 2017/7/4
N2 - Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89% of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75% of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.
AB - Multilevel structural equation modeling (ML-SEM) for multilevel mediation is noted for its flexibility over a system of multilevel models (MLMs). Sample size requirements are an overlooked limitation of ML-SEM (100 clusters is recommended). We find that 89% of ML-SEM studies have fewer than 100 clusters and the median number is 44. Furthermore, 75% of ML-SEM studies implement 2–1–1 or 1–1–1 models, which can be equivalently fit with MLMs. MLMs theoretically have lower sample size requirements, although studies have yet to assess small sample performance for multilevel mediation. We conduct a simulation to address this pervasive problem. We find that MLMs have more desirable small sample performance and can be trustworthy with 10 clusters. Importantly, many studies lack the sample size and model complexity to necessitate ML-SEM. Although ML-SEM is undeniably more flexible and uniquely positioned for difficult problems, small samples often can be more effectively and simply addressed with MLMs.
KW - multilevel mediation
KW - multilevel SEM
KW - small sample
UR - http://www.scopus.com/inward/record.url?scp=85013945005&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85013945005&partnerID=8YFLogxK
U2 - 10.1080/10705511.2017.1280797
DO - 10.1080/10705511.2017.1280797
M3 - Article
AN - SCOPUS:85013945005
VL - 24
SP - 609
EP - 625
JO - Structural Equation Modeling
JF - Structural Equation Modeling
SN - 1070-5511
IS - 4
ER -