Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees

Oscar Gonzalez, Holly O'Rourke, Ingrid C. Wurpts, Kevin Grimm

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Monte Carlo simulations are an important tool for researchers to study statistical properties of estimators, such as parameter bias, or the limits of various modeling approaches. Typically, the immense amount of data produced by Monte Carlo studies is analyzed with regression or analysis of variance, and researchers are faced with making arbitrary decisions regarding what effects to report and what interactions to test. Understanding current limitations, we propose a classification and regression trees (CART) approach from the statistical learning and data mining field to analyze Monte Carlo simulation data. We demonstrate the advantages of the CART approach and several extensions by reanalyzing and interpreting results from one published Monte Carlo study and one fully reproducible simulation example. Results suggest that CART is able to arrive at the same conclusions as current descriptive and inferential approaches and, at the same time, provide additional insight on the complex interactions among simulation factors.

Original languageEnglish (US)
Pages (from-to)1-11
Number of pages11
JournalStructural Equation Modeling
DOIs
StateAccepted/In press - Sep 29 2017

Fingerprint

Classification and Regression Trees
Monte Carlo Simulation
Simulation Study
Monte Carlo Study
regression
simulation
Statistical Learning
Analysis of variance
Analysis of variance (ANOVA)
Interaction
Statistical property
Data mining
Data Mining
Simulation
interaction
Regression
Decision making
analysis of variance
Estimator
Arbitrary

Keywords

  • classification and regression trees
  • data mining
  • interactions
  • Monte Carlo simulations

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Modeling and Simulation
  • Sociology and Political Science
  • Economics, Econometrics and Finance(all)

Cite this

Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees. / Gonzalez, Oscar; O'Rourke, Holly; Wurpts, Ingrid C.; Grimm, Kevin.

In: Structural Equation Modeling, 29.09.2017, p. 1-11.

Research output: Contribution to journalArticle

@article{3dac86b1e47f4593a65adcaeae8b4c6a,
title = "Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees",
abstract = "Monte Carlo simulations are an important tool for researchers to study statistical properties of estimators, such as parameter bias, or the limits of various modeling approaches. Typically, the immense amount of data produced by Monte Carlo studies is analyzed with regression or analysis of variance, and researchers are faced with making arbitrary decisions regarding what effects to report and what interactions to test. Understanding current limitations, we propose a classification and regression trees (CART) approach from the statistical learning and data mining field to analyze Monte Carlo simulation data. We demonstrate the advantages of the CART approach and several extensions by reanalyzing and interpreting results from one published Monte Carlo study and one fully reproducible simulation example. Results suggest that CART is able to arrive at the same conclusions as current descriptive and inferential approaches and, at the same time, provide additional insight on the complex interactions among simulation factors.",
keywords = "classification and regression trees, data mining, interactions, Monte Carlo simulations",
author = "Oscar Gonzalez and Holly O'Rourke and Wurpts, {Ingrid C.} and Kevin Grimm",
year = "2017",
month = "9",
day = "29",
doi = "10.1080/10705511.2017.1369353",
language = "English (US)",
pages = "1--11",
journal = "Structural Equation Modeling",
issn = "1070-5511",
publisher = "Psychology Press Ltd",

}

TY - JOUR

T1 - Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees

AU - Gonzalez, Oscar

AU - O'Rourke, Holly

AU - Wurpts, Ingrid C.

AU - Grimm, Kevin

PY - 2017/9/29

Y1 - 2017/9/29

N2 - Monte Carlo simulations are an important tool for researchers to study statistical properties of estimators, such as parameter bias, or the limits of various modeling approaches. Typically, the immense amount of data produced by Monte Carlo studies is analyzed with regression or analysis of variance, and researchers are faced with making arbitrary decisions regarding what effects to report and what interactions to test. Understanding current limitations, we propose a classification and regression trees (CART) approach from the statistical learning and data mining field to analyze Monte Carlo simulation data. We demonstrate the advantages of the CART approach and several extensions by reanalyzing and interpreting results from one published Monte Carlo study and one fully reproducible simulation example. Results suggest that CART is able to arrive at the same conclusions as current descriptive and inferential approaches and, at the same time, provide additional insight on the complex interactions among simulation factors.

AB - Monte Carlo simulations are an important tool for researchers to study statistical properties of estimators, such as parameter bias, or the limits of various modeling approaches. Typically, the immense amount of data produced by Monte Carlo studies is analyzed with regression or analysis of variance, and researchers are faced with making arbitrary decisions regarding what effects to report and what interactions to test. Understanding current limitations, we propose a classification and regression trees (CART) approach from the statistical learning and data mining field to analyze Monte Carlo simulation data. We demonstrate the advantages of the CART approach and several extensions by reanalyzing and interpreting results from one published Monte Carlo study and one fully reproducible simulation example. Results suggest that CART is able to arrive at the same conclusions as current descriptive and inferential approaches and, at the same time, provide additional insight on the complex interactions among simulation factors.

KW - classification and regression trees

KW - data mining

KW - interactions

KW - Monte Carlo simulations

UR - http://www.scopus.com/inward/record.url?scp=85030183125&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030183125&partnerID=8YFLogxK

U2 - 10.1080/10705511.2017.1369353

DO - 10.1080/10705511.2017.1369353

M3 - Article

SP - 1

EP - 11

JO - Structural Equation Modeling

JF - Structural Equation Modeling

SN - 1070-5511

ER -