Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees

Oscar Gonzalez, Holly O'Rourke, Ingrid C. Wurpts, Kevin Grimm

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Monte Carlo simulations are an important tool for researchers to study statistical properties of estimators, such as parameter bias, or the limits of various modeling approaches. Typically, the immense amount of data produced by Monte Carlo studies is analyzed with regression or analysis of variance, and researchers are faced with making arbitrary decisions regarding what effects to report and what interactions to test. Understanding current limitations, we propose a classification and regression trees (CART) approach from the statistical learning and data mining field to analyze Monte Carlo simulation data. We demonstrate the advantages of the CART approach and several extensions by reanalyzing and interpreting results from one published Monte Carlo study and one fully reproducible simulation example. Results suggest that CART is able to arrive at the same conclusions as current descriptive and inferential approaches and, at the same time, provide additional insight on the complex interactions among simulation factors.

Original languageEnglish (US)
Pages (from-to)403-413
Number of pages11
JournalStructural Equation Modeling
Volume25
Issue number3
DOIs
StatePublished - May 4 2018

Keywords

  • Monte Carlo simulations
  • classification and regression trees
  • data mining
  • interactions

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Modeling and Simulation
  • Sociology and Political Science
  • Economics, Econometrics and Finance(all)

Fingerprint Dive into the research topics of 'Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees'. Together they form a unique fingerprint.

Cite this