Quantifying the robustness of causal inferences: Sensitivity analysis for pragmatic social science

Kenneth A. Frank, Qinyun Lin, Ran Xu, Spiro Maroulis, Anna Mueller

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Social scientists seeking to inform policy or public action must carefully consider how to identify effects and express inferences because actions based on invalid inferences may not yield the intended results. Recognizing the complexities and uncertainties of social science, we seek to inform inevitable debates about causal inferences by quantifying the conditions necessary to change an inference. Specifically, we review existing sensitivity analyses within the omitted variables and potential outcomes frameworks. We then present the Impact Threshold for a Confounding Variable (ITCV) based on omitted variables in the linear model and the Robustness of Inference to Replacement (RIR) based on the potential outcomes framework. We extend each approach to include benchmarks and to fully account for sampling variability represented by standard errors as well as bias. We exhort social scientists wishing to inform policy and practice to quantify the robustness of their inferences after utilizing the best available data and methods to draw an initial causal inference.

Original languageEnglish (US)
Article number102815
JournalSocial Science Research
DOIs
StateAccepted/In press - 2022
Externally publishedYes

Keywords

  • Causal inference
  • Pragmatic sociology
  • Sensitivity analysis

ASJC Scopus subject areas

  • Education
  • Sociology and Political Science

Fingerprint

Dive into the research topics of 'Quantifying the robustness of causal inferences: Sensitivity analysis for pragmatic social science'. Together they form a unique fingerprint.

Cite this