Extrinsic Convergent Validity Evidence to Prevent Jingle and Jangle Fallacies

Oscar Gonzalez, David P. MacKinnon, Felix B. Muniz

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

In psychology, there have been vast creative efforts in proposing new constructs and developing measures to assess them. Less effort has been spent in investigating construct overlap to prevent bifurcated literatures, wasted research efforts, and jingle-jangle fallacies. For example, researchers could gather validity evidence to evaluate if two measures with the same label actually assess different constructs (jingle fallacy), or if two measures with different labels actually assess the same construct (jangle fallacy). In this paper, we discuss the concept of extrinsic convergent validity, a source of validity evidence demonstrated when two measures of the same construct, or two measures of seemingly different constructs, have comparable correlations with external criteria. We introduce a formal approach to obtain extrinsic convergent validity evidence using tests of dependent correlations and evaluate the tests using Monte Carlo simulations. Also, we illustrate the methods by examining the overlap between the self-control and grit constructs, and the overlap among seven seemingly different measures of the connectedness to nature construct. Finally, we discuss how extrinsic convergent validity evidence supplements other sources of evidence that support validity arguments of construct overlap.

Original languageEnglish (US)
JournalMultivariate Behavioral Research
DOIs
StateAccepted/In press - Jan 1 2020

Keywords

  • construct overlap
  • Dependent correlations
  • jangle fallacy
  • jingle fallacy
  • validity

ASJC Scopus subject areas

  • Statistics and Probability
  • Experimental and Cognitive Psychology
  • Arts and Humanities (miscellaneous)

Fingerprint Dive into the research topics of 'Extrinsic Convergent Validity Evidence to Prevent Jingle and Jangle Fallacies'. Together they form a unique fingerprint.

Cite this