A Commentary on Construct Validity When Using Operational Virtual Learning Environment Data in Effectiveness Studies

A. Corinne Huggins-Manley, Carole R. Beal, Sidney K. D’Mello, Walter L. Leite, Dyugu Dee Cetin-Berber, Dongho Kim, Danielle S. McNamara

Research output: Contribution to journalArticle

2 Scopus citations

Abstract

Virtual learning environments (VLEs) are increasingly used at-scale in educational contexts to facilitate teaching and promote learning, and the data they produce can be used for educational research purposes. Meanwhile, the U.S. Department of Education’s Office of Educational Technology has repeatedly emphasized the importance of using evidence to validate claims from VLE-based educational research. Although VLE data can provide some affordances for conducting educational research, we argue that many challenges can arise with respect to providing evidence for construct validity. The objective of this commentary is to encourage educational researchers using operational, at-scale VLE data to align their data and intended constructs to a theoretical framework of construct validity threats in order to develop a comprehensive set of actionable solutions. We use examples from our research project as a demonstration resource for performing such an alignment.

Original languageEnglish (US)
Pages (from-to)750-759
Number of pages10
JournalJournal of Research on Educational Effectiveness
Volume12
Issue number4
DOIs
StatePublished - Oct 2 2019

    Fingerprint

Keywords

  • construct validity
  • educational technology
  • measurement
  • virtual learning environments

ASJC Scopus subject areas

  • Education

Cite this