Assessing Students' Opportunity to Learn the Intended Curriculum Using an Online Teacher Log: Initial Validity Evidence

Alexander Kurz, Stephen Elliott, Ryan J. Kettler, Nedim Yel

Research output: Contribution to journalArticle

18 Scopus citations

Abstract

This study provides initial evidence supporting intended score interpretations for the purpose of assessing opportunity to learn (OTL) via an online teacher log. MyiLOGS yields 5 scores related to instructional time, content, and quality. Based on data from 46 middle school classes, the evidence indicated that (a) MyiLOGS has high usability, (b) its quarterly summary scores are relatively consistent over time, (c) summary scores based on 20 randomly sampled log days provide reliable estimates of teachers' respective yearly summary scores, and (d) most teachers report positive consequences from using the instrument. Agreements between log data from teachers and independent observers were comparable to agreements reported in similar studies. Moreover, several OTL scores exhibited moderate correlations with achievement and virtually nonexistent correlations with a curricular alignment index. Limitations and directions for future research to strengthen and extend this initial evidence are discussed.

Original languageEnglish (US)
Pages (from-to)159-184
Number of pages26
JournalEducational Assessment
Volume19
Issue number3
DOIs
StatePublished - Jul 2014

    Fingerprint

ASJC Scopus subject areas

  • Education

Cite this