Predicting Literacy Skills via Stealth Assessment in a Simple Vocabulary Game

Ying Fang, Tong Li, Rod D. Roscoe, Danielle S. McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

iSTART is a game-based intelligent tutoring system (ITS) designed to improve students’ reading skills by providing training on reading comprehension strategies. Game-based practice in iSTART follows two main approaches: generative practice and identification practice. Generative practice games ask students to author self-explanations using one or more of the instructed strategies. Identification practice games require students to recognize or select appropriate strategies based on their analysis of example texts. This study explored the feasibility of implementing stealth assessments in iSTART using only an identification game. Specifically, this study examined the extent to which participants’ performance and attitudes related to a simple vocabulary game could predict the outcomes of standardized reading assessments. MTurk participants (N = 211) played identification games in iSTART and then rated their subjective gameplay experience. Participants also completed measures of their vocabulary and reading comprehension skills. Results indicated that participants’ performance in a vocabulary practice game was predictive of literacy skills. In addition, the possibility that students’ attitude towards the game moderated the relation between game performance and literacy skills was ruled out. These findings argue for the feasibility of implementing stealth assessment in simple games to facilitate the adaptivity of ITSs.

Original languageEnglish (US)
Title of host publicationAdaptive Instructional Systems. Adaptation Strategies and Methods - 3rd International Conference, AIS 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Proceedings
EditorsRobert A. Sottilare, Jessica Schwarz
PublisherSpringer Science and Business Media Deutschland GmbH
Pages32-44
Number of pages13
ISBN (Print)9783030778729
DOIs
StatePublished - 2021
Externally publishedYes
Event3rd International Conference on Adaptive Instructional Systems, AIS 2021, Held as Part of the 23rd HCI International Conference, HCII 2021 - Virtual, Online
Duration: Jul 24 2021Jul 29 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12793 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd International Conference on Adaptive Instructional Systems, AIS 2021, Held as Part of the 23rd HCI International Conference, HCII 2021
CityVirtual, Online
Period7/24/217/29/21

Keywords

  • Game-based learning environment
  • iSTART
  • Stealth assessment

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Predicting Literacy Skills via Stealth Assessment in a Simple Vocabulary Game'. Together they form a unique fingerprint.

Cite this