Taking Control: Stealth Assessment of Deterministic Behaviors Within a Game-Based System

Erica L. Snow, Aaron D. Likens, Laura K. Allen, Danielle McNamara

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Game-based environments frequently afford students the opportunity to exert agency over their learning paths by making various choices within the environment. The combination of log data from these systems and dynamic methodologies may serve as a stealth means to assess how students behave (i.e., deterministic or random) within these learning environments. The current work captures variations in students’ behavior patterns by employing two dynamic analyses to classify students’ sequences of choices within an adaptive learning environment. Random Walk analyses and Hurst exponents were used to classify students’ interaction patterns as random or deterministic. Forty high school students interacted with the game-based system, iSTART-ME, for 11-sessions (pretest, 8 training sessions, posttest, and a delayed retention test). Analyses revealed that students who interacted in a more deterministic manner also generated higher quality self-explanations during training sessions. The results point toward the potential for dynamic analyses such as random walk analyses and Hurst exponents to provide stealth assessments of students’ learning behaviors while engaged within a game-based environment.

Original languageEnglish (US)
Pages (from-to)1011-1032
Number of pages22
JournalInternational Journal of Artificial Intelligence in Education
Volume26
Issue number4
DOIs
StatePublished - Dec 1 2016

Fingerprint

Students
student
learning environment
interaction pattern
learning behavior
behavior pattern
methodology
school
learning

Keywords

  • Dynamic analyses
  • Game-based intelligent tutoring systems
  • Log data
  • Stealth assessment

ASJC Scopus subject areas

  • Education
  • Computational Theory and Mathematics

Cite this

Taking Control : Stealth Assessment of Deterministic Behaviors Within a Game-Based System. / Snow, Erica L.; Likens, Aaron D.; Allen, Laura K.; McNamara, Danielle.

In: International Journal of Artificial Intelligence in Education, Vol. 26, No. 4, 01.12.2016, p. 1011-1032.

Research output: Contribution to journalArticle

@article{7a8f4f3afc254c8b89fb66a33ea31b9f,
title = "Taking Control: Stealth Assessment of Deterministic Behaviors Within a Game-Based System",
abstract = "Game-based environments frequently afford students the opportunity to exert agency over their learning paths by making various choices within the environment. The combination of log data from these systems and dynamic methodologies may serve as a stealth means to assess how students behave (i.e., deterministic or random) within these learning environments. The current work captures variations in students’ behavior patterns by employing two dynamic analyses to classify students’ sequences of choices within an adaptive learning environment. Random Walk analyses and Hurst exponents were used to classify students’ interaction patterns as random or deterministic. Forty high school students interacted with the game-based system, iSTART-ME, for 11-sessions (pretest, 8 training sessions, posttest, and a delayed retention test). Analyses revealed that students who interacted in a more deterministic manner also generated higher quality self-explanations during training sessions. The results point toward the potential for dynamic analyses such as random walk analyses and Hurst exponents to provide stealth assessments of students’ learning behaviors while engaged within a game-based environment.",
keywords = "Dynamic analyses, Game-based intelligent tutoring systems, Log data, Stealth assessment",
author = "Snow, {Erica L.} and Likens, {Aaron D.} and Allen, {Laura K.} and Danielle McNamara",
year = "2016",
month = "12",
day = "1",
doi = "10.1007/s40593-015-0085-5",
language = "English (US)",
volume = "26",
pages = "1011--1032",
journal = "International Journal of Artificial Intelligence in Education",
issn = "1560-4292",
publisher = "IOS Press",
number = "4",

}

TY - JOUR

T1 - Taking Control

T2 - Stealth Assessment of Deterministic Behaviors Within a Game-Based System

AU - Snow, Erica L.

AU - Likens, Aaron D.

AU - Allen, Laura K.

AU - McNamara, Danielle

PY - 2016/12/1

Y1 - 2016/12/1

N2 - Game-based environments frequently afford students the opportunity to exert agency over their learning paths by making various choices within the environment. The combination of log data from these systems and dynamic methodologies may serve as a stealth means to assess how students behave (i.e., deterministic or random) within these learning environments. The current work captures variations in students’ behavior patterns by employing two dynamic analyses to classify students’ sequences of choices within an adaptive learning environment. Random Walk analyses and Hurst exponents were used to classify students’ interaction patterns as random or deterministic. Forty high school students interacted with the game-based system, iSTART-ME, for 11-sessions (pretest, 8 training sessions, posttest, and a delayed retention test). Analyses revealed that students who interacted in a more deterministic manner also generated higher quality self-explanations during training sessions. The results point toward the potential for dynamic analyses such as random walk analyses and Hurst exponents to provide stealth assessments of students’ learning behaviors while engaged within a game-based environment.

AB - Game-based environments frequently afford students the opportunity to exert agency over their learning paths by making various choices within the environment. The combination of log data from these systems and dynamic methodologies may serve as a stealth means to assess how students behave (i.e., deterministic or random) within these learning environments. The current work captures variations in students’ behavior patterns by employing two dynamic analyses to classify students’ sequences of choices within an adaptive learning environment. Random Walk analyses and Hurst exponents were used to classify students’ interaction patterns as random or deterministic. Forty high school students interacted with the game-based system, iSTART-ME, for 11-sessions (pretest, 8 training sessions, posttest, and a delayed retention test). Analyses revealed that students who interacted in a more deterministic manner also generated higher quality self-explanations during training sessions. The results point toward the potential for dynamic analyses such as random walk analyses and Hurst exponents to provide stealth assessments of students’ learning behaviors while engaged within a game-based environment.

KW - Dynamic analyses

KW - Game-based intelligent tutoring systems

KW - Log data

KW - Stealth assessment

UR - http://www.scopus.com/inward/record.url?scp=84988458295&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988458295&partnerID=8YFLogxK

U2 - 10.1007/s40593-015-0085-5

DO - 10.1007/s40593-015-0085-5

M3 - Article

AN - SCOPUS:84988458295

VL - 26

SP - 1011

EP - 1032

JO - International Journal of Artificial Intelligence in Education

JF - International Journal of Artificial Intelligence in Education

SN - 1560-4292

IS - 4

ER -