Shallow strategy development in a teachable agent environment designed to support self-regulated learning

Rod Roscoe, James R. Segedy, Brian Sulcer, Hogyeong Jeong, Gautam Biswas

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

To support self-regulated learning (SRL), computer-based learning environments (CBLEs) are often designed to be open-ended and multidimensional. These systems incorporate diverse features that allow students to enact and reveal their SRL strategies via the choices they make. However, research shows that students' use of such features is limited; students often neglect SRL-supportive tools in CBLEs. In this study, we examined middle school students' feature use and strategy development over time using a teachable agent system called Betty's Brain. Students learned about climate change and thermoregulation in two units spanning several weeks. Learning was assessed using a pretest-posttest design, and students' interactions with the system were logged. Results indicated that use of SRL-supportive tools was positively correlated with learning outcomes. However, promising strategy patterns weakened over time due to shallow strategy development, which also negatively impacted the efficacy of the system. Although students seemed to acquire one beneficial strategy, they did so at the cost of other beneficial strategies. Understanding this phenomenon may be a key avenue for future research on SRL-supportive CBLEs. We consider two hypotheses for explaining and perhaps reducing shallow strategy development: a student-centered hypothesis related to "gaming the system," and a design-centered hypothesis regarding how students are scaffolded via the system.

Original languageEnglish (US)
Pages (from-to)286-297
Number of pages12
JournalComputers and Education
Volume62
DOIs
StatePublished - 2013

Fingerprint

development strategy
Students
learning
student
learning environment
learning strategy
Climate change
neglect
Brain
brain
climate change
interaction

Keywords

  • Human-computer interface
  • Intelligent tutoring systems
  • Interactive learning environments
  • Self-regulated learning
  • Teaching/learning strategies

ASJC Scopus subject areas

  • Computer Science(all)
  • Education

Cite this

Shallow strategy development in a teachable agent environment designed to support self-regulated learning. / Roscoe, Rod; Segedy, James R.; Sulcer, Brian; Jeong, Hogyeong; Biswas, Gautam.

In: Computers and Education, Vol. 62, 2013, p. 286-297.

Research output: Contribution to journalArticle

Roscoe, Rod ; Segedy, James R. ; Sulcer, Brian ; Jeong, Hogyeong ; Biswas, Gautam. / Shallow strategy development in a teachable agent environment designed to support self-regulated learning. In: Computers and Education. 2013 ; Vol. 62. pp. 286-297.
@article{140355ebb80443bd95ab03c7b47d8eb8,
title = "Shallow strategy development in a teachable agent environment designed to support self-regulated learning",
abstract = "To support self-regulated learning (SRL), computer-based learning environments (CBLEs) are often designed to be open-ended and multidimensional. These systems incorporate diverse features that allow students to enact and reveal their SRL strategies via the choices they make. However, research shows that students' use of such features is limited; students often neglect SRL-supportive tools in CBLEs. In this study, we examined middle school students' feature use and strategy development over time using a teachable agent system called Betty's Brain. Students learned about climate change and thermoregulation in two units spanning several weeks. Learning was assessed using a pretest-posttest design, and students' interactions with the system were logged. Results indicated that use of SRL-supportive tools was positively correlated with learning outcomes. However, promising strategy patterns weakened over time due to shallow strategy development, which also negatively impacted the efficacy of the system. Although students seemed to acquire one beneficial strategy, they did so at the cost of other beneficial strategies. Understanding this phenomenon may be a key avenue for future research on SRL-supportive CBLEs. We consider two hypotheses for explaining and perhaps reducing shallow strategy development: a student-centered hypothesis related to {"}gaming the system,{"} and a design-centered hypothesis regarding how students are scaffolded via the system.",
keywords = "Human-computer interface, Intelligent tutoring systems, Interactive learning environments, Self-regulated learning, Teaching/learning strategies",
author = "Rod Roscoe and Segedy, {James R.} and Brian Sulcer and Hogyeong Jeong and Gautam Biswas",
year = "2013",
doi = "10.1016/j.compedu.2012.11.008",
language = "English (US)",
volume = "62",
pages = "286--297",
journal = "Computers and Education",
issn = "0360-1315",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Shallow strategy development in a teachable agent environment designed to support self-regulated learning

AU - Roscoe, Rod

AU - Segedy, James R.

AU - Sulcer, Brian

AU - Jeong, Hogyeong

AU - Biswas, Gautam

PY - 2013

Y1 - 2013

N2 - To support self-regulated learning (SRL), computer-based learning environments (CBLEs) are often designed to be open-ended and multidimensional. These systems incorporate diverse features that allow students to enact and reveal their SRL strategies via the choices they make. However, research shows that students' use of such features is limited; students often neglect SRL-supportive tools in CBLEs. In this study, we examined middle school students' feature use and strategy development over time using a teachable agent system called Betty's Brain. Students learned about climate change and thermoregulation in two units spanning several weeks. Learning was assessed using a pretest-posttest design, and students' interactions with the system were logged. Results indicated that use of SRL-supportive tools was positively correlated with learning outcomes. However, promising strategy patterns weakened over time due to shallow strategy development, which also negatively impacted the efficacy of the system. Although students seemed to acquire one beneficial strategy, they did so at the cost of other beneficial strategies. Understanding this phenomenon may be a key avenue for future research on SRL-supportive CBLEs. We consider two hypotheses for explaining and perhaps reducing shallow strategy development: a student-centered hypothesis related to "gaming the system," and a design-centered hypothesis regarding how students are scaffolded via the system.

AB - To support self-regulated learning (SRL), computer-based learning environments (CBLEs) are often designed to be open-ended and multidimensional. These systems incorporate diverse features that allow students to enact and reveal their SRL strategies via the choices they make. However, research shows that students' use of such features is limited; students often neglect SRL-supportive tools in CBLEs. In this study, we examined middle school students' feature use and strategy development over time using a teachable agent system called Betty's Brain. Students learned about climate change and thermoregulation in two units spanning several weeks. Learning was assessed using a pretest-posttest design, and students' interactions with the system were logged. Results indicated that use of SRL-supportive tools was positively correlated with learning outcomes. However, promising strategy patterns weakened over time due to shallow strategy development, which also negatively impacted the efficacy of the system. Although students seemed to acquire one beneficial strategy, they did so at the cost of other beneficial strategies. Understanding this phenomenon may be a key avenue for future research on SRL-supportive CBLEs. We consider two hypotheses for explaining and perhaps reducing shallow strategy development: a student-centered hypothesis related to "gaming the system," and a design-centered hypothesis regarding how students are scaffolded via the system.

KW - Human-computer interface

KW - Intelligent tutoring systems

KW - Interactive learning environments

KW - Self-regulated learning

KW - Teaching/learning strategies

UR - http://www.scopus.com/inward/record.url?scp=84871782560&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871782560&partnerID=8YFLogxK

U2 - 10.1016/j.compedu.2012.11.008

DO - 10.1016/j.compedu.2012.11.008

M3 - Article

VL - 62

SP - 286

EP - 297

JO - Computers and Education

JF - Computers and Education

SN - 0360-1315

ER -