An evaluation of pedagogical tutorial tactics for a natural language tutoring system

A reinforcement learning approach

Min Chi, Kurt VanLehn, Diane Litman, Pamela Jordan

Research output: Contribution to journalArticle

34 Citations (Scopus)

Abstract

Pedagogical strategies are policies for a tutor to decide the next action when there are multiple actions available. When the content is controlled to be the same across experimental conditions, there has been little evidence that tutorial decisions have an impact on students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of pedagogical policies from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then tested with human students. Our results show that when the content was controlled to be the same, different pedagogical policies did make a difference in learning and more specifically, the NormGain students outperformed their peers. Overall our results suggest that content exposure and practice opportunities can help students to learn even when tutors have poor pedagogical tutorial tactics. However, with effective tutorial tactics, students can learn even more.

Original languageEnglish (US)
Pages (from-to)83-113
Number of pages31
JournalInternational Journal of Artificial Intelligence in Education
Volume21
Issue number1-2
DOIs
StatePublished - 2011

Fingerprint

Reinforcement learning
reinforcement
tactics
Students
language
evaluation
learning
tutor
student
interaction
evidence

Keywords

  • human learning
  • intelligent tutoring systems
  • pedagogical strategy
  • Reinforcement learning

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Education

Cite this

An evaluation of pedagogical tutorial tactics for a natural language tutoring system : A reinforcement learning approach. / Chi, Min; VanLehn, Kurt; Litman, Diane; Jordan, Pamela.

In: International Journal of Artificial Intelligence in Education, Vol. 21, No. 1-2, 2011, p. 83-113.

Research output: Contribution to journalArticle

@article{1f361b1c5f5d495fb15347b15adf63ed,
title = "An evaluation of pedagogical tutorial tactics for a natural language tutoring system: A reinforcement learning approach",
abstract = "Pedagogical strategies are policies for a tutor to decide the next action when there are multiple actions available. When the content is controlled to be the same across experimental conditions, there has been little evidence that tutorial decisions have an impact on students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of pedagogical policies from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then tested with human students. Our results show that when the content was controlled to be the same, different pedagogical policies did make a difference in learning and more specifically, the NormGain students outperformed their peers. Overall our results suggest that content exposure and practice opportunities can help students to learn even when tutors have poor pedagogical tutorial tactics. However, with effective tutorial tactics, students can learn even more.",
keywords = "human learning, intelligent tutoring systems, pedagogical strategy, Reinforcement learning",
author = "Min Chi and Kurt VanLehn and Diane Litman and Pamela Jordan",
year = "2011",
doi = "10.3233/JAI-2011-014",
language = "English (US)",
volume = "21",
pages = "83--113",
journal = "International Journal of Artificial Intelligence in Education",
issn = "1560-4292",
publisher = "IOS Press",
number = "1-2",

}

TY - JOUR

T1 - An evaluation of pedagogical tutorial tactics for a natural language tutoring system

T2 - A reinforcement learning approach

AU - Chi, Min

AU - VanLehn, Kurt

AU - Litman, Diane

AU - Jordan, Pamela

PY - 2011

Y1 - 2011

N2 - Pedagogical strategies are policies for a tutor to decide the next action when there are multiple actions available. When the content is controlled to be the same across experimental conditions, there has been little evidence that tutorial decisions have an impact on students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of pedagogical policies from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then tested with human students. Our results show that when the content was controlled to be the same, different pedagogical policies did make a difference in learning and more specifically, the NormGain students outperformed their peers. Overall our results suggest that content exposure and practice opportunities can help students to learn even when tutors have poor pedagogical tutorial tactics. However, with effective tutorial tactics, students can learn even more.

AB - Pedagogical strategies are policies for a tutor to decide the next action when there are multiple actions available. When the content is controlled to be the same across experimental conditions, there has been little evidence that tutorial decisions have an impact on students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of pedagogical policies from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then tested with human students. Our results show that when the content was controlled to be the same, different pedagogical policies did make a difference in learning and more specifically, the NormGain students outperformed their peers. Overall our results suggest that content exposure and practice opportunities can help students to learn even when tutors have poor pedagogical tutorial tactics. However, with effective tutorial tactics, students can learn even more.

KW - human learning

KW - intelligent tutoring systems

KW - pedagogical strategy

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=84855645734&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84855645734&partnerID=8YFLogxK

U2 - 10.3233/JAI-2011-014

DO - 10.3233/JAI-2011-014

M3 - Article

VL - 21

SP - 83

EP - 113

JO - International Journal of Artificial Intelligence in Education

JF - International Journal of Artificial Intelligence in Education

SN - 1560-4292

IS - 1-2

ER -