Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics

Min Chi, Kurt VanLehn, Diane Litman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

33 Citations (Scopus)

Abstract

Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.

Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages224-234
Number of pages11
Volume6094 LNCS
EditionPART 1
DOIs
StatePublished - 2010
Event10th International Conference on Intelligent Tutoring Systems, ITS 2010 - Pittsburgh, PA, United States
Duration: Jun 14 2010Jun 18 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume6094 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other10th International Conference on Intelligent Tutoring Systems, ITS 2010
CountryUnited States
CityPittsburgh, PA
Period6/14/106/18/10

Fingerprint

Reinforcement learning
Reinforcement Learning
Students
Student Learning
Interaction
Learning
Human

Keywords

  • Human learning
  • Intelligent tutoring systems
  • Pedagogical strategy
  • Reinforcement learning

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Chi, M., VanLehn, K., & Litman, D. (2010). Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 1 ed., Vol. 6094 LNCS, pp. 224-234). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6094 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-13388-6_27

Do micro-level tutorial decisions matter : Applying reinforcement learning to induce pedagogical tutorial tactics. / Chi, Min; VanLehn, Kurt; Litman, Diane.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6094 LNCS PART 1. ed. 2010. p. 224-234 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6094 LNCS, No. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chi, M, VanLehn, K & Litman, D 2010, Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 edn, vol. 6094 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6094 LNCS, pp. 224-234, 10th International Conference on Intelligent Tutoring Systems, ITS 2010, Pittsburgh, PA, United States, 6/14/10. https://doi.org/10.1007/978-3-642-13388-6_27
Chi M, VanLehn K, Litman D. Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 1 ed. Vol. 6094 LNCS. 2010. p. 224-234. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). https://doi.org/10.1007/978-3-642-13388-6_27
Chi, Min ; VanLehn, Kurt ; Litman, Diane. / Do micro-level tutorial decisions matter : Applying reinforcement learning to induce pedagogical tutorial tactics. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6094 LNCS PART 1. ed. 2010. pp. 224-234 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).
@inproceedings{391c6c7cdeff42ab85860d919e5d0d04,
title = "Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics",
abstract = "Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.",
keywords = "Human learning, Intelligent tutoring systems, Pedagogical strategy, Reinforcement learning",
author = "Min Chi and Kurt VanLehn and Diane Litman",
year = "2010",
doi = "10.1007/978-3-642-13388-6_27",
language = "English (US)",
isbn = "3642133878",
volume = "6094 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 1",
pages = "224--234",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 1",

}

TY - GEN

T1 - Do micro-level tutorial decisions matter

T2 - Applying reinforcement learning to induce pedagogical tutorial tactics

AU - Chi, Min

AU - VanLehn, Kurt

AU - Litman, Diane

PY - 2010

Y1 - 2010

N2 - Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.

AB - Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.

KW - Human learning

KW - Intelligent tutoring systems

KW - Pedagogical strategy

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=79957490177&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79957490177&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-13388-6_27

DO - 10.1007/978-3-642-13388-6_27

M3 - Conference contribution

AN - SCOPUS:79957490177

SN - 3642133878

SN - 9783642133879

VL - 6094 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 224

EP - 234

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -