Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics

Min Chi; Kurt VanLehn; Diane Litman

doi:10.1007/978-3-642-13388-6_27

Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics

Min Chi, Kurt VanLehn, Diane Litman

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

40 Scopus citations

Abstract

Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.

Original language	English (US)
Title of host publication	Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings
Pages	224-234
Number of pages	11
Edition	PART 1
DOIs	https://doi.org/10.1007/978-3-642-13388-6_27
State	Published - 2010
Event	10th International Conference on Intelligent Tutoring Systems, ITS 2010 - Pittsburgh, PA, United States Duration: Jun 14 2010 → Jun 18 2010

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 1
Volume	6094 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	10th International Conference on Intelligent Tutoring Systems, ITS 2010
Country/Territory	United States
City	Pittsburgh, PA
Period	6/14/10 → 6/18/10

Keywords

Human learning
Intelligent tutoring systems
Pedagogical strategy
Reinforcement learning

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-642-13388-6_27

Cite this

Chi, M., VanLehn, K., & Litman, D. (2010). Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. In Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings (PART 1 ed., pp. 224-234). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6094 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-13388-6_27

Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. / Chi, Min; VanLehn, Kurt; Litman, Diane.
Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings. PART 1. ed. 2010. p. 224-234 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6094 LNCS, No. PART 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chi, M, VanLehn, K & Litman, D 2010, Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. in Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings. PART 1 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6094 LNCS, pp. 224-234, 10th International Conference on Intelligent Tutoring Systems, ITS 2010, Pittsburgh, PA, United States, 6/14/10. https://doi.org/10.1007/978-3-642-13388-6_27

Chi M, VanLehn K, Litman D. Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics. In Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings. PART 1 ed. 2010. p. 224-234. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). doi: 10.1007/978-3-642-13388-6_27

Chi, Min ; VanLehn, Kurt ; Litman, Diane. / Do micro-level tutorial decisions matter : Applying reinforcement learning to induce pedagogical tutorial tactics. Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings. PART 1. ed. 2010. pp. 224-234 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).

@inproceedings{391c6c7cdeff42ab85860d919e5d0d04,

title = "Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics",

abstract = "Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.",

keywords = "Human learning, Intelligent tutoring systems, Pedagogical strategy, Reinforcement learning",

author = "Min Chi and Kurt VanLehn and Diane Litman",

year = "2010",

doi = "10.1007/978-3-642-13388-6_27",

language = "English (US)",

isbn = "3642133878",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 1",

pages = "224--234",

booktitle = "Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings",

edition = "PART 1",

}

TY - GEN

T1 - Do micro-level tutorial decisions matter

T2 - 10th International Conference on Intelligent Tutoring Systems, ITS 2010

AU - Chi, Min

AU - VanLehn, Kurt

AU - Litman, Diane

PY - 2010

Y1 - 2010

N2 - Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.

AB - Pedagogical tutorial tactics are policies for a tutor to decide the next action when there are multiple actions available. When the contents were controlled so as to be the same, little evidence has shown that tutorial decisions would impact students' learning. In this paper, we applied Reinforcement Learning (RL) to induce two sets of tutorial tactics from pre-existing human interaction data. The NormGain set was derived with the goal of enhancing tutorial decisions that contribute to learning while the InvNormGain set was derived with the goal of enhancing those decisions that contribute less or even nothing to learning. The two sets were then compared with human students. Our results showed that when the contents were controlled so as to be the same, different pedagogical tutorial tactics would make a difference in learning and more specifically, the NormGain students outperformed their peers.

KW - Human learning

KW - Intelligent tutoring systems

KW - Pedagogical strategy

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=79957490177&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79957490177&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-13388-6_27

DO - 10.1007/978-3-642-13388-6_27

M3 - Conference contribution

AN - SCOPUS:79957490177

SN - 3642133878

SN - 9783642133879

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 224

EP - 234

BT - Intelligent Tutoring Systems - 10th International Conference, ITS 2010, Proceedings

Y2 - 14 June 2010 through 18 June 2010

ER -

Do micro-level tutorial decisions matter: Applying reinforcement learning to induce pedagogical tutorial tactics

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this