Using automated dialog analysis to assess peer tutoring and trigger effective support

Erin Walker, Nikol Rummel, Kenneth R. Koedinger

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Intelligent tutors have the potential to be used in supporting learning from collaboration, but there are few results demonstrating their positive effects in this domain. One of the main challenges in automated support for collaboration is the machine classification of dialogue, giving the system an ability to know when and how to intervene. We have developed an automated detector of conceptual content that is used as a basis for providing adaptive prompts to peer tutors in high-school algebra. We conducted an after-school study with 61 participants where we compared this adaptive support to two nonadaptive support conditions, and found that adaptive prompts significantly increased conceptual help and peer tutor domain learning. The amount of conceptual help students gave, as determined by either human coding or machine classification, was predictive of learning. Thus, machine classification was effective both as a basis for feedback and predictor of success.

Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages385-393
Number of pages9
Volume6738 LNAI
DOIs
StatePublished - 2011
Externally publishedYes
Event15th International Conference on Artificial Intelligence in Education, AIED 2011 - Auckland, New Zealand
Duration: Jun 28 2011Jul 1 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6738 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other15th International Conference on Artificial Intelligence in Education, AIED 2011
CountryNew Zealand
CityAuckland
Period6/28/117/1/11

Fingerprint

Trigger
Algebra
Predictors
Coding
Detector
Students
Detectors
Feedback
Dialogue
Learning
Collaboration
Human

Keywords

  • adaptive collaboration support
  • intelligent tutoring
  • peer tutoring

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Walker, E., Rummel, N., & Koedinger, K. R. (2011). Using automated dialog analysis to assess peer tutoring and trigger effective support. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 6738 LNAI, pp. 385-393). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6738 LNAI). https://doi.org/10.1007/978-3-642-21869-9_50

Using automated dialog analysis to assess peer tutoring and trigger effective support. / Walker, Erin; Rummel, Nikol; Koedinger, Kenneth R.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6738 LNAI 2011. p. 385-393 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6738 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Walker, E, Rummel, N & Koedinger, KR 2011, Using automated dialog analysis to assess peer tutoring and trigger effective support. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 6738 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6738 LNAI, pp. 385-393, 15th International Conference on Artificial Intelligence in Education, AIED 2011, Auckland, New Zealand, 6/28/11. https://doi.org/10.1007/978-3-642-21869-9_50
Walker E, Rummel N, Koedinger KR. Using automated dialog analysis to assess peer tutoring and trigger effective support. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6738 LNAI. 2011. p. 385-393. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-21869-9_50
Walker, Erin ; Rummel, Nikol ; Koedinger, Kenneth R. / Using automated dialog analysis to assess peer tutoring and trigger effective support. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 6738 LNAI 2011. pp. 385-393 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{a28867cc1dc6486787b30d7c3ffed5bb,
title = "Using automated dialog analysis to assess peer tutoring and trigger effective support",
abstract = "Intelligent tutors have the potential to be used in supporting learning from collaboration, but there are few results demonstrating their positive effects in this domain. One of the main challenges in automated support for collaboration is the machine classification of dialogue, giving the system an ability to know when and how to intervene. We have developed an automated detector of conceptual content that is used as a basis for providing adaptive prompts to peer tutors in high-school algebra. We conducted an after-school study with 61 participants where we compared this adaptive support to two nonadaptive support conditions, and found that adaptive prompts significantly increased conceptual help and peer tutor domain learning. The amount of conceptual help students gave, as determined by either human coding or machine classification, was predictive of learning. Thus, machine classification was effective both as a basis for feedback and predictor of success.",
keywords = "adaptive collaboration support, intelligent tutoring, peer tutoring",
author = "Erin Walker and Nikol Rummel and Koedinger, {Kenneth R.}",
year = "2011",
doi = "10.1007/978-3-642-21869-9_50",
language = "English (US)",
isbn = "9783642218682",
volume = "6738 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "385--393",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Using automated dialog analysis to assess peer tutoring and trigger effective support

AU - Walker, Erin

AU - Rummel, Nikol

AU - Koedinger, Kenneth R.

PY - 2011

Y1 - 2011

N2 - Intelligent tutors have the potential to be used in supporting learning from collaboration, but there are few results demonstrating their positive effects in this domain. One of the main challenges in automated support for collaboration is the machine classification of dialogue, giving the system an ability to know when and how to intervene. We have developed an automated detector of conceptual content that is used as a basis for providing adaptive prompts to peer tutors in high-school algebra. We conducted an after-school study with 61 participants where we compared this adaptive support to two nonadaptive support conditions, and found that adaptive prompts significantly increased conceptual help and peer tutor domain learning. The amount of conceptual help students gave, as determined by either human coding or machine classification, was predictive of learning. Thus, machine classification was effective both as a basis for feedback and predictor of success.

AB - Intelligent tutors have the potential to be used in supporting learning from collaboration, but there are few results demonstrating their positive effects in this domain. One of the main challenges in automated support for collaboration is the machine classification of dialogue, giving the system an ability to know when and how to intervene. We have developed an automated detector of conceptual content that is used as a basis for providing adaptive prompts to peer tutors in high-school algebra. We conducted an after-school study with 61 participants where we compared this adaptive support to two nonadaptive support conditions, and found that adaptive prompts significantly increased conceptual help and peer tutor domain learning. The amount of conceptual help students gave, as determined by either human coding or machine classification, was predictive of learning. Thus, machine classification was effective both as a basis for feedback and predictor of success.

KW - adaptive collaboration support

KW - intelligent tutoring

KW - peer tutoring

UR - http://www.scopus.com/inward/record.url?scp=79959293473&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79959293473&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-21869-9_50

DO - 10.1007/978-3-642-21869-9_50

M3 - Conference contribution

SN - 9783642218682

VL - 6738 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 385

EP - 393

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -