Responding to learners' cognitive-affective states with supportive and shakeup dialogues

Sidney D'Mello, Scotty Craig, Karl Fike, Arthur Graesser

Research output: Chapter in Book/Report/Conference proceedingConference contribution

30 Citations (Scopus)

Abstract

This paper describes two affect-sensitive variants of an existing intelligent tutoring system called AutoTutor. The new versions of AutoTutor detect learners' boredom, confusion, and frustration by monitoring conversational cues, gross body language, and facial features. The sensed cognitive-affective states are used to select AutoTutor's pedagogical and motivational dialogue moves and to drive the behavior of an embodied pedagogical agent that expresses emotions through verbal content, facial expressions, and affective speech. The first version, called the Supportive AutoTutor, addresses the presence of the negative states by providing empathetic and encouraging responses. The Supportive AutoTutor attributes the source of the learners' emotions to the material or itself, but never directly to the learner. In contrast, the second version, called the Shakeup AutoTutor, takes students to task by directly attributing the source of the emotions to the learners themselves and responding with witty, skeptical, and enthusiastic responses. This paper provides an overview of our theoretical framework, and the design of the Supportive and Shakeup tutors.

Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages595-604
Number of pages10
Volume5612 LNCS
EditionPART 3
DOIs
StatePublished - 2009
Externally publishedYes
Event13th International Conference on Human-Computer Interaction, HCI International 2009 - San Diego, CA, United States
Duration: Jul 19 2009Jul 24 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 3
Volume5612 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other13th International Conference on Human-Computer Interaction, HCI International 2009
CountryUnited States
CitySan Diego, CA
Period7/19/097/24/09

Fingerprint

Intelligent systems
Students
Monitoring
Intelligent Tutoring Systems
Frustration
Facial Expression
Gross
Express
Attribute
Emotion
Dialogue

Keywords

  • Affect
  • Affect-sensitive AutoTutor
  • Emotion
  • ITS

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

D'Mello, S., Craig, S., Fike, K., & Graesser, A. (2009). Responding to learners' cognitive-affective states with supportive and shakeup dialogues. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 3 ed., Vol. 5612 LNCS, pp. 595-604). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5612 LNCS, No. PART 3). https://doi.org/10.1007/978-3-642-02580-8_65

Responding to learners' cognitive-affective states with supportive and shakeup dialogues. / D'Mello, Sidney; Craig, Scotty; Fike, Karl; Graesser, Arthur.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5612 LNCS PART 3. ed. 2009. p. 595-604 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5612 LNCS, No. PART 3).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

D'Mello, S, Craig, S, Fike, K & Graesser, A 2009, Responding to learners' cognitive-affective states with supportive and shakeup dialogues. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 3 edn, vol. 5612 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 3, vol. 5612 LNCS, pp. 595-604, 13th International Conference on Human-Computer Interaction, HCI International 2009, San Diego, CA, United States, 7/19/09. https://doi.org/10.1007/978-3-642-02580-8_65
D'Mello S, Craig S, Fike K, Graesser A. Responding to learners' cognitive-affective states with supportive and shakeup dialogues. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 3 ed. Vol. 5612 LNCS. 2009. p. 595-604. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 3). https://doi.org/10.1007/978-3-642-02580-8_65
D'Mello, Sidney ; Craig, Scotty ; Fike, Karl ; Graesser, Arthur. / Responding to learners' cognitive-affective states with supportive and shakeup dialogues. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5612 LNCS PART 3. ed. 2009. pp. 595-604 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 3).
@inproceedings{c768a60552854384a116a806be1d741f,
title = "Responding to learners' cognitive-affective states with supportive and shakeup dialogues",
abstract = "This paper describes two affect-sensitive variants of an existing intelligent tutoring system called AutoTutor. The new versions of AutoTutor detect learners' boredom, confusion, and frustration by monitoring conversational cues, gross body language, and facial features. The sensed cognitive-affective states are used to select AutoTutor's pedagogical and motivational dialogue moves and to drive the behavior of an embodied pedagogical agent that expresses emotions through verbal content, facial expressions, and affective speech. The first version, called the Supportive AutoTutor, addresses the presence of the negative states by providing empathetic and encouraging responses. The Supportive AutoTutor attributes the source of the learners' emotions to the material or itself, but never directly to the learner. In contrast, the second version, called the Shakeup AutoTutor, takes students to task by directly attributing the source of the emotions to the learners themselves and responding with witty, skeptical, and enthusiastic responses. This paper provides an overview of our theoretical framework, and the design of the Supportive and Shakeup tutors.",
keywords = "Affect, Affect-sensitive AutoTutor, Emotion, ITS",
author = "Sidney D'Mello and Scotty Craig and Karl Fike and Arthur Graesser",
year = "2009",
doi = "10.1007/978-3-642-02580-8_65",
language = "English (US)",
isbn = "364202579X",
volume = "5612 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 3",
pages = "595--604",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 3",

}

TY - GEN

T1 - Responding to learners' cognitive-affective states with supportive and shakeup dialogues

AU - D'Mello, Sidney

AU - Craig, Scotty

AU - Fike, Karl

AU - Graesser, Arthur

PY - 2009

Y1 - 2009

N2 - This paper describes two affect-sensitive variants of an existing intelligent tutoring system called AutoTutor. The new versions of AutoTutor detect learners' boredom, confusion, and frustration by monitoring conversational cues, gross body language, and facial features. The sensed cognitive-affective states are used to select AutoTutor's pedagogical and motivational dialogue moves and to drive the behavior of an embodied pedagogical agent that expresses emotions through verbal content, facial expressions, and affective speech. The first version, called the Supportive AutoTutor, addresses the presence of the negative states by providing empathetic and encouraging responses. The Supportive AutoTutor attributes the source of the learners' emotions to the material or itself, but never directly to the learner. In contrast, the second version, called the Shakeup AutoTutor, takes students to task by directly attributing the source of the emotions to the learners themselves and responding with witty, skeptical, and enthusiastic responses. This paper provides an overview of our theoretical framework, and the design of the Supportive and Shakeup tutors.

AB - This paper describes two affect-sensitive variants of an existing intelligent tutoring system called AutoTutor. The new versions of AutoTutor detect learners' boredom, confusion, and frustration by monitoring conversational cues, gross body language, and facial features. The sensed cognitive-affective states are used to select AutoTutor's pedagogical and motivational dialogue moves and to drive the behavior of an embodied pedagogical agent that expresses emotions through verbal content, facial expressions, and affective speech. The first version, called the Supportive AutoTutor, addresses the presence of the negative states by providing empathetic and encouraging responses. The Supportive AutoTutor attributes the source of the learners' emotions to the material or itself, but never directly to the learner. In contrast, the second version, called the Shakeup AutoTutor, takes students to task by directly attributing the source of the emotions to the learners themselves and responding with witty, skeptical, and enthusiastic responses. This paper provides an overview of our theoretical framework, and the design of the Supportive and Shakeup tutors.

KW - Affect

KW - Affect-sensitive AutoTutor

KW - Emotion

KW - ITS

UR - http://www.scopus.com/inward/record.url?scp=70350319581&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350319581&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-02580-8_65

DO - 10.1007/978-3-642-02580-8_65

M3 - Conference contribution

AN - SCOPUS:70350319581

SN - 364202579X

SN - 9783642025792

VL - 5612 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 595

EP - 604

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -