Towards understanding how to assess help-seeking behavior across cultures

Amy Ogan, Erin Walker, Ryan Baker, Ma Mercedes T Rodrigo, Jose Carlo Soriano, Maynor Jimenez Castro

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

In recent years, there has been increasing interest in automatically assessing help seeking, the process of referring to resources outside of oneself to accomplish a task or solve a problem. Research in the United States has shown that specific help-seeking behaviors led to better learning within intelligent tutoring systems. However, intelligent tutors are used differently by students in different countries, raising the question of whether the same help-seeking behaviors are effective and desirable in different cultural settings. To investigate this question, models connecting help-seeking behaviors with learning were generated from datasets from students in three countries - Costa Rica, the Philippines, and the United States, as well as a combined dataset from all three sites. Each model was tested on data from the other countries. This study found that models of effective help seeking transfer to some degree between the United States and Philippines, but not between those countries and Costa Rica. Differences may be explained by variations in classroom practices between the sites; for example, greater collaboration observed in the Costa Rican site indicates that much help seeking occurred outside of the technology. Findings indicate that greater care should be taken when assuming that the models underlying AIED systems generalize across cultures and contexts.

Original languageEnglish (US)
Pages (from-to)229-248
Number of pages20
JournalInternational Journal of Artificial Intelligence in Education
Volume25
Issue number2
DOIs
StatePublished - Mar 31 2015

Fingerprint

Costa Rica
Philippines
Students
Intelligent systems
tutor
learning
student
classroom
resources

Keywords

  • Assessment
  • Cross-curricular skills
  • Help seeking
  • Intelligent tutoring system

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Education

Cite this

Towards understanding how to assess help-seeking behavior across cultures. / Ogan, Amy; Walker, Erin; Baker, Ryan; Rodrigo, Ma Mercedes T; Soriano, Jose Carlo; Castro, Maynor Jimenez.

In: International Journal of Artificial Intelligence in Education, Vol. 25, No. 2, 31.03.2015, p. 229-248.

Research output: Contribution to journalArticle

Ogan, Amy ; Walker, Erin ; Baker, Ryan ; Rodrigo, Ma Mercedes T ; Soriano, Jose Carlo ; Castro, Maynor Jimenez. / Towards understanding how to assess help-seeking behavior across cultures. In: International Journal of Artificial Intelligence in Education. 2015 ; Vol. 25, No. 2. pp. 229-248.
@article{de165b77179d430c9781e44cecb5c4c4,
title = "Towards understanding how to assess help-seeking behavior across cultures",
abstract = "In recent years, there has been increasing interest in automatically assessing help seeking, the process of referring to resources outside of oneself to accomplish a task or solve a problem. Research in the United States has shown that specific help-seeking behaviors led to better learning within intelligent tutoring systems. However, intelligent tutors are used differently by students in different countries, raising the question of whether the same help-seeking behaviors are effective and desirable in different cultural settings. To investigate this question, models connecting help-seeking behaviors with learning were generated from datasets from students in three countries - Costa Rica, the Philippines, and the United States, as well as a combined dataset from all three sites. Each model was tested on data from the other countries. This study found that models of effective help seeking transfer to some degree between the United States and Philippines, but not between those countries and Costa Rica. Differences may be explained by variations in classroom practices between the sites; for example, greater collaboration observed in the Costa Rican site indicates that much help seeking occurred outside of the technology. Findings indicate that greater care should be taken when assuming that the models underlying AIED systems generalize across cultures and contexts.",
keywords = "Assessment, Cross-curricular skills, Help seeking, Intelligent tutoring system",
author = "Amy Ogan and Erin Walker and Ryan Baker and Rodrigo, {Ma Mercedes T} and Soriano, {Jose Carlo} and Castro, {Maynor Jimenez}",
year = "2015",
month = "3",
day = "31",
doi = "10.1007/s40593-014-0034-8",
language = "English (US)",
volume = "25",
pages = "229--248",
journal = "International Journal of Artificial Intelligence in Education",
issn = "1560-4292",
publisher = "IOS Press",
number = "2",

}

TY - JOUR

T1 - Towards understanding how to assess help-seeking behavior across cultures

AU - Ogan, Amy

AU - Walker, Erin

AU - Baker, Ryan

AU - Rodrigo, Ma Mercedes T

AU - Soriano, Jose Carlo

AU - Castro, Maynor Jimenez

PY - 2015/3/31

Y1 - 2015/3/31

N2 - In recent years, there has been increasing interest in automatically assessing help seeking, the process of referring to resources outside of oneself to accomplish a task or solve a problem. Research in the United States has shown that specific help-seeking behaviors led to better learning within intelligent tutoring systems. However, intelligent tutors are used differently by students in different countries, raising the question of whether the same help-seeking behaviors are effective and desirable in different cultural settings. To investigate this question, models connecting help-seeking behaviors with learning were generated from datasets from students in three countries - Costa Rica, the Philippines, and the United States, as well as a combined dataset from all three sites. Each model was tested on data from the other countries. This study found that models of effective help seeking transfer to some degree between the United States and Philippines, but not between those countries and Costa Rica. Differences may be explained by variations in classroom practices between the sites; for example, greater collaboration observed in the Costa Rican site indicates that much help seeking occurred outside of the technology. Findings indicate that greater care should be taken when assuming that the models underlying AIED systems generalize across cultures and contexts.

AB - In recent years, there has been increasing interest in automatically assessing help seeking, the process of referring to resources outside of oneself to accomplish a task or solve a problem. Research in the United States has shown that specific help-seeking behaviors led to better learning within intelligent tutoring systems. However, intelligent tutors are used differently by students in different countries, raising the question of whether the same help-seeking behaviors are effective and desirable in different cultural settings. To investigate this question, models connecting help-seeking behaviors with learning were generated from datasets from students in three countries - Costa Rica, the Philippines, and the United States, as well as a combined dataset from all three sites. Each model was tested on data from the other countries. This study found that models of effective help seeking transfer to some degree between the United States and Philippines, but not between those countries and Costa Rica. Differences may be explained by variations in classroom practices between the sites; for example, greater collaboration observed in the Costa Rican site indicates that much help seeking occurred outside of the technology. Findings indicate that greater care should be taken when assuming that the models underlying AIED systems generalize across cultures and contexts.

KW - Assessment

KW - Cross-curricular skills

KW - Help seeking

KW - Intelligent tutoring system

UR - http://www.scopus.com/inward/record.url?scp=84928334830&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84928334830&partnerID=8YFLogxK

U2 - 10.1007/s40593-014-0034-8

DO - 10.1007/s40593-014-0034-8

M3 - Article

VL - 25

SP - 229

EP - 248

JO - International Journal of Artificial Intelligence in Education

JF - International Journal of Artificial Intelligence in Education

SN - 1560-4292

IS - 2

ER -