A preliminary evaluation of the usability of an ai-infused orchestration system

Jon Wetzel, Hugh Burkhardt, Salman Cheema, Seokmin Kang, Daniel Pead, Alan Schoenfeld, Kurt VanLehn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Artificial intelligence (AI) holds great promise for improving classroom orchestration—the teacher’s management of a classroom workflow that mixes small group, individual, and whole class activities. Although we have developed an orchestration system, named FACT, that uses AI, we were concerned that usability issues might decrease its effectiveness. We conducted an analysis of classroom video recordings that classified and compared the time FACT students spent to the time spent by students using paper versions of the same lessons. FACT wasted half the time that paper did. However FACT students spent slightly more time off task and had difficulties referring to objects on shared documents.

Original languageEnglish (US)
Title of host publicationArtificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings
PublisherSpringer Verlag
Pages379-383
Number of pages5
ISBN (Print)9783319938455
DOIs
StatePublished - Jan 1 2018
Event19th International Conference on Artificial Intelligence in Education, AIED 2018 - London, United Kingdom
Duration: Jun 27 2018Jun 30 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10948 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other19th International Conference on Artificial Intelligence in Education, AIED 2018
CountryUnited Kingdom
CityLondon
Period6/27/186/30/18

Fingerprint

Orchestration
Usability
Students
Artificial intelligence
Evaluation
Artificial Intelligence
Video recording
Work Flow
Decrease

Keywords

  • Digital media
  • Orchestration
  • Usability

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Wetzel, J., Burkhardt, H., Cheema, S., Kang, S., Pead, D., Schoenfeld, A., & VanLehn, K. (2018). A preliminary evaluation of the usability of an ai-infused orchestration system. In Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings (pp. 379-383). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10948 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-93846-2_71

A preliminary evaluation of the usability of an ai-infused orchestration system. / Wetzel, Jon; Burkhardt, Hugh; Cheema, Salman; Kang, Seokmin; Pead, Daniel; Schoenfeld, Alan; VanLehn, Kurt.

Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings. Springer Verlag, 2018. p. 379-383 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10948 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Wetzel, J, Burkhardt, H, Cheema, S, Kang, S, Pead, D, Schoenfeld, A & VanLehn, K 2018, A preliminary evaluation of the usability of an ai-infused orchestration system. in Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10948 LNAI, Springer Verlag, pp. 379-383, 19th International Conference on Artificial Intelligence in Education, AIED 2018, London, United Kingdom, 6/27/18. https://doi.org/10.1007/978-3-319-93846-2_71
Wetzel J, Burkhardt H, Cheema S, Kang S, Pead D, Schoenfeld A et al. A preliminary evaluation of the usability of an ai-infused orchestration system. In Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings. Springer Verlag. 2018. p. 379-383. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-93846-2_71
Wetzel, Jon ; Burkhardt, Hugh ; Cheema, Salman ; Kang, Seokmin ; Pead, Daniel ; Schoenfeld, Alan ; VanLehn, Kurt. / A preliminary evaluation of the usability of an ai-infused orchestration system. Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings. Springer Verlag, 2018. pp. 379-383 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{e31df8b03be14fa7ba7f3aa6b6696f1a,
title = "A preliminary evaluation of the usability of an ai-infused orchestration system",
abstract = "Artificial intelligence (AI) holds great promise for improving classroom orchestration—the teacher’s management of a classroom workflow that mixes small group, individual, and whole class activities. Although we have developed an orchestration system, named FACT, that uses AI, we were concerned that usability issues might decrease its effectiveness. We conducted an analysis of classroom video recordings that classified and compared the time FACT students spent to the time spent by students using paper versions of the same lessons. FACT wasted half the time that paper did. However FACT students spent slightly more time off task and had difficulties referring to objects on shared documents.",
keywords = "Digital media, Orchestration, Usability",
author = "Jon Wetzel and Hugh Burkhardt and Salman Cheema and Seokmin Kang and Daniel Pead and Alan Schoenfeld and Kurt VanLehn",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-319-93846-2_71",
language = "English (US)",
isbn = "9783319938455",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "379--383",
booktitle = "Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings",

}

TY - GEN

T1 - A preliminary evaluation of the usability of an ai-infused orchestration system

AU - Wetzel, Jon

AU - Burkhardt, Hugh

AU - Cheema, Salman

AU - Kang, Seokmin

AU - Pead, Daniel

AU - Schoenfeld, Alan

AU - VanLehn, Kurt

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Artificial intelligence (AI) holds great promise for improving classroom orchestration—the teacher’s management of a classroom workflow that mixes small group, individual, and whole class activities. Although we have developed an orchestration system, named FACT, that uses AI, we were concerned that usability issues might decrease its effectiveness. We conducted an analysis of classroom video recordings that classified and compared the time FACT students spent to the time spent by students using paper versions of the same lessons. FACT wasted half the time that paper did. However FACT students spent slightly more time off task and had difficulties referring to objects on shared documents.

AB - Artificial intelligence (AI) holds great promise for improving classroom orchestration—the teacher’s management of a classroom workflow that mixes small group, individual, and whole class activities. Although we have developed an orchestration system, named FACT, that uses AI, we were concerned that usability issues might decrease its effectiveness. We conducted an analysis of classroom video recordings that classified and compared the time FACT students spent to the time spent by students using paper versions of the same lessons. FACT wasted half the time that paper did. However FACT students spent slightly more time off task and had difficulties referring to objects on shared documents.

KW - Digital media

KW - Orchestration

KW - Usability

UR - http://www.scopus.com/inward/record.url?scp=85049367022&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049367022&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-93846-2_71

DO - 10.1007/978-3-319-93846-2_71

M3 - Conference contribution

SN - 9783319938455

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 379

EP - 383

BT - Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings

PB - Springer Verlag

ER -