Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment

Kai Tu, Harvey Thornburg, Ellen Campana, David Birchfield, Matthew Fulmer, Andreas Spanias

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

The mixed-reality environment, or hybrid physical-digital space, is an emerging human-computer interaction paradigm with great potential to support constructive learning in everyday settings as a complement to traditional classroom methods. Key advantages over screen-based media and immersive (virtual-reality) environments include a) dynamic, multimodal feedback, which engages diverse learning styles through multiple modes of representation; b) affordance of unencumbered, full-body movement, which enables interactions to be physically embodied; and c) physical continuity with the classroom, which fosters informal collaborative and social interactions. For this potential to be realized, however, we must address significant challenges in interaction design. We must develop modes of interaction which are implicitly learnable, which afford full-body movement, and which are cognitively well adapted to large physical spaces. Furthermore, we must create a mechanism by which students can reflect on what they have "constructed" through interacting with the space, so that implicit learning can be leveraged in the interest of explicit understanding. To these ends, we have developed a novel interaction paradigm based around 3D path shape qualities: straight, curved, random, and stop, which describe motion of an illuminated object (glowball) guided by the participant through the space. We infer these qualities in real-time (online) and also offline using a robust Bayesian framework operating on a low-cost, non-intrusive video sensing apparatus. Online inference drives the interaction and offline segmentation the post-interaction display, our mechanism for reflection where segmentation results are mapped onto a physical trace of the participant.s motion. An informal study a) validates the implicit learnability of straight, curved, and stop mappings based on shape quality controls, and b) highlights the comparative advantage of the postinteraction display for all mappings, when subjects are asked to identify the actions responsible for specific target outcomes.

Original languageEnglish (US)
Title of host publicationProceedings of the ACM International Multimedia Conference and Exhibition
Pages37-46
Number of pages10
DOIs
StatePublished - 2007
Externally publishedYes
EventInternational Multimedia Conference, MM'07 - ACM Workshop on Educational Multimedia and Multimedia Education, EMME 2007 - Augsburg, Bavaria, Germany
Duration: Sep 28 2007Sep 28 2007

Other

OtherInternational Multimedia Conference, MM'07 - ACM Workshop on Educational Multimedia and Multimedia Education, EMME 2007
CountryGermany
CityAugsburg, Bavaria
Period9/28/079/28/07

Fingerprint

Display devices
Human computer interaction
Virtual reality
Quality control
Students
Feedback
Costs

Keywords

  • Hybrid physical-digital space
  • Mediated constructive learning
  • Motion quality analysis

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Tu, K., Thornburg, H., Campana, E., Birchfield, D., Fulmer, M., & Spanias, A. (2007). Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment. In Proceedings of the ACM International Multimedia Conference and Exhibition (pp. 37-46) https://doi.org/10.1145/1290144.1290152

Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment. / Tu, Kai; Thornburg, Harvey; Campana, Ellen; Birchfield, David; Fulmer, Matthew; Spanias, Andreas.

Proceedings of the ACM International Multimedia Conference and Exhibition. 2007. p. 37-46.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tu, K, Thornburg, H, Campana, E, Birchfield, D, Fulmer, M & Spanias, A 2007, Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment. in Proceedings of the ACM International Multimedia Conference and Exhibition. pp. 37-46, International Multimedia Conference, MM'07 - ACM Workshop on Educational Multimedia and Multimedia Education, EMME 2007, Augsburg, Bavaria, Germany, 9/28/07. https://doi.org/10.1145/1290144.1290152
Tu K, Thornburg H, Campana E, Birchfield D, Fulmer M, Spanias A. Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment. In Proceedings of the ACM International Multimedia Conference and Exhibition. 2007. p. 37-46 https://doi.org/10.1145/1290144.1290152
Tu, Kai ; Thornburg, Harvey ; Campana, Ellen ; Birchfield, David ; Fulmer, Matthew ; Spanias, Andreas. / Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment. Proceedings of the ACM International Multimedia Conference and Exhibition. 2007. pp. 37-46
@inproceedings{f11ba6b4c2384965a85306d1bbea7ffa,
title = "Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment",
abstract = "The mixed-reality environment, or hybrid physical-digital space, is an emerging human-computer interaction paradigm with great potential to support constructive learning in everyday settings as a complement to traditional classroom methods. Key advantages over screen-based media and immersive (virtual-reality) environments include a) dynamic, multimodal feedback, which engages diverse learning styles through multiple modes of representation; b) affordance of unencumbered, full-body movement, which enables interactions to be physically embodied; and c) physical continuity with the classroom, which fosters informal collaborative and social interactions. For this potential to be realized, however, we must address significant challenges in interaction design. We must develop modes of interaction which are implicitly learnable, which afford full-body movement, and which are cognitively well adapted to large physical spaces. Furthermore, we must create a mechanism by which students can reflect on what they have {"}constructed{"} through interacting with the space, so that implicit learning can be leveraged in the interest of explicit understanding. To these ends, we have developed a novel interaction paradigm based around 3D path shape qualities: straight, curved, random, and stop, which describe motion of an illuminated object (glowball) guided by the participant through the space. We infer these qualities in real-time (online) and also offline using a robust Bayesian framework operating on a low-cost, non-intrusive video sensing apparatus. Online inference drives the interaction and offline segmentation the post-interaction display, our mechanism for reflection where segmentation results are mapped onto a physical trace of the participant.s motion. An informal study a) validates the implicit learnability of straight, curved, and stop mappings based on shape quality controls, and b) highlights the comparative advantage of the postinteraction display for all mappings, when subjects are asked to identify the actions responsible for specific target outcomes.",
keywords = "Hybrid physical-digital space, Mediated constructive learning, Motion quality analysis",
author = "Kai Tu and Harvey Thornburg and Ellen Campana and David Birchfield and Matthew Fulmer and Andreas Spanias",
year = "2007",
doi = "10.1145/1290144.1290152",
language = "English (US)",
isbn = "9781595937834",
pages = "37--46",
booktitle = "Proceedings of the ACM International Multimedia Conference and Exhibition",

}

TY - GEN

T1 - Interaction and reflection via 3D path shape qualities in a mediated constructive learning environment

AU - Tu, Kai

AU - Thornburg, Harvey

AU - Campana, Ellen

AU - Birchfield, David

AU - Fulmer, Matthew

AU - Spanias, Andreas

PY - 2007

Y1 - 2007

N2 - The mixed-reality environment, or hybrid physical-digital space, is an emerging human-computer interaction paradigm with great potential to support constructive learning in everyday settings as a complement to traditional classroom methods. Key advantages over screen-based media and immersive (virtual-reality) environments include a) dynamic, multimodal feedback, which engages diverse learning styles through multiple modes of representation; b) affordance of unencumbered, full-body movement, which enables interactions to be physically embodied; and c) physical continuity with the classroom, which fosters informal collaborative and social interactions. For this potential to be realized, however, we must address significant challenges in interaction design. We must develop modes of interaction which are implicitly learnable, which afford full-body movement, and which are cognitively well adapted to large physical spaces. Furthermore, we must create a mechanism by which students can reflect on what they have "constructed" through interacting with the space, so that implicit learning can be leveraged in the interest of explicit understanding. To these ends, we have developed a novel interaction paradigm based around 3D path shape qualities: straight, curved, random, and stop, which describe motion of an illuminated object (glowball) guided by the participant through the space. We infer these qualities in real-time (online) and also offline using a robust Bayesian framework operating on a low-cost, non-intrusive video sensing apparatus. Online inference drives the interaction and offline segmentation the post-interaction display, our mechanism for reflection where segmentation results are mapped onto a physical trace of the participant.s motion. An informal study a) validates the implicit learnability of straight, curved, and stop mappings based on shape quality controls, and b) highlights the comparative advantage of the postinteraction display for all mappings, when subjects are asked to identify the actions responsible for specific target outcomes.

AB - The mixed-reality environment, or hybrid physical-digital space, is an emerging human-computer interaction paradigm with great potential to support constructive learning in everyday settings as a complement to traditional classroom methods. Key advantages over screen-based media and immersive (virtual-reality) environments include a) dynamic, multimodal feedback, which engages diverse learning styles through multiple modes of representation; b) affordance of unencumbered, full-body movement, which enables interactions to be physically embodied; and c) physical continuity with the classroom, which fosters informal collaborative and social interactions. For this potential to be realized, however, we must address significant challenges in interaction design. We must develop modes of interaction which are implicitly learnable, which afford full-body movement, and which are cognitively well adapted to large physical spaces. Furthermore, we must create a mechanism by which students can reflect on what they have "constructed" through interacting with the space, so that implicit learning can be leveraged in the interest of explicit understanding. To these ends, we have developed a novel interaction paradigm based around 3D path shape qualities: straight, curved, random, and stop, which describe motion of an illuminated object (glowball) guided by the participant through the space. We infer these qualities in real-time (online) and also offline using a robust Bayesian framework operating on a low-cost, non-intrusive video sensing apparatus. Online inference drives the interaction and offline segmentation the post-interaction display, our mechanism for reflection where segmentation results are mapped onto a physical trace of the participant.s motion. An informal study a) validates the implicit learnability of straight, curved, and stop mappings based on shape quality controls, and b) highlights the comparative advantage of the postinteraction display for all mappings, when subjects are asked to identify the actions responsible for specific target outcomes.

KW - Hybrid physical-digital space

KW - Mediated constructive learning

KW - Motion quality analysis

UR - http://www.scopus.com/inward/record.url?scp=37848999406&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37848999406&partnerID=8YFLogxK

U2 - 10.1145/1290144.1290152

DO - 10.1145/1290144.1290152

M3 - Conference contribution

SN - 9781595937834

SP - 37

EP - 46

BT - Proceedings of the ACM International Multimedia Conference and Exhibition

ER -