Visual-to-tactile mapping of facial movements for enriched social interactions

Shantanu Bala, Troy McDaniel, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Citations (Scopus)

Abstract

This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.

Original languageEnglish (US)
Title of host publication2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages82-87
Number of pages6
ISBN (Electronic)9781479959631
DOIs
StatePublished - Nov 12 2014
Event2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Richardson, United States
Duration: Oct 10 2014 → Oct 11 2014

Other

Other2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014
CountryUnited States
CityRichardson
Period10/10/14 → 10/11/14

Fingerprint

Haptic interfaces
Conveying

Keywords

  • Affective haptics
  • Assistive technology
  • Bilateral interpersonal interaction
  • Facial expressions
  • Social assistive aids
  • Vibrotactile stimulation

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Cite this

Bala, S., McDaniel, T., & Panchanathan, S. (2014). Visual-to-tactile mapping of facial movements for enriched social interactions. In 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings (pp. 82-87). [6954336] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/HAVE.2014.6954336

Visual-to-tactile mapping of facial movements for enriched social interactions. / Bala, Shantanu; McDaniel, Troy; Panchanathan, Sethuraman.

2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. p. 82-87 6954336.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Bala, S, McDaniel, T & Panchanathan, S 2014, Visual-to-tactile mapping of facial movements for enriched social interactions. in 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings., 6954336, Institute of Electrical and Electronics Engineers Inc., pp. 82-87, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014, Richardson, United States, 10/10/14. https://doi.org/10.1109/HAVE.2014.6954336
Bala S, McDaniel T, Panchanathan S. Visual-to-tactile mapping of facial movements for enriched social interactions. In 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2014. p. 82-87. 6954336 https://doi.org/10.1109/HAVE.2014.6954336
Bala, Shantanu ; McDaniel, Troy ; Panchanathan, Sethuraman. / Visual-to-tactile mapping of facial movements for enriched social interactions. 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 82-87
@inproceedings{ab03274fe4044f0d93212386f9b51938,
title = "Visual-to-tactile mapping of facial movements for enriched social interactions",
abstract = "This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.",
keywords = "Affective haptics, Assistive technology, Bilateral interpersonal interaction, Facial expressions, Social assistive aids, Vibrotactile stimulation",
author = "Shantanu Bala and Troy McDaniel and Sethuraman Panchanathan",
year = "2014",
month = "11",
day = "12",
doi = "10.1109/HAVE.2014.6954336",
language = "English (US)",
pages = "82--87",
booktitle = "2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - Visual-to-tactile mapping of facial movements for enriched social interactions

AU - Bala, Shantanu

AU - McDaniel, Troy

AU - Panchanathan, Sethuraman

PY - 2014/11/12

Y1 - 2014/11/12

N2 - This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.

AB - This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.

KW - Affective haptics

KW - Assistive technology

KW - Bilateral interpersonal interaction

KW - Facial expressions

KW - Social assistive aids

KW - Vibrotactile stimulation

UR - http://www.scopus.com/inward/record.url?scp=84915789624&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84915789624&partnerID=8YFLogxK

U2 - 10.1109/HAVE.2014.6954336

DO - 10.1109/HAVE.2014.6954336

M3 - Conference contribution

AN - SCOPUS:84915789624

SP - 82

EP - 87

BT - 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Access to Document