Visual-to-tactile mapping of facial movements for enriched social interactions

Shantanu Bala; Troy McDaniel; Sethuraman Panchanathan

doi:10.1109/HAVE.2014.6954336

Visual-to-tactile mapping of facial movements for enriched social interactions

Shantanu Bala, Troy McDaniel, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

15 Scopus citations

Abstract

This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.

Original language	English (US)
Title of host publication	2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	82-87
Number of pages	6
ISBN (Electronic)	9781479959631
DOIs	https://doi.org/10.1109/HAVE.2014.6954336
State	Published - Nov 12 2014
Event	2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Richardson, United States Duration: Oct 10 2014 → Oct 11 2014

Publication series

Name	2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings

Other

Other	2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014
Country/Territory	United States
City	Richardson
Period	10/10/14 → 10/11/14

Keywords

Affective haptics
Assistive technology
Bilateral interpersonal interaction
Facial expressions
Social assistive aids
Vibrotactile stimulation

ASJC Scopus subject areas

Computer Networks and Communications
Computer Vision and Pattern Recognition
Human-Computer Interaction

Access to Document

10.1109/HAVE.2014.6954336

Cite this

Bala, S., McDaniel, T., & Panchanathan, S. (2014). Visual-to-tactile mapping of facial movements for enriched social interactions. In 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings (pp. 82-87). [6954336] (2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/HAVE.2014.6954336

Visual-to-tactile mapping of facial movements for enriched social interactions. / Bala, Shantanu; McDaniel, Troy ; Panchanathan, Sethuraman.

2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. p. 82-87 6954336 (2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Bala, S, McDaniel, T & Panchanathan, S 2014, Visual-to-tactile mapping of facial movements for enriched social interactions. in 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings., 6954336, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 82-87, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014, Richardson, United States, 10/10/14. https://doi.org/10.1109/HAVE.2014.6954336

Bala S, McDaniel T , Panchanathan S. Visual-to-tactile mapping of facial movements for enriched social interactions. In 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2014. p. 82-87. 6954336. (2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings). doi: 10.1109/HAVE.2014.6954336

Bala, Shantanu ; McDaniel, Troy ; Panchanathan, Sethuraman. / Visual-to-tactile mapping of facial movements for enriched social interactions. 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 82-87 (2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings).

@inproceedings{ab03274fe4044f0d93212386f9b51938,

title = "Visual-to-tactile mapping of facial movements for enriched social interactions",

abstract = "This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.",

keywords = "Affective haptics, Assistive technology, Bilateral interpersonal interaction, Facial expressions, Social assistive aids, Vibrotactile stimulation",

author = "Shantanu Bala and Troy McDaniel and Sethuraman Panchanathan",

note = "Publisher Copyright: {\textcopyright} 2014 IEEE.; 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 ; Conference date: 10-10-2014 Through 11-10-2014",

year = "2014",

month = nov,

day = "12",

doi = "10.1109/HAVE.2014.6954336",

language = "English (US)",

series = "2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "82--87",

booktitle = "2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings",

}

TY - GEN

T1 - Visual-to-tactile mapping of facial movements for enriched social interactions

AU - Bala, Shantanu

AU - McDaniel, Troy

AU - Panchanathan, Sethuraman

PY - 2014/11/12

Y1 - 2014/11/12

N2 - This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.

AB - This paper presents a haptic interface for augmenting human-human interpersonal interactions by delivering facial expressions of an interaction partner to an individual using a visual-to-tactile mapping of facial action units. Pancake shaftless vibration motors are mounted on the back of a chair to provide vibrotactile stimulation in the context of a dyadic (one-on-one) interaction across a table. This work explores the design of spatiotemporal vibration patterns that can be used to convey the basic building blocks of facial movements according to the Facial Action Unit Coding System. A behavioral study was conducted to explore the factors that influence the naturalness of conveying affect using vibrotactile cues.

KW - Affective haptics

KW - Assistive technology

KW - Bilateral interpersonal interaction

KW - Facial expressions

KW - Social assistive aids

KW - Vibrotactile stimulation

UR - http://www.scopus.com/inward/record.url?scp=84915789624&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84915789624&partnerID=8YFLogxK

U2 - 10.1109/HAVE.2014.6954336

DO - 10.1109/HAVE.2014.6954336

M3 - Conference contribution

AN - SCOPUS:84915789624

T3 - 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings

SP - 82

EP - 87

BT - 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2014

Y2 - 10 October 2014 through 11 October 2014

ER -

Visual-to-tactile mapping of facial movements for enriched social interactions

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this