Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind

Troy McDaniel; Diep Tran; Samjhana Devkota; Kaitlyn DiLorenzo; Bijan Fakhri; Sethuraman Panchanathan

doi:10.1145/3264856.3264860

Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind

Troy McDaniel, Diep Tran, Samjhana Devkota, Kaitlyn DiLorenzo, Bijan Fakhri, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Scopus citations

Abstract

For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

Original language	English (US)
Title of host publication	MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018
Publisher	Association for Computing Machinery, Inc
Pages	25-32
Number of pages	8
ISBN (Electronic)	9781450359801
DOIs	https://doi.org/10.1145/3264856.3264860
State	Published - Oct 15 2018
Event	1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018 - Seoul, Korea, Republic of Duration: Oct 22 2018 → …

Publication series

Name	MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018

Other

Other	1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018
Country/Territory	Korea, Republic of
City	Seoul
Period	10/22/18 → …

Keywords

Assistive technology
Blindness
Haptics
Vibrotactile displays

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design

Access to Document

10.1145/3264856.3264860

Cite this

McDaniel, T., Tran, D., Devkota, S., DiLorenzo, K., Fakhri, B., & Panchanathan, S. (2018). Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. In MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018 (pp. 25-32). (MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018). Association for Computing Machinery, Inc. https://doi.org/10.1145/3264856.3264860

Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. / McDaniel, Troy; Tran, Diep; Devkota, Samjhana et al.
MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc, 2018. p. 25-32 (MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

McDaniel, T, Tran, D, Devkota, S, DiLorenzo, K, Fakhri, B & Panchanathan, S 2018, Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. in MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018, Association for Computing Machinery, Inc, pp. 25-32, 1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018, Seoul, Korea, Republic of, 10/22/18. https://doi.org/10.1145/3264856.3264860

McDaniel T, Tran D, Devkota S, DiLorenzo K, Fakhri B, Panchanathan S. Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. In MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc. 2018. p. 25-32. (MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018). doi: 10.1145/3264856.3264860

McDaniel, Troy ; Tran, Diep ; Devkota, Samjhana et al. / Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc, 2018. pp. 25-32 (MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018).

@inproceedings{f296a58ca3ba4cbe848cd382e4e22b61,

title = "Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind",

abstract = "For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.",

keywords = "Assistive technology, Blindness, Haptics, Vibrotactile displays",

author = "Troy McDaniel and Diep Tran and Samjhana Devkota and Kaitlyn DiLorenzo and Bijan Fakhri and Sethuraman Panchanathan",

note = "Publisher Copyright: {\textcopyright} 2018 Association for Computing Machinery. Copyright: Copyright 2019 Elsevier B.V., All rights reserved.; 1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018 ; Conference date: 22-10-2018",

year = "2018",

month = oct,

day = "15",

doi = "10.1145/3264856.3264860",

language = "English (US)",

series = "MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018",

publisher = "Association for Computing Machinery, Inc",

pages = "25--32",

booktitle = "MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018",

}

TY - GEN

T1 - Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind

AU - McDaniel, Troy

AU - Tran, Diep

AU - Devkota, Samjhana

AU - DiLorenzo, Kaitlyn

AU - Fakhri, Bijan

AU - Panchanathan, Sethuraman

PY - 2018/10/15

Y1 - 2018/10/15

N2 - For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

AB - For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

KW - Assistive technology

KW - Blindness

KW - Haptics

KW - Vibrotactile displays

UR - http://www.scopus.com/inward/record.url?scp=85058296610&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058296610&partnerID=8YFLogxK

U2 - 10.1145/3264856.3264860

DO - 10.1145/3264856.3264860

M3 - Conference contribution

AN - SCOPUS:85058296610

T3 - MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018

SP - 25

EP - 32

BT - MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018

PB - Association for Computing Machinery, Inc

T2 - 1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018

Y2 - 22 October 2018

ER -

Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this