Abstract

For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

Original languageEnglish (US)
Title of host publicationMAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018
PublisherAssociation for Computing Machinery, Inc
Pages25-32
Number of pages8
ISBN (Electronic)9781450359801
DOIs
StatePublished - Oct 15 2018
Event1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018 - Seoul, Korea, Republic of
Duration: Oct 22 2018 → …

Other

Other1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018
CountryKorea, Republic of
CitySeoul
Period10/22/18 → …

Fingerprint

Display devices
Feedback

Keywords

  • Assistive technology
  • Blindness
  • Haptics
  • Vibrotactile displays

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Cite this

McDaniel, T., Tran, D., Devkota, S., DiLorenzo, K., Fakhri, B., & Panchanathan, S. (2018). Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. In MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018 (pp. 25-32). Association for Computing Machinery, Inc. https://doi.org/10.1145/3264856.3264860

Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. / McDaniel, Troy; Tran, Diep; Devkota, Samjhana; DiLorenzo, Kaitlyn; Fakhri, Bijan; Panchanathan, Sethuraman.

MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc, 2018. p. 25-32.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

McDaniel, T, Tran, D, Devkota, S, DiLorenzo, K, Fakhri, B & Panchanathan, S 2018, Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. in MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc, pp. 25-32, 1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018, Seoul, Korea, Republic of, 10/22/18. https://doi.org/10.1145/3264856.3264860
McDaniel T, Tran D, Devkota S, DiLorenzo K, Fakhri B, Panchanathan S. Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. In MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc. 2018. p. 25-32 https://doi.org/10.1145/3264856.3264860
McDaniel, Troy ; Tran, Diep ; Devkota, Samjhana ; DiLorenzo, Kaitlyn ; Fakhri, Bijan ; Panchanathan, Sethuraman. / Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018. Association for Computing Machinery, Inc, 2018. pp. 25-32
@inproceedings{f296a58ca3ba4cbe848cd382e4e22b61,
title = "Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind",
abstract = "For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.",
keywords = "Assistive technology, Blindness, Haptics, Vibrotactile displays",
author = "Troy McDaniel and Diep Tran and Samjhana Devkota and Kaitlyn DiLorenzo and Bijan Fakhri and Sethuraman Panchanathan",
year = "2018",
month = "10",
day = "15",
doi = "10.1145/3264856.3264860",
language = "English (US)",
pages = "25--32",
booktitle = "MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind

AU - McDaniel, Troy

AU - Tran, Diep

AU - Devkota, Samjhana

AU - DiLorenzo, Kaitlyn

AU - Fakhri, Bijan

AU - Panchanathan, Sethuraman

PY - 2018/10/15

Y1 - 2018/10/15

N2 - For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

AB - For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

KW - Assistive technology

KW - Blindness

KW - Haptics

KW - Vibrotactile displays

UR - http://www.scopus.com/inward/record.url?scp=85058296610&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058296610&partnerID=8YFLogxK

U2 - 10.1145/3264856.3264860

DO - 10.1145/3264856.3264860

M3 - Conference contribution

SP - 25

EP - 32

BT - MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018

PB - Association for Computing Machinery, Inc

ER -