Abstract

For individuals who are blind, much of social interactions are inaccessible: The majority of information exchanged is nonverbal, e.g., facial expressions and body language. Little work has been done toward building social assistive aids for individuals who are blind. This work presents a mapping between facial action units and vibrotactile representations that may be presented through haptic displays. We present a study exploring how well individuals who are blind can learn to recognize universal emotions of happy, sad, surprise, anger, fear and disgust from vibrotactile facial action units. Results show promising recognition accuracy and subjective feedback, demonstrating that individuals who are blind can learn to understand the emotional content of facial movements presented through vibrations.

Original languageEnglish (US)
Title of host publicationMAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018
PublisherAssociation for Computing Machinery, Inc
Pages25-32
Number of pages8
ISBN (Electronic)9781450359801
DOIs
StatePublished - Oct 15 2018
Event1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018 - Seoul, Korea, Republic of
Duration: Oct 22 2018 → …

Other

Other1st Workshop on Multimedia for Accessible Human Computer Interface, MAHCI 2018, in conjunction with ACM Multimedia, MM 2018
CountryKorea, Republic of
CitySeoul
Period10/22/18 → …

Keywords

  • Assistive technology
  • Blindness
  • Haptics
  • Vibrotactile displays

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind'. Together they form a unique fingerprint.

  • Cite this

    McDaniel, T., Tran, D., Devkota, S., DiLorenzo, K., Fakhri, B., & Panchanathan, S. (2018). Tactile facial expressions and associated emotions toward accessible social interactions for individuals who are blind. In MAHCI 2018 - Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface, co-located with MM 2018 (pp. 25-32). Association for Computing Machinery, Inc. https://doi.org/10.1145/3264856.3264860