Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind

Shamima Yasmin; Sethuraman Panchanathan

doi:10.1145/3013971.3013999

Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind

Shamima Yasmin, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Scopus citations

Abstract

To people who are visually impaired, sensory substitution requires conversion from distal visual data to proximal haptic cue. The challenge is to identify the optimum haptic cues that will make a common haptic "language", which can eventually be used to convey information about facial expressions to the individuals who are blind. Once this language has been developed, the next challenge is learning and training. We propose a dynamic haptic tool for simultaneous learning and interaction with a proposed haptic language. We call this application "Haptic mirror", an interactive haptic-based reflection of one's self which can be comparable to a visual mirror. Once the user has acquired this language, it can be used to convey the facial expressions of social peers.

Original language	English (US)
Title of host publication	Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
Publisher	Association for Computing Machinery, Inc
Pages	319-329
Number of pages	11
Volume	1
ISBN (Electronic)	9781450346924
DOIs	https://doi.org/10.1145/3013971.3013999
State	Published - Dec 3 2016
Event	15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016 - Zhuhai, China Duration: Dec 3 2016 → Dec 4 2016

Other

Other	15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016
Country/Territory	China
City	Zhuhai
Period	12/3/16 → 12/4/16

Keywords

Blind
Face exploration
Facial feature
Haptic cue

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Computer Graphics and Computer-Aided Design
Computer Vision and Pattern Recognition

Access to Document

10.1145/3013971.3013999

Cite this

Yasmin, S., & Panchanathan, S. (2016). Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind. In Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry (Vol. 1, pp. 319-329). Association for Computing Machinery, Inc. https://doi.org/10.1145/3013971.3013999

Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind. / Yasmin, Shamima; Panchanathan, Sethuraman.
Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry. Vol. 1 Association for Computing Machinery, Inc, 2016. p. 319-329.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Yasmin, S & Panchanathan, S 2016, Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind. in Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry. vol. 1, Association for Computing Machinery, Inc, pp. 319-329, 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016, Zhuhai, China, 12/3/16. https://doi.org/10.1145/3013971.3013999

@inproceedings{b9b9480f27c24be483d38a47424233d2,

title = "Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind",

abstract = "To people who are visually impaired, sensory substitution requires conversion from distal visual data to proximal haptic cue. The challenge is to identify the optimum haptic cues that will make a common haptic {"}language{"}, which can eventually be used to convey information about facial expressions to the individuals who are blind. Once this language has been developed, the next challenge is learning and training. We propose a dynamic haptic tool for simultaneous learning and interaction with a proposed haptic language. We call this application {"}Haptic mirror{"}, an interactive haptic-based reflection of one's self which can be comparable to a visual mirror. Once the user has acquired this language, it can be used to convey the facial expressions of social peers.",

keywords = "Blind, Face exploration, Facial feature, Haptic cue",

author = "Shamima Yasmin and Sethuraman Panchanathan",

year = "2016",

month = dec,

day = "3",

doi = "10.1145/3013971.3013999",

language = "English (US)",

volume = "1",

pages = "319--329",

booktitle = "Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry",

publisher = "Association for Computing Machinery, Inc",

note = "15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016 ; Conference date: 03-12-2016 Through 04-12-2016",

}

TY - GEN

T1 - Haptic Mirror

T2 - 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016

AU - Yasmin, Shamima

AU - Panchanathan, Sethuraman

PY - 2016/12/3

Y1 - 2016/12/3

N2 - To people who are visually impaired, sensory substitution requires conversion from distal visual data to proximal haptic cue. The challenge is to identify the optimum haptic cues that will make a common haptic "language", which can eventually be used to convey information about facial expressions to the individuals who are blind. Once this language has been developed, the next challenge is learning and training. We propose a dynamic haptic tool for simultaneous learning and interaction with a proposed haptic language. We call this application "Haptic mirror", an interactive haptic-based reflection of one's self which can be comparable to a visual mirror. Once the user has acquired this language, it can be used to convey the facial expressions of social peers.

AB - To people who are visually impaired, sensory substitution requires conversion from distal visual data to proximal haptic cue. The challenge is to identify the optimum haptic cues that will make a common haptic "language", which can eventually be used to convey information about facial expressions to the individuals who are blind. Once this language has been developed, the next challenge is learning and training. We propose a dynamic haptic tool for simultaneous learning and interaction with a proposed haptic language. We call this application "Haptic mirror", an interactive haptic-based reflection of one's self which can be comparable to a visual mirror. Once the user has acquired this language, it can be used to convey the facial expressions of social peers.

KW - Blind

KW - Face exploration

KW - Facial feature

KW - Haptic cue

UR - http://www.scopus.com/inward/record.url?scp=85009727198&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009727198&partnerID=8YFLogxK

U2 - 10.1145/3013971.3013999

DO - 10.1145/3013971.3013999

M3 - Conference contribution

AN - SCOPUS:85009727198

VL - 1

SP - 319

EP - 329

BT - Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry

PB - Association for Computing Machinery, Inc

Y2 - 3 December 2016 through 4 December 2016

ER -

Haptic Mirror: A platform for active exploration of facial expressions and social interaction by individuals who are blind

Abstract

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this