HaptWrap: Augmenting non-visual travel via visual-to-tactile mapping of objects in motion

Bryan Duarte, Troy McDaniel, Abhik Chowdhury, Sana Gill, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Access to real-time situational information at a distance, including the relative position and motion of surrounding objects, is essential for an individual to travel safely and independently. For blind and low vision travelers, access to critical environmental information is unattainable if it is positioned beyond the reach of their preferred mobility aid or outside their path of travel. Due to its cost and versatility, and the dynamic information which can be aggregated through its use, the long white cane remains the most widely used mobility aid for non-visual travelers. Physical characteristics such as texture, slope, and position can be identified with the long white cane, but only when the traveler is within close proximity to an object. In this work, we introduce a wearable technology to augment non-visual travel methods by communicating spatial information at a distance. We propose a vibrotactile device, the HaptWrap, equipped with vibration motors capable of communicating an object's position relative to the user's orientation, as well as its relative variations in position as the object moves about the user. An experiment supports the use of haptics to represent objects in motion around an individual as a substitute modality for vision.

Original languageEnglish (US)
Title of host publicationMAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019
PublisherAssociation for Computing Machinery, Inc
Pages17-24
Number of pages8
ISBN (Electronic)9781450369121
DOIs
StatePublished - Oct 15 2019
Event2nd Workshop on Multimedia for Accessible Human Computer Interfaces, MAHCI 2019, in conjunction with ACM Multimedia 2019 - Nice, France
Duration: Oct 25 2019 → …

Publication series

NameMAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019

Conference

Conference2nd Workshop on Multimedia for Accessible Human Computer Interfaces, MAHCI 2019, in conjunction with ACM Multimedia 2019
CountryFrance
CityNice
Period10/25/19 → …

Fingerprint

Textures
Costs
Experiments
Wearable technology

Keywords

  • Assistive device
  • Haptics
  • Nonvisual travel
  • Vibrotactile display

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction

Cite this

Duarte, B., McDaniel, T., Chowdhury, A., Gill, S., & Panchanathan, S. (2019). HaptWrap: Augmenting non-visual travel via visual-to-tactile mapping of objects in motion. In MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019 (pp. 17-24). (MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019). Association for Computing Machinery, Inc. https://doi.org/10.1145/3347319.3356835

HaptWrap : Augmenting non-visual travel via visual-to-tactile mapping of objects in motion. / Duarte, Bryan; McDaniel, Troy; Chowdhury, Abhik; Gill, Sana; Panchanathan, Sethuraman.

MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019. Association for Computing Machinery, Inc, 2019. p. 17-24 (MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Duarte, B, McDaniel, T, Chowdhury, A, Gill, S & Panchanathan, S 2019, HaptWrap: Augmenting non-visual travel via visual-to-tactile mapping of objects in motion. in MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019. MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019, Association for Computing Machinery, Inc, pp. 17-24, 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, MAHCI 2019, in conjunction with ACM Multimedia 2019, Nice, France, 10/25/19. https://doi.org/10.1145/3347319.3356835
Duarte B, McDaniel T, Chowdhury A, Gill S, Panchanathan S. HaptWrap: Augmenting non-visual travel via visual-to-tactile mapping of objects in motion. In MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019. Association for Computing Machinery, Inc. 2019. p. 17-24. (MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019). https://doi.org/10.1145/3347319.3356835
Duarte, Bryan ; McDaniel, Troy ; Chowdhury, Abhik ; Gill, Sana ; Panchanathan, Sethuraman. / HaptWrap : Augmenting non-visual travel via visual-to-tactile mapping of objects in motion. MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019. Association for Computing Machinery, Inc, 2019. pp. 17-24 (MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019).
@inproceedings{0f87918682a94d5ebc026da1a19d0073,
title = "HaptWrap: Augmenting non-visual travel via visual-to-tactile mapping of objects in motion",
abstract = "Access to real-time situational information at a distance, including the relative position and motion of surrounding objects, is essential for an individual to travel safely and independently. For blind and low vision travelers, access to critical environmental information is unattainable if it is positioned beyond the reach of their preferred mobility aid or outside their path of travel. Due to its cost and versatility, and the dynamic information which can be aggregated through its use, the long white cane remains the most widely used mobility aid for non-visual travelers. Physical characteristics such as texture, slope, and position can be identified with the long white cane, but only when the traveler is within close proximity to an object. In this work, we introduce a wearable technology to augment non-visual travel methods by communicating spatial information at a distance. We propose a vibrotactile device, the HaptWrap, equipped with vibration motors capable of communicating an object's position relative to the user's orientation, as well as its relative variations in position as the object moves about the user. An experiment supports the use of haptics to represent objects in motion around an individual as a substitute modality for vision.",
keywords = "Assistive device, Haptics, Nonvisual travel, Vibrotactile display",
author = "Bryan Duarte and Troy McDaniel and Abhik Chowdhury and Sana Gill and Sethuraman Panchanathan",
year = "2019",
month = "10",
day = "15",
doi = "10.1145/3347319.3356835",
language = "English (US)",
series = "MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019",
publisher = "Association for Computing Machinery, Inc",
pages = "17--24",
booktitle = "MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019",

}

TY - GEN

T1 - HaptWrap

T2 - Augmenting non-visual travel via visual-to-tactile mapping of objects in motion

AU - Duarte, Bryan

AU - McDaniel, Troy

AU - Chowdhury, Abhik

AU - Gill, Sana

AU - Panchanathan, Sethuraman

PY - 2019/10/15

Y1 - 2019/10/15

N2 - Access to real-time situational information at a distance, including the relative position and motion of surrounding objects, is essential for an individual to travel safely and independently. For blind and low vision travelers, access to critical environmental information is unattainable if it is positioned beyond the reach of their preferred mobility aid or outside their path of travel. Due to its cost and versatility, and the dynamic information which can be aggregated through its use, the long white cane remains the most widely used mobility aid for non-visual travelers. Physical characteristics such as texture, slope, and position can be identified with the long white cane, but only when the traveler is within close proximity to an object. In this work, we introduce a wearable technology to augment non-visual travel methods by communicating spatial information at a distance. We propose a vibrotactile device, the HaptWrap, equipped with vibration motors capable of communicating an object's position relative to the user's orientation, as well as its relative variations in position as the object moves about the user. An experiment supports the use of haptics to represent objects in motion around an individual as a substitute modality for vision.

AB - Access to real-time situational information at a distance, including the relative position and motion of surrounding objects, is essential for an individual to travel safely and independently. For blind and low vision travelers, access to critical environmental information is unattainable if it is positioned beyond the reach of their preferred mobility aid or outside their path of travel. Due to its cost and versatility, and the dynamic information which can be aggregated through its use, the long white cane remains the most widely used mobility aid for non-visual travelers. Physical characteristics such as texture, slope, and position can be identified with the long white cane, but only when the traveler is within close proximity to an object. In this work, we introduce a wearable technology to augment non-visual travel methods by communicating spatial information at a distance. We propose a vibrotactile device, the HaptWrap, equipped with vibration motors capable of communicating an object's position relative to the user's orientation, as well as its relative variations in position as the object moves about the user. An experiment supports the use of haptics to represent objects in motion around an individual as a substitute modality for vision.

KW - Assistive device

KW - Haptics

KW - Nonvisual travel

KW - Vibrotactile display

UR - http://www.scopus.com/inward/record.url?scp=85075130316&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85075130316&partnerID=8YFLogxK

U2 - 10.1145/3347319.3356835

DO - 10.1145/3347319.3356835

M3 - Conference contribution

AN - SCOPUS:85075130316

T3 - MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019

SP - 17

EP - 24

BT - MAHCI 2019 - Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer Interfaces, co-located with MM 2019

PB - Association for Computing Machinery, Inc

ER -