Abstract

This paper proposes a methodology to enhance audio described movies (i.e., films augmented with additional narration to explain visual content to viewers who are blind or visually impaired) by providing positional information of on-screen actors through haptics. Using a vibrotactile belt, we map the location of a character across the screen to a relative location around the waist, and the relative distance of a character from the camera is mapped to a tactile rhythm. Character movement is subsequently conveyed through these two dimensions. All participants, including one visually impaired subject, felt the vibrations improved their visualization of the clips. This subject also felt that it was quite easy to combine the information received through audio and haptics, and that the vibrations were not obstructing the subject's attention to audio.

Original languageEnglish (US)
Title of host publicationHCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings
Pages414-418
Number of pages5
Volume173 CCIS
EditionPART 1
DOIs
StatePublished - 2011
Event14th International Conference on Human-Computer Interaction, HCI International 2011 - Orlando, FL, United States
Duration: Jul 9 2011Jul 14 2011

Publication series

NameCommunications in Computer and Information Science
NumberPART 1
Volume173 CCIS
ISSN (Print)18650929

Other

Other14th International Conference on Human-Computer Interaction, HCI International 2011
CountryUnited States
CityOrlando, FL
Period7/9/117/14/11

Fingerprint

Visualization
Cameras

Keywords

  • assistive technology
  • Audio description
  • described audio
  • descriptive video service
  • haptics
  • movies
  • tactile icons
  • tactons
  • vibrotactile belt
  • video description

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Viswanathan, L. N., McDaniel, T., & Panchanathan, S. (2011). Audio-haptic description in movies. In HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings (PART 1 ed., Vol. 173 CCIS, pp. 414-418). (Communications in Computer and Information Science; Vol. 173 CCIS, No. PART 1). https://doi.org/10.1007/978-3-642-22098-2_83

Audio-haptic description in movies. / Viswanathan, Lakshmie Narayan; McDaniel, Troy; Panchanathan, Sethuraman.

HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings. Vol. 173 CCIS PART 1. ed. 2011. p. 414-418 (Communications in Computer and Information Science; Vol. 173 CCIS, No. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Viswanathan, LN, McDaniel, T & Panchanathan, S 2011, Audio-haptic description in movies. in HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings. PART 1 edn, vol. 173 CCIS, Communications in Computer and Information Science, no. PART 1, vol. 173 CCIS, pp. 414-418, 14th International Conference on Human-Computer Interaction, HCI International 2011, Orlando, FL, United States, 7/9/11. https://doi.org/10.1007/978-3-642-22098-2_83
Viswanathan LN, McDaniel T, Panchanathan S. Audio-haptic description in movies. In HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings. PART 1 ed. Vol. 173 CCIS. 2011. p. 414-418. (Communications in Computer and Information Science; PART 1). https://doi.org/10.1007/978-3-642-22098-2_83
Viswanathan, Lakshmie Narayan ; McDaniel, Troy ; Panchanathan, Sethuraman. / Audio-haptic description in movies. HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings. Vol. 173 CCIS PART 1. ed. 2011. pp. 414-418 (Communications in Computer and Information Science; PART 1).
@inproceedings{58d009f50eeb4228adf5500c2814a1cb,
title = "Audio-haptic description in movies",
abstract = "This paper proposes a methodology to enhance audio described movies (i.e., films augmented with additional narration to explain visual content to viewers who are blind or visually impaired) by providing positional information of on-screen actors through haptics. Using a vibrotactile belt, we map the location of a character across the screen to a relative location around the waist, and the relative distance of a character from the camera is mapped to a tactile rhythm. Character movement is subsequently conveyed through these two dimensions. All participants, including one visually impaired subject, felt the vibrations improved their visualization of the clips. This subject also felt that it was quite easy to combine the information received through audio and haptics, and that the vibrations were not obstructing the subject's attention to audio.",
keywords = "assistive technology, Audio description, described audio, descriptive video service, haptics, movies, tactile icons, tactons, vibrotactile belt, video description",
author = "Viswanathan, {Lakshmie Narayan} and Troy McDaniel and Sethuraman Panchanathan",
year = "2011",
doi = "10.1007/978-3-642-22098-2_83",
language = "English (US)",
isbn = "9783642220975",
volume = "173 CCIS",
series = "Communications in Computer and Information Science",
number = "PART 1",
pages = "414--418",
booktitle = "HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings",
edition = "PART 1",

}

TY - GEN

T1 - Audio-haptic description in movies

AU - Viswanathan, Lakshmie Narayan

AU - McDaniel, Troy

AU - Panchanathan, Sethuraman

PY - 2011

Y1 - 2011

N2 - This paper proposes a methodology to enhance audio described movies (i.e., films augmented with additional narration to explain visual content to viewers who are blind or visually impaired) by providing positional information of on-screen actors through haptics. Using a vibrotactile belt, we map the location of a character across the screen to a relative location around the waist, and the relative distance of a character from the camera is mapped to a tactile rhythm. Character movement is subsequently conveyed through these two dimensions. All participants, including one visually impaired subject, felt the vibrations improved their visualization of the clips. This subject also felt that it was quite easy to combine the information received through audio and haptics, and that the vibrations were not obstructing the subject's attention to audio.

AB - This paper proposes a methodology to enhance audio described movies (i.e., films augmented with additional narration to explain visual content to viewers who are blind or visually impaired) by providing positional information of on-screen actors through haptics. Using a vibrotactile belt, we map the location of a character across the screen to a relative location around the waist, and the relative distance of a character from the camera is mapped to a tactile rhythm. Character movement is subsequently conveyed through these two dimensions. All participants, including one visually impaired subject, felt the vibrations improved their visualization of the clips. This subject also felt that it was quite easy to combine the information received through audio and haptics, and that the vibrations were not obstructing the subject's attention to audio.

KW - assistive technology

KW - Audio description

KW - described audio

KW - descriptive video service

KW - haptics

KW - movies

KW - tactile icons

KW - tactons

KW - vibrotactile belt

KW - video description

UR - http://www.scopus.com/inward/record.url?scp=79960398724&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960398724&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-22098-2_83

DO - 10.1007/978-3-642-22098-2_83

M3 - Conference contribution

AN - SCOPUS:79960398724

SN - 9783642220975

VL - 173 CCIS

T3 - Communications in Computer and Information Science

SP - 414

EP - 418

BT - HCI International 2011 - Posters' Extended Abstracts - International Conference, HCI International 2011, Proceedings

ER -