Abstract

Given their visual nature, nonverbal social cues, such as facial and head movements, are largely inaccessible to individuals who are blind, limiting the information gleaned during interactions. While social assistive aids have explored some nonverbal cues, such as detecting and communicating facial expressions, relatively few nonverbal cues have been explored. A thorough and systematic study has yet to investigate the importance and usefulness of many nonverbal social cues for individuals who are blind. This work takes this first step by beginning to explore the nonverbal cue of agreement/disagreement as indicated by head/body movements including head nod, head shake, leaning forward and leaning backward. To facilitate the investigation of the usefulness of nonverbal cues for individuals who are blind, we propose the use of a Wizard of Oz experiment to rapidly evaluate nonverbal communications using existing technologies rather than building new and complete systems. We first explore the usefulness of agreement/disagreement nonverbal cues using our existing Social Interaction Assistant platform in which most of the seemingly automated processes were manually performed by a wizard without the knowledge of participants. We conducted an experiment with 11 individuals who are blind or visually impaired involving one-on-one interactions with trained interviewers. Results show the potential of agreement/disagreement nonverbal cues within the social interactions of individuals who are blind.

Original languageEnglish (US)
Pages (from-to)243-248
Number of pages6
JournalCommunications in Computer and Information Science
Volume435 PART II
DOIs
StatePublished - 2014

Fingerprint

Social Interaction
Visually Impaired
Facial Expression
Interaction
Experiment
Limiting
Experiments
Evaluate
Communication
Movement
Knowledge
Vision

Keywords

  • agreement
  • disagreement
  • haptic belt
  • nonverbal communication
  • social assistive aids
  • Social Interaction Assistant

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

@article{0585987b1994439ebae047b0dd9209a2,
title = "A Wizard of Oz Study Exploring How Agreement/Disagreement Nonverbal Cues Enhance Social Interactions for Individuals Who Are Blind",
abstract = "Given their visual nature, nonverbal social cues, such as facial and head movements, are largely inaccessible to individuals who are blind, limiting the information gleaned during interactions. While social assistive aids have explored some nonverbal cues, such as detecting and communicating facial expressions, relatively few nonverbal cues have been explored. A thorough and systematic study has yet to investigate the importance and usefulness of many nonverbal social cues for individuals who are blind. This work takes this first step by beginning to explore the nonverbal cue of agreement/disagreement as indicated by head/body movements including head nod, head shake, leaning forward and leaning backward. To facilitate the investigation of the usefulness of nonverbal cues for individuals who are blind, we propose the use of a Wizard of Oz experiment to rapidly evaluate nonverbal communications using existing technologies rather than building new and complete systems. We first explore the usefulness of agreement/disagreement nonverbal cues using our existing Social Interaction Assistant platform in which most of the seemingly automated processes were manually performed by a wizard without the knowledge of participants. We conducted an experiment with 11 individuals who are blind or visually impaired involving one-on-one interactions with trained interviewers. Results show the potential of agreement/disagreement nonverbal cues within the social interactions of individuals who are blind.",
keywords = "agreement, disagreement, haptic belt, nonverbal communication, social assistive aids, Social Interaction Assistant",
author = "Joshua Rader and Troy McDaniel and Artemio Ramirez and Shantanu Bala and Sethuraman Panchanathan",
year = "2014",
doi = "10.1007/978-3-319-07854-0_43",
language = "English (US)",
volume = "435 PART II",
pages = "243--248",
journal = "Communications in Computer and Information Science",
issn = "1865-0929",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - A Wizard of Oz Study Exploring How Agreement/Disagreement Nonverbal Cues Enhance Social Interactions for Individuals Who Are Blind

AU - Rader, Joshua

AU - McDaniel, Troy

AU - Ramirez, Artemio

AU - Bala, Shantanu

AU - Panchanathan, Sethuraman

PY - 2014

Y1 - 2014

N2 - Given their visual nature, nonverbal social cues, such as facial and head movements, are largely inaccessible to individuals who are blind, limiting the information gleaned during interactions. While social assistive aids have explored some nonverbal cues, such as detecting and communicating facial expressions, relatively few nonverbal cues have been explored. A thorough and systematic study has yet to investigate the importance and usefulness of many nonverbal social cues for individuals who are blind. This work takes this first step by beginning to explore the nonverbal cue of agreement/disagreement as indicated by head/body movements including head nod, head shake, leaning forward and leaning backward. To facilitate the investigation of the usefulness of nonverbal cues for individuals who are blind, we propose the use of a Wizard of Oz experiment to rapidly evaluate nonverbal communications using existing technologies rather than building new and complete systems. We first explore the usefulness of agreement/disagreement nonverbal cues using our existing Social Interaction Assistant platform in which most of the seemingly automated processes were manually performed by a wizard without the knowledge of participants. We conducted an experiment with 11 individuals who are blind or visually impaired involving one-on-one interactions with trained interviewers. Results show the potential of agreement/disagreement nonverbal cues within the social interactions of individuals who are blind.

AB - Given their visual nature, nonverbal social cues, such as facial and head movements, are largely inaccessible to individuals who are blind, limiting the information gleaned during interactions. While social assistive aids have explored some nonverbal cues, such as detecting and communicating facial expressions, relatively few nonverbal cues have been explored. A thorough and systematic study has yet to investigate the importance and usefulness of many nonverbal social cues for individuals who are blind. This work takes this first step by beginning to explore the nonverbal cue of agreement/disagreement as indicated by head/body movements including head nod, head shake, leaning forward and leaning backward. To facilitate the investigation of the usefulness of nonverbal cues for individuals who are blind, we propose the use of a Wizard of Oz experiment to rapidly evaluate nonverbal communications using existing technologies rather than building new and complete systems. We first explore the usefulness of agreement/disagreement nonverbal cues using our existing Social Interaction Assistant platform in which most of the seemingly automated processes were manually performed by a wizard without the knowledge of participants. We conducted an experiment with 11 individuals who are blind or visually impaired involving one-on-one interactions with trained interviewers. Results show the potential of agreement/disagreement nonverbal cues within the social interactions of individuals who are blind.

KW - agreement

KW - disagreement

KW - haptic belt

KW - nonverbal communication

KW - social assistive aids

KW - Social Interaction Assistant

UR - http://www.scopus.com/inward/record.url?scp=84903521712&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84903521712&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-07854-0_43

DO - 10.1007/978-3-319-07854-0_43

M3 - Article

AN - SCOPUS:84903521712

VL - 435 PART II

SP - 243

EP - 248

JO - Communications in Computer and Information Science

JF - Communications in Computer and Information Science

SN - 1865-0929

ER -