Do multimodal signals need to come from the same place? Crossmodal attentional links between proximal and distal surfaces

Robert Gray, H. Z. Tan, J. J. Young

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

Previous research has shown that the use of multimodal signals can lead to faster and more accurate responses compared to purely unimodal displays. However, in most cases response facilitation only occurs when the signals are presented in roughly the same spatial location. This would suggest a severe restriction on interface designers: to use multimodal displays effectively all signals must be presented from the same location on the display. We previously reported evidence that the use of haptic cues may provide a solution to this problem as haptic cues presented to a user's back can be used to redirect visual attention to locations on a screen in front of the user (Tan et al., 2001). In the present experiment we used a visual change detection task to investigate whether (i) this type of visual-haptic interaction is robust at low cue validity rates and (ii) similar effects occur for auditory cues. Valid haptic cues resulted in significantly faster change detection times even when they accurately indicated the location of the change on only 20% of the trials. Auditory cues had a much smaller effect on detection times at the high validity rate (80%) than haptic cues and did not significantly improve performance at the 20% validity rate. These results suggest that the use haptic attentional cues may be particularly effective in environments in which information cannot be presented in the same spatial location.

Original languageEnglish (US)
Title of host publicationProceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages437-441
Number of pages5
ISBN (Electronic)0769518346, 9780769518343
DOIs
StatePublished - Jan 1 2002
Event4th IEEE International Conference on Multimodal Interfaces, ICMI 2002 - Pittsburgh, United States
Duration: Oct 14 2002Oct 16 2002

Publication series

NameProceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002

Other

Other4th IEEE International Conference on Multimodal Interfaces, ICMI 2002
CountryUnited States
CityPittsburgh
Period10/14/0210/16/02

    Fingerprint

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture

Cite this

Gray, R., Tan, H. Z., & Young, J. J. (2002). Do multimodal signals need to come from the same place? Crossmodal attentional links between proximal and distal surfaces. In Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002 (pp. 437-441). [1167035] (Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMI.2002.1167035