TY - GEN
T1 - Do multimodal signals need to come from the same place? Crossmodal attentional links between proximal and distal surfaces
AU - Gray, Robert
AU - Tan, H. Z.
AU - Young, J. J.
N1 - Funding Information:
This research was supported by Nissan Technical Center North America, Inc. The second and third authors were also funded partly by a National Science Foundation Faculty Early Career Development (CAREER) Award under Grant 9984991-IIS.
Publisher Copyright:
© 2002 IEEE.
PY - 2002
Y1 - 2002
N2 - Previous research has shown that the use of multimodal signals can lead to faster and more accurate responses compared to purely unimodal displays. However, in most cases response facilitation only occurs when the signals are presented in roughly the same spatial location. This would suggest a severe restriction on interface designers: to use multimodal displays effectively all signals must be presented from the same location on the display. We previously reported evidence that the use of haptic cues may provide a solution to this problem as haptic cues presented to a user's back can be used to redirect visual attention to locations on a screen in front of the user (Tan et al., 2001). In the present experiment we used a visual change detection task to investigate whether (i) this type of visual-haptic interaction is robust at low cue validity rates and (ii) similar effects occur for auditory cues. Valid haptic cues resulted in significantly faster change detection times even when they accurately indicated the location of the change on only 20% of the trials. Auditory cues had a much smaller effect on detection times at the high validity rate (80%) than haptic cues and did not significantly improve performance at the 20% validity rate. These results suggest that the use haptic attentional cues may be particularly effective in environments in which information cannot be presented in the same spatial location.
AB - Previous research has shown that the use of multimodal signals can lead to faster and more accurate responses compared to purely unimodal displays. However, in most cases response facilitation only occurs when the signals are presented in roughly the same spatial location. This would suggest a severe restriction on interface designers: to use multimodal displays effectively all signals must be presented from the same location on the display. We previously reported evidence that the use of haptic cues may provide a solution to this problem as haptic cues presented to a user's back can be used to redirect visual attention to locations on a screen in front of the user (Tan et al., 2001). In the present experiment we used a visual change detection task to investigate whether (i) this type of visual-haptic interaction is robust at low cue validity rates and (ii) similar effects occur for auditory cues. Valid haptic cues resulted in significantly faster change detection times even when they accurately indicated the location of the change on only 20% of the trials. Auditory cues had a much smaller effect on detection times at the high validity rate (80%) than haptic cues and did not significantly improve performance at the 20% validity rate. These results suggest that the use haptic attentional cues may be particularly effective in environments in which information cannot be presented in the same spatial location.
UR - http://www.scopus.com/inward/record.url?scp=15744378494&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=15744378494&partnerID=8YFLogxK
U2 - 10.1109/ICMI.2002.1167035
DO - 10.1109/ICMI.2002.1167035
M3 - Conference contribution
AN - SCOPUS:15744378494
T3 - Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002
SP - 437
EP - 441
BT - Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002
Y2 - 14 October 2002 through 16 October 2002
ER -