TY - GEN
T1 - Reaction times in multisensory localization tasks
AU - Zhou, Yi
AU - Clayton, Colton
N1 - Funding Information:
Christopher Montagne helped the hardware instrumentation and software development. Elise Wagener and Alina Roanne Lasrado contributed to the earlier versions of experimental design. We appreciate their help. This work is supported by NSF BCS-1539376 (YZ).
Publisher Copyright:
© 2019 Proceedings of the International Congress on Acoustics. All rights reserved.
PY - 2019
Y1 - 2019
N2 - The encoding of space between the visual and auditory systems does not always align. For foveal species like humans and monkeys, the visual field is restricted to frontal space, whereas the auditory field is panoramic, covering the entire surrounding space. Sensitivity to sounds coming from the rear brought by spatial hearing is critical for avoiding unseen dangers. Our recent study shows that, in humans, vision's influence on auditory perception can extend to unseen rear space (Montagne and Zhou, 2018). The present study further investigates the effects of visual stimulation on reaction times when listeners localize an auditory target presented from the front or rear. Experiments are designed to survey two types of reaction times simultaneously: (1) choice reaction time for pushing a button to indicate the perceived front or back location of a sound; (2) saccade reaction time by listeners shifting their gaze to indicate the lateral direction of a perceived sound source. Our results show domain-specific effects of visual capture on both types of reaction times, and support our previous findings that audio-visual interactions are not limited by the spatial rule of proximity.
AB - The encoding of space between the visual and auditory systems does not always align. For foveal species like humans and monkeys, the visual field is restricted to frontal space, whereas the auditory field is panoramic, covering the entire surrounding space. Sensitivity to sounds coming from the rear brought by spatial hearing is critical for avoiding unseen dangers. Our recent study shows that, in humans, vision's influence on auditory perception can extend to unseen rear space (Montagne and Zhou, 2018). The present study further investigates the effects of visual stimulation on reaction times when listeners localize an auditory target presented from the front or rear. Experiments are designed to survey two types of reaction times simultaneously: (1) choice reaction time for pushing a button to indicate the perceived front or back location of a sound; (2) saccade reaction time by listeners shifting their gaze to indicate the lateral direction of a perceived sound source. Our results show domain-specific effects of visual capture on both types of reaction times, and support our previous findings that audio-visual interactions are not limited by the spatial rule of proximity.
KW - Multisensory
KW - Reaction Time
KW - Sound Source Localization
UR - http://www.scopus.com/inward/record.url?scp=85099330203&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85099330203&partnerID=8YFLogxK
U2 - 10.18154/RWTH-CONV-239794
DO - 10.18154/RWTH-CONV-239794
M3 - Conference contribution
AN - SCOPUS:85099330203
T3 - Proceedings of the International Congress on Acoustics
SP - 3906
EP - 3912
BT - Proceedings of the 23rd International Congress on Acoustics
A2 - Ochmann, Martin
A2 - Michael, Vorlander
A2 - Fels, Janina
PB - International Commission for Acoustics (ICA)
T2 - 23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019
Y2 - 9 September 2019 through 23 September 2019
ER -