Audiovisual interactions in front and rear space

Christopher Montagne, Yi Zhou

    Research output: Contribution to journalArticle

    1 Citation (Scopus)

    Abstract

    The human visual and auditory systems do not encode an entirely overlapped space when static head and body position are maintained. While visual capture of sound source location in the frontal field is known to be immediate and direct, visual influence in the rear auditory space behind the subject remains under-studied. In this study we investigated the influence of presenting frontal LED flashes on the perceived location of a phantom sound source generated using time-delay-based stereophony. Our results show that frontal visual stimuli affected auditory localization in two different ways - (1) auditory responses were laterally shifted (left or right) toward the location of the light stimulus and (2) auditory responses were more often in the frontal field. The observed visual effects do not adhere to the spatial rule of multisensory interaction with regard to the physical proximity of cues. Instead, the influence of visual cues interacted closely with front-back confusions in auditory localization. In particular, visually induced shift along the left-right direction occurred most often when an auditory stimulus was localized in the same (frontal) field as the light stimulus, even when the actual sound sources were presented from behind a subject. Increasing stimulus duration (from 15-ms to 50-ms) significantly mitigated the rates of front-back confusion and the associated effects of visual stimuli. These findings suggest that concurrent visual stimulation elicits a strong frontal bias in auditory localization and confirm that temporal integration plays an important role in decreasing front-back errors under conditions requiring multisensory spatial processing.

    Original languageEnglish (US)
    Article number713
    JournalFrontiers in Psychology
    Volume9
    Issue numberMAY
    DOIs
    StatePublished - May 15 2018

    Fingerprint

    Sound Localization
    Cues
    Light
    Confusion
    Photic Stimulation

    Keywords

    • Audiovisual integration
    • Cross-modal bias
    • Multi-sensory
    • Rear space
    • Sound localization
    • Spatial hearing

    ASJC Scopus subject areas

    • Psychology(all)

    Cite this

    Audiovisual interactions in front and rear space. / Montagne, Christopher; Zhou, Yi.

    In: Frontiers in Psychology, Vol. 9, No. MAY, 713, 15.05.2018.

    Research output: Contribution to journalArticle

    Montagne, Christopher ; Zhou, Yi. / Audiovisual interactions in front and rear space. In: Frontiers in Psychology. 2018 ; Vol. 9, No. MAY.
    @article{fefbea6d6b76403db2511ddae792ed9d,
    title = "Audiovisual interactions in front and rear space",
    abstract = "The human visual and auditory systems do not encode an entirely overlapped space when static head and body position are maintained. While visual capture of sound source location in the frontal field is known to be immediate and direct, visual influence in the rear auditory space behind the subject remains under-studied. In this study we investigated the influence of presenting frontal LED flashes on the perceived location of a phantom sound source generated using time-delay-based stereophony. Our results show that frontal visual stimuli affected auditory localization in two different ways - (1) auditory responses were laterally shifted (left or right) toward the location of the light stimulus and (2) auditory responses were more often in the frontal field. The observed visual effects do not adhere to the spatial rule of multisensory interaction with regard to the physical proximity of cues. Instead, the influence of visual cues interacted closely with front-back confusions in auditory localization. In particular, visually induced shift along the left-right direction occurred most often when an auditory stimulus was localized in the same (frontal) field as the light stimulus, even when the actual sound sources were presented from behind a subject. Increasing stimulus duration (from 15-ms to 50-ms) significantly mitigated the rates of front-back confusion and the associated effects of visual stimuli. These findings suggest that concurrent visual stimulation elicits a strong frontal bias in auditory localization and confirm that temporal integration plays an important role in decreasing front-back errors under conditions requiring multisensory spatial processing.",
    keywords = "Audiovisual integration, Cross-modal bias, Multi-sensory, Rear space, Sound localization, Spatial hearing",
    author = "Christopher Montagne and Yi Zhou",
    year = "2018",
    month = "5",
    day = "15",
    doi = "10.3389/fpsyg.2018.00713",
    language = "English (US)",
    volume = "9",
    journal = "Frontiers in Psychology",
    issn = "1664-1078",
    publisher = "Frontiers Research Foundation",
    number = "MAY",

    }

    TY - JOUR

    T1 - Audiovisual interactions in front and rear space

    AU - Montagne, Christopher

    AU - Zhou, Yi

    PY - 2018/5/15

    Y1 - 2018/5/15

    N2 - The human visual and auditory systems do not encode an entirely overlapped space when static head and body position are maintained. While visual capture of sound source location in the frontal field is known to be immediate and direct, visual influence in the rear auditory space behind the subject remains under-studied. In this study we investigated the influence of presenting frontal LED flashes on the perceived location of a phantom sound source generated using time-delay-based stereophony. Our results show that frontal visual stimuli affected auditory localization in two different ways - (1) auditory responses were laterally shifted (left or right) toward the location of the light stimulus and (2) auditory responses were more often in the frontal field. The observed visual effects do not adhere to the spatial rule of multisensory interaction with regard to the physical proximity of cues. Instead, the influence of visual cues interacted closely with front-back confusions in auditory localization. In particular, visually induced shift along the left-right direction occurred most often when an auditory stimulus was localized in the same (frontal) field as the light stimulus, even when the actual sound sources were presented from behind a subject. Increasing stimulus duration (from 15-ms to 50-ms) significantly mitigated the rates of front-back confusion and the associated effects of visual stimuli. These findings suggest that concurrent visual stimulation elicits a strong frontal bias in auditory localization and confirm that temporal integration plays an important role in decreasing front-back errors under conditions requiring multisensory spatial processing.

    AB - The human visual and auditory systems do not encode an entirely overlapped space when static head and body position are maintained. While visual capture of sound source location in the frontal field is known to be immediate and direct, visual influence in the rear auditory space behind the subject remains under-studied. In this study we investigated the influence of presenting frontal LED flashes on the perceived location of a phantom sound source generated using time-delay-based stereophony. Our results show that frontal visual stimuli affected auditory localization in two different ways - (1) auditory responses were laterally shifted (left or right) toward the location of the light stimulus and (2) auditory responses were more often in the frontal field. The observed visual effects do not adhere to the spatial rule of multisensory interaction with regard to the physical proximity of cues. Instead, the influence of visual cues interacted closely with front-back confusions in auditory localization. In particular, visually induced shift along the left-right direction occurred most often when an auditory stimulus was localized in the same (frontal) field as the light stimulus, even when the actual sound sources were presented from behind a subject. Increasing stimulus duration (from 15-ms to 50-ms) significantly mitigated the rates of front-back confusion and the associated effects of visual stimuli. These findings suggest that concurrent visual stimulation elicits a strong frontal bias in auditory localization and confirm that temporal integration plays an important role in decreasing front-back errors under conditions requiring multisensory spatial processing.

    KW - Audiovisual integration

    KW - Cross-modal bias

    KW - Multi-sensory

    KW - Rear space

    KW - Sound localization

    KW - Spatial hearing

    UR - http://www.scopus.com/inward/record.url?scp=85046995021&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85046995021&partnerID=8YFLogxK

    U2 - 10.3389/fpsyg.2018.00713

    DO - 10.3389/fpsyg.2018.00713

    M3 - Article

    AN - SCOPUS:85046995021

    VL - 9

    JO - Frontiers in Psychology

    JF - Frontiers in Psychology

    SN - 1664-1078

    IS - MAY

    M1 - 713

    ER -