Auditory capture of visual apparent motion, both laterally and looming

Michael McBeath, Jason D. Addie, R. Chandler Krynen

    Research output: Contribution to journalArticle

    Abstract

    Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.

    Original languageEnglish (US)
    Pages (from-to)105-112
    Number of pages8
    JournalActa Psychologica
    Volume193
    DOIs
    StatePublished - Feb 1 2019

    Fingerprint

    Acoustics
    Hearing
    Experiment
    Cues
    Head
    Equipment and Supplies
    Auditory Stimuli
    Research
    Motion Capture
    Sound
    Direction compound
    Phone
    Audition
    Stimulus
    Sensory Modality
    Spatial Perception
    Data Collection
    World Wide Web

    Keywords

    • Apparent motion
    • Auditory and visual motion
    • Auditory capture
    • Dynamic spatial perception
    • Multisensory perception

    ASJC Scopus subject areas

    • Experimental and Cognitive Psychology
    • Developmental and Educational Psychology
    • Arts and Humanities (miscellaneous)

    Cite this

    Auditory capture of visual apparent motion, both laterally and looming. / McBeath, Michael; Addie, Jason D.; Krynen, R. Chandler.

    In: Acta Psychologica, Vol. 193, 01.02.2019, p. 105-112.

    Research output: Contribution to journalArticle

    McBeath, Michael ; Addie, Jason D. ; Krynen, R. Chandler. / Auditory capture of visual apparent motion, both laterally and looming. In: Acta Psychologica. 2019 ; Vol. 193. pp. 105-112.
    @article{5e5f4ee8234c4659a889b4d17ac54a8a,
    title = "Auditory capture of visual apparent motion, both laterally and looming",
    abstract = "Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.",
    keywords = "Apparent motion, Auditory and visual motion, Auditory capture, Dynamic spatial perception, Multisensory perception",
    author = "Michael McBeath and Addie, {Jason D.} and Krynen, {R. Chandler}",
    year = "2019",
    month = "2",
    day = "1",
    doi = "10.1016/j.actpsy.2018.12.011",
    language = "English (US)",
    volume = "193",
    pages = "105--112",
    journal = "Acta Psychologica",
    issn = "0001-6918",
    publisher = "Elsevier",

    }

    TY - JOUR

    T1 - Auditory capture of visual apparent motion, both laterally and looming

    AU - McBeath, Michael

    AU - Addie, Jason D.

    AU - Krynen, R. Chandler

    PY - 2019/2/1

    Y1 - 2019/2/1

    N2 - Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.

    AB - Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.

    KW - Apparent motion

    KW - Auditory and visual motion

    KW - Auditory capture

    KW - Dynamic spatial perception

    KW - Multisensory perception

    UR - http://www.scopus.com/inward/record.url?scp=85059214077&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85059214077&partnerID=8YFLogxK

    U2 - 10.1016/j.actpsy.2018.12.011

    DO - 10.1016/j.actpsy.2018.12.011

    M3 - Article

    VL - 193

    SP - 105

    EP - 112

    JO - Acta Psychologica

    JF - Acta Psychologica

    SN - 0001-6918

    ER -