Auditory capture of visual apparent motion, both laterally and looming

Michael McBeath, Jason D. Addie, R. Chandler Krynen

Research output: Contribution to journalArticle

Abstract

Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.

Original languageEnglish (US)
Pages (from-to)105-112
Number of pages8
JournalActa Psychologica
Volume193
DOIs
StatePublished - Feb 1 2019

Fingerprint

Acoustics
Hearing
Experiment
Cues
Head
Equipment and Supplies
Auditory Stimuli
Research
Motion Capture
Sound
Direction compound
Phone
Audition
Stimulus
Sensory Modality
Spatial Perception
Data Collection
World Wide Web

Keywords

  • Apparent motion
  • Auditory and visual motion
  • Auditory capture
  • Dynamic spatial perception
  • Multisensory perception

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)

Cite this

Auditory capture of visual apparent motion, both laterally and looming. / McBeath, Michael; Addie, Jason D.; Krynen, R. Chandler.

In: Acta Psychologica, Vol. 193, 01.02.2019, p. 105-112.

Research output: Contribution to journalArticle

McBeath, Michael ; Addie, Jason D. ; Krynen, R. Chandler. / Auditory capture of visual apparent motion, both laterally and looming. In: Acta Psychologica. 2019 ; Vol. 193. pp. 105-112.
@article{5e5f4ee8234c4659a889b4d17ac54a8a,
title = "Auditory capture of visual apparent motion, both laterally and looming",
abstract = "Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.",
keywords = "Apparent motion, Auditory and visual motion, Auditory capture, Dynamic spatial perception, Multisensory perception",
author = "Michael McBeath and Addie, {Jason D.} and Krynen, {R. Chandler}",
year = "2019",
month = "2",
day = "1",
doi = "10.1016/j.actpsy.2018.12.011",
language = "English (US)",
volume = "193",
pages = "105--112",
journal = "Acta Psychologica",
issn = "0001-6918",
publisher = "Elsevier",

}

TY - JOUR

T1 - Auditory capture of visual apparent motion, both laterally and looming

AU - McBeath, Michael

AU - Addie, Jason D.

AU - Krynen, R. Chandler

PY - 2019/2/1

Y1 - 2019/2/1

N2 - Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.

AB - Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.

KW - Apparent motion

KW - Auditory and visual motion

KW - Auditory capture

KW - Dynamic spatial perception

KW - Multisensory perception

UR - http://www.scopus.com/inward/record.url?scp=85059214077&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059214077&partnerID=8YFLogxK

U2 - 10.1016/j.actpsy.2018.12.011

DO - 10.1016/j.actpsy.2018.12.011

M3 - Article

VL - 193

SP - 105

EP - 112

JO - Acta Psychologica

JF - Acta Psychologica

SN - 0001-6918

ER -