Neural networks supporting audiovisual integration for speech: A large-scale lesion study

Gregory Hickok, Corianne Reddy, William Matchin, Alexandra Basilakos, Julia Cai, Sara Pillay, Michelle Ferrill, Soren Mickelsen, Steven W. Anderson, Tracy Love, Jeffrey Binder, Julius Fridriksson

    Research output: Contribution to journalArticle

    6 Scopus citations

    Abstract

    Auditory and visual speech information are often strongly integrated resulting in perceptual enhancements for audiovisual (AV) speech over audio alone and sometimes yielding compelling illusory fusion percepts when AV cues are mismatched, the McGurk-MacDonald effect. Previous research has identified three candidate regions thought to be critical for AV speech integration: the posterior superior temporal sulcus (STS), early auditory cortex, and the posterior inferior frontal gyrus. We assess the causal involvement of these regions (and others) in the first large-scale (N = 100) lesion-based study of AV speech integration. Two primary findings emerged. First, behavioral performance and lesion maps for AV enhancement and illusory fusion measures indicate that classic metrics of AV speech integration are not necessarily measuring the same process. Second, lesions involving superior temporal auditory, lateral occipital visual, and multisensory zones in the STS are the most disruptive to AV speech integration. Further, when AV speech integration fails, the nature of the failure—auditory vs visual capture—can be predicted from the location of the lesions. These findings show that AV speech processing is supported by unimodal auditory and visual cortices as well as multimodal regions such as the STS at their boundary. Motor related frontal regions do not appear to play a role in AV speech integration.

    Original languageEnglish (US)
    Pages (from-to)360-371
    Number of pages12
    JournalCortex
    Volume103
    DOIs
    StatePublished - Jun 2018

    Keywords

    • Speech audiovisual stroke language aphasia

    ASJC Scopus subject areas

    • Neuropsychology and Physiological Psychology
    • Experimental and Cognitive Psychology
    • Cognitive Neuroscience

    Fingerprint Dive into the research topics of 'Neural networks supporting audiovisual integration for speech: A large-scale lesion study'. Together they form a unique fingerprint.

  • Cite this

    Hickok, G., Reddy, C., Matchin, W., Basilakos, A., Cai, J., Pillay, S., Ferrill, M., Mickelsen, S., Anderson, S. W., Love, T., Binder, J., & Fridriksson, J. (2018). Neural networks supporting audiovisual integration for speech: A large-scale lesion study. Cortex, 103, 360-371. https://doi.org/10.1016/j.cortex.2018.03.030