Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex
dc.contributor.author | Ganesan, Karthik | |
dc.contributor.author | Plass, John | |
dc.contributor.author | Beltz, Adriene M. | |
dc.contributor.author | Liu, Zhongming | |
dc.contributor.author | Grabowecky, Marcia | |
dc.contributor.author | Suzuki, Satoru | |
dc.contributor.author | Stacey, William C. | |
dc.contributor.author | Wasade, Vibhangini S. | |
dc.contributor.author | Towle, Vernon L. | |
dc.contributor.author | Tao, James X | |
dc.contributor.author | Wu, Shasha | |
dc.contributor.author | Issa, Naoum P | |
dc.contributor.author | Brang, David | |
dc.date.accessioned | 2021-06-01T13:25:22Z | |
dc.date.available | 2021-06-01T13:25:22Z | |
dc.date.issued | 2021-05-14 | |
dc.identifier.uri | https://hdl.handle.net/2027.42/167729 | en |
dc.description.abstract | Speech perception is a central component of social communication. While principally an auditory process, accurate speech perception in everyday settings is supported by meaningful information extracted from visual cues (e.g., speech content, timing, and speaker identity). Previous research has shown that visual speech modulates activity in cortical areas subserving auditory speech perception, including the superior temporal gyrus (STG), potentially through feedback connections from the multisensory posterior superior temporal sulcus (pSTS). However, it is unknown whether visual modulation of auditory processing in the STG is a unitary phenomenon or, rather, consists of multiple temporally, spatially, or functionally distinct processes. To explore these questions, we examined neural responses to audiovisual speech measured from intracranially implanted electrodes within the temporal cortex of 21 patients undergoing clinical monitoring for epilepsy. We found that visual speech modulates auditory processes in the STG in multiple ways, eliciting temporally and spatially distinct patterns of activity that differ across theta, beta, and high-gamma frequency bands. Before speech onset, visual information increased high-gamma power in the posterior STG and suppressed beta power in mid-STG regions, suggesting crossmodal prediction of speech signals in these areas. After sound onset, visual speech decreased theta power in the middle and posterior STG, potentially reflecting a decrease in sustained feedforward auditory activity. These results are consistent with models that posit multiple distinct mechanisms supporting audiovisual speech perception and provide a crucial map for subsequent studies to identify the types of visual features that are encoded by these separate mechanisms. | en_US |
dc.description.sponsorship | This study was supported by NIH Grant R00 DC013828 A. Beltz was supported by the Jacobs Foundation. | en_US |
dc.language.iso | en_US | en_US |
dc.rights | Attribution-NonCommercial-NoDerivatives 4.0 International | * |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/4.0/ | * |
dc.subject | Multisensory | en_US |
dc.subject | Audiovisual | en_US |
dc.subject | Speech | en_US |
dc.subject | ECoG | en_US |
dc.subject | iEEG | en_US |
dc.subject | sEEG | en_US |
dc.subject | Intracranial | en_US |
dc.title | Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex | en_US |
dc.type | Preprint | en_US |
dc.subject.hlbsecondlevel | Psychology | |
dc.subject.hlbtoplevel | Social Sciences | |
dc.contributor.affiliationother | Northwestern University, Evanston, IL 60208 | en_US |
dc.contributor.affiliationother | Henry Ford Hospital, Detroit, MI 48202 | en_US |
dc.contributor.affiliationother | Department of Neurology, Wayne State University School of Medicine, MI 48201 | en_US |
dc.contributor.affiliationother | Department of Neurology, The University of Chicago, Chicago, IL 60637 | en_US |
dc.contributor.affiliationumcampus | Ann Arbor | en_US |
dc.description.bitstreamurl | http://deepblue.lib.umich.edu/bitstream/2027.42/167729/1/OriginalManuscript.pdf | |
dc.identifier.doi | https://doi.org/10.1101/2020.09.07.284455 | |
dc.identifier.doi | https://dx.doi.org/10.7302/1269 | |
dc.identifier.orcid | https://orcid.org/0000-0002-2706-6777 | en_US |
dc.description.filedescription | Description of OriginalManuscript.pdf : Preprint of the article "Multiple auditory responses to visual speech" | |
dc.description.depositor | SELF | en_US |
dc.identifier.name-orcid | Brang, David; 0000-0002-2706-6777 | en_US |
dc.working.doi | 10.7302/1269 | en_US |
dc.owningcollname | Psychology, Department of |
Files in this item
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.