Why is it so easy to hear individual words in your native language, but in a foreign language they run together in one long stream of sound?
Researchers from UC San Francisco have begun to answer that question with two complementary studies that show how the brain learns the sound patterns of a language until it recognizes where one word ends and the next begins.
When we speak naturally, we don’t put pauses or “spaces” between words, yet fluent speakers effortlessly perceive them. For years, researchers assumed it was the brain areas that give meaning to speech that were figuring out the boundaries between words.
The new studies focus on a different brain region, called the superior temporal gyrus, or STG. Until now, it was thought only to handle simple sound processing, like identifying consonants and vowels.
The new studies show the STG contains neurons that learn to track where words begin and end over years of experience hearing a language.
“This shows that the STG isn’t just hearing sounds, it’s using experience to identify words as they’re being spoken,” said Edward Chang, MD, Chair of Neurological Surgery. “This work gives us a neural blueprint for how the brain transforms continuous sound into meaningful units.”
Chang led the two studies, which were published Nov. 7 in Neuron and Nov. 19 in Nature and supported by the National Institutes of Health.
Rapid reset for the next word
In the Nature study, researchers recorded brain activity from 34 volunteers who were being monitored for epilepsy. Most spoke either Spanish, Mandarin, or English as their native language. Eight were bilingual, but no one spoke all three languages.
Participants listened to sentences in English, Spanish, and Mandarin — languages that were both familiar and unfamiliar to them.
The researchers used machine learning models to analyze patterns and found that when participants heard their native tongue or a language they knew, the specialized neurons in the STG lit up. But when participants heard a language, they didn’t know, the neurons failed to light up.
“It explains a bit of the magic that allows us to understand what someone is saying,” said Ilina Bhaya-Grossman, a PhD candidate in the UCSF-UC Berkeley Joint PhD Program in Bioengineering who is the first author of the Nature study.
The Neuron study showed how these specialized neurons detect the beginnings and endings of words.
Given that fluent speakers utter several words per second, these neurons must rapidly reset to take note of the next word.
“It’s like a kind of reboot, where the brain has processed a word it recognizes, and then resets so it can start in on the next word,” said Matthew Leonard, PhD, Associate Professor of Neurological Surgery, the co-first author with postdoctoral scholar Yizhen Zhang, PhD.
Chang, who along with Leonard is a member of the UCSF Weill Institute for Neurosciences, said the studies clarify why injury to certain regions of the brain can impair the ability to comprehend speech even when a person’s hearing is intact.
Authors: Other authors include Laura Gwilliams of UCSF, Keith Johnson of UC Berkeley, and Junfeng Lu of Fudan University, Shanghai.
Funding: The Nature study was supported by the National Institutes of Health (NIDCD R01DC012379, NINDS U01NS117765), the National Science Foundation GRFP and the UCSF Discovery Fellowship. The Neuron study was supported the National Institutes of Health (NIDCD R01DC012379), the Susan and Bill Oberndorf Foundation, the William K. Bowes, Jr. Foundation, and the Feldman Foundation.
Disclosures: Chang is is cofounder of Echo Neurotechnologies, LLC and an inventor on a pending UCSF patent application (application number: WO2022251472A1, 2022, WIPO PCT - International patent system) and patents PCT/US2020/028926, PCT/US2020/043706 and US9905239B2. All other authors declare no competing interests.
About UCSF: The University of California, San Francisco (UCSF) is exclusively focused on the health sciences and is dedicated to promoting health worldwide through advanced biomedical research, graduate-level education in the life sciences and health professions, and excellence in patient care. UCSF Health, which serves as UCSF’s primary academic medical center, includes top-ranked specialty hospitals and other clinical programs, and has affiliations throughout the Bay Area. UCSF School of Medicine also has a regional campus in Fresno. Learn more at https://ucsf.edu or see our Fact Sheet.
###
Follow UCSF
ucsf.edu | Facebook.com/ucsf | Twitter.com/ucsf | YouTube.com/ucsf
Journal
Nature