Kaufeld, G. | Search bioRxiv

bioRxiv2022

Task-dependent and automatic tracking of hierarchical linguistic structure

Linguistic phrases are tracked in sentences even though there is no clear acoustic phrasal marker in the physical signal. This phenomenon suggests an automatic tracking of abstract linguistic structure that is endogenously generated by the brain. However, all studies investigating linguistic tracking compare conditions where either relevant information at linguistic timescales is available, or where this information is absent altogether (e.g., sentences versus word lists during passive listening). It is therefore unclear whether tracking at these phrasal timescales is related to the content of language, or rather, is a consequence of attending to the timescales that happen to match behaviourally-relevant information. To investigate this question, we presented participants with sentences and word lists while recording their brain activity with MEG. Participants performed passive, syllable, word, and word-combination tasks corresponding to attending to rates they would naturally attend to, syllable-rates, word-rates, and phrasal-rates, respectively. We replicated overall findings of stronger phrasal-rate tracking measured with mutual information (MI) for sentences compared to word lists across the classical language network. However, in the inferior frontal gyrus (IFG) we found a task-effect suggesting stronger phrasal-rate tracking during the word-combination task independent of the presence of linguistic structure, as well as stronger delta-band connectivity during this task. These results suggest that extracting linguistic information at phrasal-rates occurs automatically with or without the presence of an additional task, but also that that IFG might be important for temporal integration across various perceptual domains.

neuroscience↗

bioRxiv2020

Structure and meaning organize neural oscillations into a content-specific hierarchy

Neural oscillations track linguistic information during speech comprehension (e.g., Ding et al., 2016; Keitel et al., 2018), and are known to be modulated by acoustic landmarks and speech intelligibility (e.g., Zoefel & VanRullen, 2015). But, it is unclear what information (e.g., timing, rhythm, or content) the brain utilizes to generate linguistic structure and meaning beyond the information that is present in the physical stimulus. We used electroencephalography (EEG) to investigate whether oscillations are modulated by linguistic content over and above the speech stimulus rhythmicity and temporal distribution. We manipulated the presence of semantic and syntactic information apart from the timescale of their occurrence, and controlled for the acoustic-prosodic and lexical-semantic information in the signal. EEG was recorded while 29 adult native speakers of all genders listened to naturally-spoken Dutch sentences, jabberwocky controls with a sentence-like prosodic rhythm and morphemes, word lists with lexical content but no phrase structure, and backwards acoustically-matched controls. Mutual information (MI) analysis revealed sensitivity to linguistic content: Phase MI was highest for sentences at the phrasal (0.8-1.1 Hz) and lexical timescale (1.9-2.8 Hz), suggesting that the delta-band is modulated by lexically-driven combinatorial processing beyond prosody, and that linguistic content (i.e., structure and meaning) organizes the phase of neural oscillations beyond the timescale and rhythmicity of the stimulus. This pattern is consistent with neurophysiologically-inspired models of language comprehension (Martin, 2016, 2020; Martin & Doumas, 2017) where oscillations encode endogenously-generated linguistic content over and above exogenous or stimulus-driven timing and rhythm information. Significance StatementBiological systems like the brain encode their environment not only by reacting in a series of stimulus-driven responses, but by combining stimulus-driven information with endogenous, internally-generated, inferential knowledge and meaning. Understanding language from speech is the human benchmark for this. Much research focusses on the purely stimulus-driven response, but here, we focus on the goal of language behavior: conveying structure and meaning. To that end, we use naturalistic stimuli that contrast acoustic-prosodic and lexical-semantic information to show that, during spoken language comprehension, oscillatory modulations reflect computations related to inferring structure and meaning from the acoustic signal. Our experiment provides the first evidence to date that compositional structure and meaning organize the oscillatory response, above and beyond acoustic and lexical controls.

neuroscience↗