Search bioRxiv⌕ Search

bioRxiv · 10.1101/2022.09.20.508802

"Um... it's really difficult to... um.. speak fluently": Neural tracking of spontaneous speech

Abstract

Spontaneous real-life speech is imperfect in many ways. It contains disfluencies and ill-formed utterances and has a highly variable rate. When listening to spontaneous speech, the brain needs to contend with these features in order to extract the speakers meaning. Here, we studied how the neural response is affected by four specific factors that are prevalent in spontaneous colloquial speech: (1) the presence of non-lexical fillers, (2) the need to detect syntactic boundaries in disfluent speech, and (3) variability in speech rate. Neural activity (EEG) was recorded from individuals as they listened to an unscripted, spontaneous narrative, which was analyzed in a time-resolved fashion to identify fillers and detect syntactic boundaries. When considering these factors in a speech-tracking analysis, which estimates a temporal response function (TRF) to describe the relationship between the stimulus and the neural response it generates, we found that the TRF was affected by both of them. This response was observed for lexical words but not for fillers, and it had an earlier onset for opening words vs. closing words of a clause and for clauses with slower speech rates. These findings broaden ongoing efforts to understand neural processing of speech under increasingly realistic conditions. They highlight the importance of considering the imperfect nature of real-life spoken language, linking past research on linguistically well-formed and meticulously controlled speech to the type of speech that the brain actually deals with on a daily basis.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Agmon, G., Jaeger, M., Tsarfaty, R., Bleichner, M. G., Zion Golumbic, E.. 2022-09-22. "Um... it's really difficult to... um.. speak fluently": Neural tracking of spontaneous speech. https://doi.org/10.1101/2022.09.20.508802

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Exploring subacute effects of a DMT and harmine meditation retreat on the brain's control energy landscape

Modeling the brain as a controllable structural network allows the estimation of the control energy (CE) required to reach functional states, where low-CE states are more accessible. Psychedelics are thought to acutely flatten the brain's CE landscape, broadening the repertoire of reachable states, but whether this reorganization persists into the subacute ``afterglow" window is largely unknown. This exploratory study uses rs-fMRI from a randomized, double-blind, placebo-controlled trial (N = 39; 19 verum [N,N-dimethyltryptamine (DMT) + harmine, Ayahuasca-inspired formulation], 20 placebo) scanned before and after a three-day meditation retreat. We compute CE on a group human connectome project (HCP) structural connectome under two approaches that emphasize long and short timescale dynamics. Globally, we found no systematic shift in the distribution of CE between transitions, however mean CE increased in both groups at the long timescale approach. Surviving network effects emerge when a network's intrinsic timescale matches the stabilization regime. In the long timescale regime, the central executive network (CEN) showed an increase in post-retreat CE within the verum group that survived Benjamini-Hochberg False Discovery Rate (FDR-BH) correction. Although CE and functional connectivity are distinct, this higher CEN cost may relate to the reduced within-network connectivity previously reported subacutely after psilocybin. The default mode network (DMN) also showed a post-retreat CE increase in both groups, but neither change survived FDR correction. In the short timescale approach, the visual network (VN) showed a FDR-BH CE decrease within the verum group, consistent with reduced dynamical demand in a region acutely engaged by DMT. To examine whether changes were concentrated in less accessible states, we additionally analyzed rare brain states, defined by the top decile of information content. This analysis revealed a modest session x condition interaction in the long timescale approach. Overall, the two timescale lenses surface different network effects, that align with cortical timescale hierarchies. These findings point to network- and timescale-specific, rather than global, CE changes in the afterglow window, though effects are small and heterogeneous and require confirmation in larger samples. Characterizing whether and where psychedelic effects persist into the subacute window is relevant to psychedelic-assisted therapy, including safety, therapeutic timing, and durability of drug effects. More broadly, considering cortical timescale hierarchies may help identify network-specific CE changes that might be less apparent when networks are evaluated under a single dynamical timescale.

neuroscience↗

Advanced meditation stabilizes cortical dynamics through inhibitory gain control linked to absorptive depth

Advanced meditation can shift conscious experience from ordinary body- and world-centered awareness toward absorption, detachment and dissociation-like states, yet the neural mechanisms that stabilize these immersive states remain unclear. We studied 18 long-term meditators during eyes-open rest and Rajyoga meditation, a practice in which practitioners reduce bodily identification while enhancing inner self-awareness. We combined multidimensional neural approach including frontal EEG spectral power, temporal non-stationarity and corticothalamic neural-field modeling, because these measures probe underlying complementary levels of the brain state transition: the strength of neural activity, its temporal stability, and the circuit level inhibition-excitation gain mechanisms. This framework is especially relevant to meditation because oscillatory, temporal organization may distinguish stable meditative states, and corticothalamic dynamics are closely linked to arousal and conscious state regulation. We correlated meditation induced neural changes with subjective ratings of absorption and dissociation. Compared with rest, meditation was associated with higher beta1, beta2 and gamma power, with no change in the slower bands (delta, theta and alpha), and with lower beta-band temporal non-stationarity, indicating a more stable expression of fast cortical dynamics. Fitting the corticothalamic model to the EEG spectra showed stronger cortical inhibitory gain and lower effective intracortical gain, placing meditation in an inhibition-dominant regime, with lower gain in the loop between excitatory and inhibitory neurons within the cortex. During meditation, these model estimates were related to subjective absorption and showed trend level links with dissociation. Together, these findings suggest that Rajyoga meditation stabilizes cortical dynamics through inhibitory gain control, linking absorption (deep and steady attention on the meditation) to dissociation-like self-detachment.

neuroscience↗

CoReg, tracking-based motion compensation for in vivo calcium imaging

In vivo calcium imaging enables the observation of neural activity with high spatial and temporal resolution. However, recordings are frequently affected by motion artifacts caused by animal movement, physiological processes, tissue drift, or instability of the imaging setup. These artifacts make signal extraction harder and reduce the consistency of downstream analyses. Current registration methods can correct rigid and non-rigid motion, but often estimate motion from individual frames or image patches and make limited use of temporal information. In addition, activity-driven fluorescence changes can make it difficult to distinguish changes in image appearance from actual motion. Here, we treat motion correction in calcium imaging as a point tracking problem and introduce CoReg, an open-source Python- based software tool with a graphical user interface. We benchmark CoReg against established registration methods using fluorescence imaging datasets from multiple species. CoReg performs competitively with or better than existing approaches across several settings. We further show that its performance is robust to the choice of tracked points, making the method straightforward to apply. CoReg includes implementations of both our method and the evaluated established methods. Our results show that tracking-based registration provides a simple and reliable approach for motion correction in vivo calcium imaging.

neuroscience↗