Search bioRxiv⌕ Search

Biology subjects

Berlot, E.

Publications and source records attributed to Berlot, E..

6 recordsLinked to original sources

Lexical surprisal drives pupil dilation during continuous story listening

The pupil famously adjusts its dilation in response to light, but its role extends far beyond this basic sensory function. Its fluctuations index arousal and mental effort, beyond luminance-related dynamics, making it a sensitive marker of internal cognitive states. A growing body of work shows that these pupil-linked signals extend beyond the visual domain. However, which processes drive pupil responses in more naturalistic settings remains unclear as most evidence comes from tightly controlled paradigms that strip away the richness of real-world experience. Language offers a uniquely powerful window into this question, as it can allow us to create rich paradigms without having any visual, i.e. luminance, confounds. Moreover, language comprehension hinges on continuous prediction: listeners constantly generate expectations about upcoming input, and the discrepancy between expectation and actual input - contextual prediction error, or surprisal - carries measurable cognitive costs. Here, we tested the hypothesis that pupil-linked arousal indexes these linguistic surprisal signals during naturalistic listening. We recorded pupil responses while volunteers listened to naturalistic spoken stories in darkness, which were either intact or reversed. Reversed speech preserves the acoustics of the signal while destroying its intelligibility. Pupil dilation selectively tracked lexical surprisal within a late window of 1,700 to 2,350 milliseconds following word onset, in forward, but not control, backward speech. These findings indicate that pupil-linked arousal is tuned to global, context-dependent processing, tracking the cognitive cost of updating a predictive model during naturalistic listening.

neuroscience↗

Predictive Neural Signals during Natural Mandarin Speech Comprehension

Language comprehension requires the continuous transformation of speech into a hierarchy of linguistic units, from phonemes to syllables to words. Because speech unfolds rapidly, listeners are thought to predict upcoming content to keep pace. Previous research has provided empirical evidence for predictive processes operating at multiple linguistic levels during naturalistic listening, including words and phonemes. However, it remains unclear whether prediction also operates concurrently at other levels, such as syllabic and phrasal representation. Here we use Mandarin Chinese to examine the neural signatures of predictive processing across multiple levels of linguistic granularity during natural speech comprehension. Mandarin comprises four representational levels: phoneme, sub-syllabic, character and word, and its lexical identity is largely constrained at the sub-syllabic level, potentially redistributing predictive weight across linguistic representations. We recorded magnetoencephalography (MEG) data while 34 native Mandarin speakers (21 females) listened to a naturalistic audiobook and applied linear regression modeling to examine how linguistic features modulated neural activity. We found that the brain activity of listeners segmented speech into hierarchical units, and that surprisal modulated responses simultaneously across sub-syllabic, character and word levels. In contrast to findings from Indo-European languages, however, we did not observe unique surprisal effects at the lowest, phonemic level. Furthermore, the surprisal of lexical tone in Mandarin modulated brain activity only when integrated with its phonological components. These findings suggest that predictive processing during Mandarin speech comprehension operates concurrently across multiple (though not necessarily all) levels of linguistic granularity, with its implementation shaped by language-specific structural properties. Significance statementLanguage comprehension involves segmenting a continuous acoustic stream into multiple linguistic units, from phonemes to words, and generating predictions at these levels. However, direct neural evidence remains limited regarding how segmentation and prediction operate simultaneously across levels of linguistic granularity, particularly outside Indo-European languages. Using temporal response function analysis of magnetoencephalography data recorded during naturalistic Mandarin listening, we show that predictive processing occurs across multiple levels of linguistic granularity. Specifically, we find evidence for prediction-related neural responses at sub-syllabic, character, and word levels, but not a reliable unique effect at the phonemic level. These results indicate that predictive processing also operates during Mandarin speech comprehension, and its neural implementation is shaped by language-specific structural properties.

neuroscience↗

Narrative Context Shifts Gaze from Visual to Semantic Salience

Humans make over a hundred thousand eye movements daily to gather visual information. But what determines where we look? Current computational models typically link gaze behaviour to visual features of isolated images, but we know that eye movements are also strongly shaped by cognitive goals: Observers gather information that helps them to understand, rather than just represent, the world. Within this framework, observers should focus more on information that updates ones understanding of the environment, and less on what is purely visually salient. Here we tested this hypothesis using a free-viewing paradigm of narratives where we experimentally manipulated the meaningfulness of temporal context by either presenting pictures in a coherent, i.e. correct, order, or in a temporally shuffled order. We developed a novel approach to quantify which visual information is semantically salient (i.e., important for understanding): we separately obtained language narratives for images in stories, and computed the contextual surprisal of visual objects using a large language model. The ability of this semantic saliency model in explaining gaze behaviour was compared to a state-of-the art model of visual saliency (DeepGaze-II). We found that individuals looked relatively more often and more quickly at semantically salient objects when images were presented in coherent compared to shuffled order. In contrast, visual salience did not better account for gaze behaviour in coherent than shuffled order. These findings highlight how internal contextual models guide visual sampling and demonstrate that language models could offer a powerful tool for capturing gaze behavior in richer, meaningful settings.

neuroscience↗

The role of primary motor cortex in sequence learning: resolving conflicting fMRI evidence from repetition suppression and pattern analysis

How does the brain change during learning? In functional magnetic resonance imaging studies, both multivariate pattern analysis and repetition suppression (RS) have been used to detect changes in neuronal representations. In the context of motor sequence learning, the two techniques have provided discrepant findings: pattern analysis showed that only premotor and parietal regions, but not primary motor cortex (M1), develop a representation of trained sequences. In contrast, RS suggested trained sequence representations in all these regions. Here we applied both analysis techniques to a 5-week finger sequence training study, in which participants executed each sequence twice before switching to a different sequence. Both RS and pattern analysis indicated learning-related changes for parietal areas, but only RS showed a difference between trained and untrained sequences in M1. A more fine-grained analysis, however, revealed that the RS effect in M1 reflects a fundamentally different process than in parietal areas. On the first execution, M1 represents especially the first finger of each sequence, likely reflecting preparatory processes. This effect dramatically reduces during the second execution. In contrast, parietal areas represent the identity of a sequence, and this representation stays relatively stable on the second execution. These results suggest that the RS effect does not reflect a trained sequence representation in M1, but rather a preparatory signal for movement initiation. More generally, our study demonstrates that across regions RS can reflect different representational changes in the neuronal population code, emphasizing the importance of combining pattern analysis and RS techniques. Significance statementPrevious studies using pattern analysis have suggested that primary motor cortex (M1) does not represent learnt sequential actions. However, a study using repetition suppression (RS) has reported M1 changes during motor sequence learning. Combining both techniques, we first replicate the discrepancy between them - with learning-related changes in M1 in RS, but not pattern dissimilarities. We further analysed the representational changes with repetition, and found that the RS effects differ across regions. M1s activity represents the starting finger of the sequence, an effect that vanishes with repetition. In contrast, activity patterns in parietal areas exhibit sequence dependency, which persists with repetition. These results demonstrate the importance of combining RS and pattern analysis to understand the function of brain regions.

neuroscience↗

fMRI signatures of motor sequence learning: A critical re-evaluation

Despite numerous studies, there is little agreement about what brain changes accompany motor sequence learning, partly because of a general publication bias that favors novel results. We therefore decided to systematically reinvestigate proposed functional magnetic resonance imaging correlates of motor learning in a preregistered longitudinal study with four scanning sessions over 5 weeks of training. Activation decreased more for trained than untrained sequences in premotor and parietal areas, without any evidence of learning-related activation increases. Premotor and parietal regions also exhibited changes in the fine-grained, sequence-specific activation patterns early in learning, which stabilized later. No changes were observed in the primary motor cortex (M1). Overall, our study provides evidence that human motor sequence learning occurs outside of M1. Furthermore, it shows that we cannot expect to find activity increases as an indicator for learning, making subtle changes in activity patterns across weeks the most promising fMRI correlate of training-induced plasticity.

neuroscience↗

Ipsilateral finger representations are engaged in active movement, but not sensory processing

Hand and finger movements are mostly controlled through crossed corticospinal projections from the contralateral hemisphere. During unimanual movements, activity in the contralateral hemisphere is increased while the ipsilateral hemisphere is suppressed below resting baseline. Despite this suppression, unimanual movements can be decoded from ipsilateral activity alone. This indicates that ipsilateral activity patterns represent parameters of ongoing movement, but the origin and functional relevance of these representations is unclear. Here, we asked whether human ipsilateral representations are caused by active movement, or whether they are driven by sensory input. Participants alternated between performing single finger presses and having fingers passively stimulated, while we recorded brain activity using high-field (7T) functional imaging. We contrasted active and passive finger representations in sensorimotor areas of ipsilateral and contralateral hemispheres. Finger representations in the contralateral hemisphere were equally strong under passive and active conditions, highlighting the importance of sensory information in feedback control. In contrast, ipsilateral finger representations were stronger during active presses. Furthermore, the spatial distribution of finger representations differed between hemispheres: the contralateral hemisphere showed the strongest finger representations in Brodmann area 3a and 3b, while the ipsilateral hemisphere exhibited stronger representations in premotor and parietal areas. This suggests that finger representations in the two hemispheres have different origins - contralateral representations are driven by both active movement and sensory stimulation, whereas ipsilateral representations are mainly engaged during active movement. This suggests that a possible contribution of the ipsilateral hemisphere lies in movement planning, rather than in the dexterous feedback control of the movement.\n\nSignificance statementMovements of the human body are mostly controlled by contralateral cortical regions. However, activity in ipsilateral sensorimotor regions is also modulated during active movements. The origin and functional relevance of these ipsilateral representations is unclear. Here we used high-field neuroimaging to investigate how human contralateral and ipsilateral hemispheres represent active finger presses and passive finger stimulation. We report that while the contralateral hemisphere was equally strongly recruited during active and passive conditions, the ipsilateral hemisphere was mostly recruited during active movement. We propose that the ipsilateral hemisphere may play a role in bilateral movement planning.

neuroscience↗