Search bioRxiv⌕ Search

Biology subjects

Simony, E.

Publications and source records attributed to Simony, E..

9 recordsLinked to original sources

The Movie After-Effect: widespread adaptation of human cortex following naturalistic sensory experience

Neural systems adapt to prolonged sensory input through mechanisms such as gain control or homeostatic plasticity to maintain stable operating ranges. However, this phenomenon has so far been documented under extreme, non-ecological stimuli targeting specific sensory systems. Here, we reveal a widespread adaptation process across diverse human cortical regions following naturalistic movie watching conditions. The effect was evident in 218 out of 251 cortical regions (87%) that exhibit significant stimulus-driven activations. Analyzing the HCP fMRI data set in which 170 participants watched 14 movie clips, followed by rest periods - we found robust evidence for a movie-induced adaptation process, revealed in the post-movies rest periods. Within a region, voxels highly activated at the end of movies subsequently reduced their activity below baseline during rest, with the magnitude of this drop proportional to initial activation levels, manifested as a consistent voxel-population inversion effect. Conversely, persistently movie-inactivated voxels exhibited increased activation above baseline. Importantly, this Movie After-Effect (MvAE) enabled successful decoding of the specific rest periods following individual movie clips. Our findings suggest that under naturalistic conditions, cortical neurons dynamically change their gain to achieve homeostatic balance in a process akin to batch instance normalization in artificial neural networks. Whether this ubiquitous MvAE has additional cognitive and memory-related implications remains to be explored.

neuroscience↗

A cortical gradient of distance to criticality governs large-scale resting-state fMRI dynamics

The cortex generates a remarkable diversity of regional dynamics despite relying on broadly shared principles of recurrent organization. Here, we identify distance to criticality (DTC) as a unifying axis along which these dynamics are spatially organized. Analyzing resting-state fMRI BOLD signals and leveraging simple network models of randomly connected recurrent units, we show that DTC robustly explains key dynamical features, in particular, local power spectra and functional connectivity, across the full set of 360 cortical areas. Our analysis shows that a rank-order distribution of DTC values is highly conserved across subjects. Moreover, the empirical analysis of cortical slow dynamics and its fitted network simulations demonstrate similar power-laws across hierarchies of the cortical sheet. These results suggest that recurrent neuronal networks, operating close to criticality, can generate a remarkably rich dynamical repertoire which fit the entire range of experimentally observed cortical slow-timescale dynamics. Our findings underscore the importance of DTC as a powerful, fundamental generator underlying the spectrum of diverse cortical dynamics. HighlightsO_LISpontaneous (resting-state) activity in the human cortex is shown to be organized along a conserved spatial gradient of distance from criticality (DTC), with regions exhibiting a stable cross-individual rank order along this axis. C_LIO_LIMulti-subject fMRI data of regional power spectra and functional connectivity can be fitted with a single parameter simulation model based on DTC. C_LIO_LIQuantitative estimation of the DTC across cortical regions can be achieved using a simple sparse recurrent neural network model. C_LIO_LIThe model fits the power spectra of low frequency fluctuations and the distribution of functional connectivity. C_LIO_LIShape collapse analysis of the power spectrum demonstrates a universal profile across the resting cortex depending only on the DTC. C_LI

neuroscience↗

A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations

Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speakers brain before word articulation, and the same linguistic content rapidly reemerged in the listeners brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts.

neuroscience↗

Retrospective behavioral sampling (RBS): a method to effectively track the cognitive fluctuations driven by naturalistic stimulation

Everyday experiences are dynamic, driving fluctuations across simultaneous cognitive processes. A key challenge in the study of naturalistic cognition is to disentangle the complexity of these dynamic processes, without altering the natural experience itself. Retrospective behavioral sampling (RBS) is a novel approach to track the cognitive fluctuations throughout the time-course of naturalistic stimulation, across a variety of cognitive dimensions. We tested the effectiveness and reliability of RBS in a web-based experiment, in which 53 participants viewed short movies and listened to a story, followed by retrospective reporting. Participants recalled their experience of 55 discrete events from the stimuli, rating their quality of memory, magnitude of surprise, intensity of negative and positive emotions, perceived importance, reflectivity state, and mental time travel. In addition, a subset of the original cohort re-rated their memory of events in a follow-up questionnaire. Results show highly replicable fluctuation patterns across distinct cognitive dimensions, thereby revealing a stimulus-driven experience that is substantially shared among individuals. Remarkably, memory ratings more than a week after stimulation resulted in an almost identical time-course of memorability as measured immediately following stimulation. In addition, idiosyncratic response patterns were preserved across different stimuli, indicating that RBS characterizes individual differences that are stimulus invariant. The current findings highlight the potential of RBS as a powerful tool for measuring dynamic processes of naturalistic cognition. We discuss the promising approach of matching RBS fluctuations with dynamic processes measured via other testing modalities, such as neuroimaging, to study the neural manifestations of naturalistic cognitive processing.

neuroscience↗

Narratives: fMRI data for evaluating models of naturalistic language comprehension

The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

neuroscience↗

The Surprising Role of the Default Mode Network

The default mode network (DMN) is a group of high-order brain regions recently implicated in processing external naturalistic events, yet it remains unclear what cognitive function it serves. Here we identified the cognitive states predictive of DMN fMRI coactivation. Particularly, we developed a state-fluctuation pattern analysis, matching network coactivations across a short movie with retrospective behavioral sampling of movie events. Network coactivation was selectively correlated with the state of surprise across movie events, compared to all other cognitive states (e.g. emotion, vividness). The effect was exhibited in the DMN, but not dorsal attention or visual networks. Furthermore, surprise was found to mediate DMN coactivations with hippocampus and nucleus accumbens. These unexpected findings point to the DMN as a major hub in high-level prediction-error representations.

neuroscience↗

Propagation of information along the cortical hierarchy as a function of attention while reading and listening to stories

How does attention route information from sensory to high-order areas as a function of task, within the relatively fixed topology of the brain? In this study, participants were simultaneously presented with two unrelated stories - one spoken and one written - and asked to attend one while ignoring the other. We used fMRI and a novel inter-subject correlation analysis to track the spread of information along the processing hierarchy as a function of task. Processing the unattended spoken (written) information was confined to auditory (visual) cortices. In contrast, attending to the spoken (written) story enhanced the stimulus-selective responses in early sensory regions and allowed it to spread into higher-order areas. Surprisingly, we found that the story-specific spoken (written) responses for the attended story also reached the opposite secondary visual (auditory) regions. These results demonstrate how attention enhances the processing of attended input and allows it to propagate across brain areas.

neuroscience↗

Altered topology of neural circuits in congenital prosopagnosia

Using a novel fMRI-based inter-subject functional correlation (ISFC) approach, which isolates stimulus-locked inter-regional correlation patterns, we compared the cortical topology of the neural circuit for face processing in participants with congenital prosopagnosia (CP) and matched controls. Whereas the anterior temporal lobe served as the major network hub for face processing in controls, this was not the case for the CPs. Instead, this group evinced hyper-connectivity in posterior regions of the visual cortex, mostly associated with the lateral occipital and the inferior temporal cortices. Moreover, the extent to which the network organization was atypical differed as a function of the severity of the face recognition deficit. These results offer new insights into the perturbed cortical topology in CP, which may serve as the underlying neural basis of the behavioral deficits typical of this disorder. The approach adopted here has the potential to uncover altered topologies in other neurodevelopmental disorders, as well.\n\nSignificance StatementCongenital prosopagnosia (CP; face blindness), a developmental deficit in face recognition, is thought to affect up to 3% of the population. Understanding its neural basis is challenging as there is no obvious deficit on conventional structural or functional MRI scans. Using an innovative, fMRI-based inter-subject correlation approach geared towards tracking inter-regional stimulus-locked brain activation, the present study uncovers marked topological differences in a distributed brain network of higher-order visual regions in CP relative to controls. Alteration in topology also differs as a function of the severity of the deficit. These findings shed new light on the neural perturbations underlying CP, and the analytic approach we have adopted may have utility in elucidating the neural basis of other neurodevelopmental disorders such as dyslexia or amusia.

neuroscience↗

Measuring speaker-listener neural coupling with functional near infrared spectroscopy

The present study investigates brain-to-brain coupling, defined as inter-subject correlations in the hemodynamic response, during natural verbal communication. We used functional near-infrared spectroscopy (fNIRS) to record brain activity of speakers telling stories and listeners comprehending audio recordings of these stories. Listeners brain activity was correlated with speakers with a delay. This between-brain correlation disappeared when verbal communication failed. We further compared the fNIRS and functional Magnetic Resonance Imaging (fMRI) recordings of listeners comprehending the same story and found a relationship between the fNIRS oxygenated-hemoglobin concentration changes and the fMRI BOLD in brain areas associated with speech comprehension. This correlation between fNIRS and fMRI was only present when data from the same story were compared between the two modalities and vanished when data from different stories were compared; this cross-modality consistency further highlights the reliability of the spatiotemporal brain activation pattern as a measure of story comprehension. Our findings suggest that fNIRS is a powerful tool for investigating brain-to-brain coupling during verbal communication. As fNIRS sensors are relatively low-cost and can even be built into wireless, portable, battery-operated systems, these results highlight the potential of broad utilization of this approach in everyday settings for augmenting communication and interaction.

neuroscience↗