Search bioRxiv⌕ Search

Biology subjects

Wittkuhn, L.

Publications and source records attributed to Wittkuhn, L..

5 recordsLinked to original sources

FASTIMAGES: Validating replay detection methods in human Neuroimaging using a combined MEG and fMRI dataset

Studies in rodents and humans using invasive electrophysiology have established that neural replay is a ubiquitous phenomenon in the brain that is associated with a wide range of cognitive functions, including memory, planning and decision making. Yet, invasively recording in humans remains difficult, and hence knowledge about replay in humans remains scarce. Hence, to comprehensively understand replay in humans, we need reliable approaches that can detect it non-invasively. Several main non-invasive approaches have been proposed, but we lack a full comparative validation against known ground truth signals. In this study, we present FASTIMAGES, a benchmark dataset from seventy participants with parallel fMRI (n = 40, previously published) and MEG (n=30) recordings containing known neural sequences evoked by fast visual stimulation as well as functional localizer trials. The neural sequences were elicited by five different visual stimuli shown in sequences at speeds of 132, 164, 228 and 612 milliseconds onset-to-onset intervals. Using this dataset, we investigate two existing statistical methods for sequence detection, namely Temporally Delayed Linear Modelling (TDLM, developed for MEG by Liu et al., 2021) and Slope Order Dynamic Analysis (SODA, developed for fMRI by Wittkuhn & Schuck, 2021). We examine the underlying assumptions of each method, analyse their resulting strengths and weaknesses in application to MEG and fMRI. We demonstrate that both approaches excel in their native modality (TDLM for MEG and SODA for fMRI), with comparable effect sizes given idealized conditions in this benchmark. Cross-modality transfer remains challenging. Finally, the FASTIMAGES dataset provides data with known and clearly expressed sequences and can be used to benchmark and validate future sequence detection methods under idealized conditions.

neuroscience↗

Entorhinal cortex signals dimensions of past experience that can be generalised in a novel environment

No two situations are identical. They can be similar in some aspects but different in others. This poses a key challenge when attempting to generalise our experience from one situation to another. How do we distinguish the aspects that transfer across situations from those that do not? One hypothesis is that the entorhinal cortex (EC) meets this challenge by forming factorised representations that allow for increased neural similarity between events that share generalisable features. We tested this hypothesis using functional magnetic resonance imaging. Female and male participants (n=40) were trained to report behavioural sequences based on an underlying graph structure. Participants then made decisions in a new environment where some, but not all graph transitions from the previous structure could be generalised. Behavioural results showed that participants distinguished the generalisable transition information. Accuracy was significantly higher in blocks where sequence transitions were shared across environments, than those in which transitions differed. This boost in accuracy was especially pronounced during early exposure to the novel environment. Throughout this early phase, neural patterns in EC showed a corresponding differentiation of the generalisable aspects. Neural patterns representing starting locations in familiar and novel environments were significantly more similar in EC on trials where sequences could be generalised from prior experience, compared to trials with new sequential transitions. This signalling was associated with improved performance when prior sequence knowledge could be reused. Our results suggest that during early exposure to novel environments, EC may signal dimensions of past experience that can be generalised. Significance StatementGeneralisation is the process of using our experience to solve new challenges. A central problem we face when attempting to generalise is determining which aspects of a new situation are similar to what we have experienced before and which are different. This allows us to generalise our knowledge selectively, transferring insights to the aspects that are similar and relevant in novel scenarios, while avoiding over-generalisation to the aspects that differ. The results from this experiment suggest that the entorhinal cortex may distinguish these aspects during early exposure to new environments, supporting complex generalisation behaviour.

neuroscience↗

Challenges in Replay Detection by TDLM in Post-Encoding Resting State

Using temporally delayed linear modelling (TDLM) and magnetoencephalography (MEG), we investigated whether items associated with an underlying graph structure are replayed during a post-learning resting state. In these same data, we previously provided evidence for replay during on-line (non-rest) memory retrieval. Despite successful decoding of brain activity during a localizer task, and contrary to predictions, we found no evidence for replay during a post-learning resting state. To better understand this, we performed a hybrid simulation analysis in which we inserted synthetic replay events into a control resting state recorded prior to the actual experiment. This simulation revealed that replay detection using our current pipeline requires an extremely high replay density to reach significance (>1 replay sequence per second, with "replay" defined as a sequence of reactivations within a certain time lag). Furthermore, when scaling the number of replay events with a behavioural measure, we were unable to induce a strong correlation between sequenceness and this measure. We infer that even if replay was present at plausible rates in our resting state dataset, we would lack statistical power to detect it with TDLM. Finally, contrasting our novel hybrid simulation to existing purely synthetic simulations indicated that the latter approaches overestimate the sensitivity of TDLM. We discuss approaches that might optimize the analytic methodology, including identifying boundary conditions under which TDLM can be expected to detect replay. We conclude that solving these methodological constraints will be crucial for optimizing the non-invasive measurement of human replay using MEG.

neuroscience↗

Statistical learning of successor representations is related to on-task replay

Humans automatically infer higher-order relationships between events in the environment from their statistical co-occurrence, often without conscious awareness. Neural replay of task representations is a candidate mechanism by which the brain learns such relational information or samples from a learned model in the service of adaptive behavior. Here, we tested whether cortical reactivation is related to learning higher-order sequential relationships without consciousness. Human participants viewed sequences of images that followed probabilistic transitions determined by ring-like graph structures. Behavioral modeling revealed that participants acquired multi-step transition knowledge through gradual updating of an internal successor representation (SR) model, although half of participants did not indicate conscious knowledge about the sequential task structure. To investigate neural replay, we analyzed the temporal dynamics of multivariate functional magnetic resonance imaging (fMRI) patterns during brief 10 seconds pauses from the ongoing statistical learning task. We found evidence for backward sequential replay of multi-step sequences in visual cortical areas. These findings indicate that implicit learning of higher-order relationships establishes an internal SR-based map of the task, and is accompanied by cortical on-task replay.

neuroscience↗

Faster than thought: Detecting sub-second activation sequences with sequential fMRI pattern analysis

Neural computations are often anatomically localized and executed on sub-second time scales. Understanding the brain therefore requires methods that offer sufficient spatial and temporal resolution. This poses a particular challenge for the study of the human brain because non-invasive methods have either high temporal or spatial resolution, but not both. Here, we introduce a novel multivariate analysis method for conventional blood-oxygen-level dependent functional magnetic resonance imaging (BOLD fMRI) that allows to study sequentially activated neural patterns separated by less than 100 ms with anatomical precision. Human participants underwent fMRI and were presented with sequences of visual stimuli separated by 32 to 2048 ms. Probabilistic pattern classifiers were trained on fMRI data to detect the presence of image-specific activation patterns in early visual and ventral temporal cortex. The classifiers were then applied to data recorded during sequences of the same images presented at increasing speeds. Our results show that probabilistic classifier time courses allowed to detect neural representations and their order, even when images were separated by only 32 ms. Moreover, the frequency spectrum of the statistical sequentiality metric distinguished between sequence speeds on sub-second versus supra-second time scales. These results survived when data with high levels of noise and rare sequence events at unknown times were analyzed. Our method promises to lay the groundwork for novel investigations of fast neural computations in the human brain, such as hippocampal replay.

neuroscience↗