Search bioRxiv⌕ Search

Biology subjects

Kerren, C.

Publications and source records attributed to Kerren, C..

9 recordsLinked to original sources

Sequential Sampling as a Computational Principle of Episodic Memory

Visual perception unfolds through sequential eye movements, yet computational models of episodic memory typically assume that event representations already exist. Here, we propose that sequential gaze sampling does not simply supply memory with visual information, but contributes to the construction and organisation of episodic representations. We introduce a computational model in which successive fixations are integrated into an evolving internal representation, subsequently stored in associative memory and later retrieved through partial reinstatement of the original sampling trajectory. Within to-be-remembered elements, successive samples support progressive individuation; between elements, more frequent transitions strengthen relational binding. As sampling proceeds, internal representations become progressively lower-dimensional while retaining information about where samples were taken and when they occurred in the sequence. Sampling history also remains embedded in the resulting representation: changing the order of otherwise identical samples alters both the representation itself and element-specific retrieval. At retrieval, reinstating more of the original sampling trajectory improves access to specific elements, while competition is strongest when memories share both semantic category and sampling history. Finally, an exploratory generative readout shows that regions sampled during encoding are reconstructed more faithfully than unsampled regions. Together, these findings suggest that sequential sampling provides a candidate computational process through which episodic representations are constructed, shaping their subsequent storage and retrieval.

neuroscience↗

Characterising semantic prioritisation in visual working memory

Cognitive operations require recently encountered information to remain available beyond the moment of sensory input. However, how such transient representations are accessed, and how they differ from sensory processing and long-term memory, remains unclear. Here, we combine hierarchical drift-diffusion modelling with behavioural manipulations to dissociate the decision processes underlying feature prioritisation in visual working memory. We first reanalysed a previously collected working memory dataset to characterise semantic and perceptual judgements at the level of latent decision processes. Semantic judgements were associated with reduced non-decision time across conditions, indicating faster access to task-relevant information, while advantages in evidence accumulation emerged selectively under higher cognitive demands. Two further experiments manipulated attentional prioritisation using retro-cues and dissociated the effects of interference from mere maintenance. Across manipulations, semantic prioritisation was selectively expressed in pre-accumulation processes and was amplified when representations fell outside the focus of attention or had to be maintained under interference. Together, these results suggest that semantic representations remain more readily accessible than perceptual details when working memory representations fall outside the focus of attention, consistent with a shift towards more abstract, long-term memory-like formats under conditions of limited attentional support.

neuroscience↗

Inference over hidden contexts shapes the geometry of conceptual knowledge for flexible behaviour

Flexible decision-making in uncertain environments requires inferring latent task states and prioritising behaviourally relevant information. We tested the hypothesis that this process is associated with systematic changes in attention and neural representational structure. Human participants performed a serial reversal learning task that required identifying which stimulus dimension(s) were currently relevant. Behaviourally, participants rapidly adapted to context switches, and a hidden-state inference model best explained these adaptations, outperforming multiple reinforcement-learning variants in predicting both choices and inferred contexts. Oculomotor behaviour provided converging evidence for selective attention, with gaze increasingly concentrated on relevant features, tracking trial-by-trial belief updates, and transiently broadening following high prediction errors. Guided by these results, we used magnetoencephalography to examine how latent-state inference was reflected in neural activity. Neural representations encoded the currently inferred context and were modulated by recent prediction errors, with larger prediction errors associated with weaker context representations on subsequent trials. Representational analyses further revealed that successful performance was associated with a systematic reorganisation of neural geometry, characterised by selective amplification of task-relevant representational distances and increased separation of behaviourally relevant stimulus values. Together, our findings demonstrate that latent-state inference, attention, and neural representational geometry are tightly coordinated during flexible decision-making, providing a systems-level account of how behaviourally relevant information is selectively prioritised and represented to support adaptive behaviour.

neuroscience↗

Hippocampal ripples initiate cortical dimensionality expansion for memory retrieval

How are past experiences reconstructed from memory? Learning is thought to compress external inputs into low-dimensional hippocampal representations, later expanded into high-dimensional cortical activity during recall. Hippocampal ripples, brief high-frequency bursts linked to retrieval, may initiate this expansion. Analysing intracranial EEG data from patients with pharmaco-resistant epilepsy during an episodic memory task, we found that cortical dimensionality increased following ripple events during correct, but not incorrect, retrieval. This expansion correlated with faster reaction times and reinstatement of the target association. Crucially, hippocampal theta and cortical gamma phase-amplitude coupling emerged after ripples but before cortical expansion, suggesting a mechanism for ripple-driven communication. Ripple events also marked the separation of task-relevant variables in cortical state space, revealing how hippocampal output reshapes the geometry of memory representations to support successful recall.

neuroscience↗

Prioritization of semantic over visuo-perceptual aspects in multi-item working memory

Working Memory (WM) keeps information temporarily available for upcoming tasks. How the contents of WM are distinguished from perceptual representations on the one hand, and from long-term memories on the other, is still debated. Here, we leveraged recent evidence for a reversal of processing dynamics when retrieving episodic long-term memories as opposed to perceiving visual input. In two experiments (n=75 and n=103), we asked participants to hold one or more items in WM and to report their low-level perceptual and high-level semantic qualities. In both experiments, we found faster responses to the items semantic qualities, indicating prioritization over visuo-perceptual aspects, when two or more items were held concurrently in WM. These dynamics of accessing information in multi-item WM were akin to those in retrieving episodic long-term memories and opposite to those in processing visual inputs. Little to no semantic prioritization was evident during single-item maintenance, consistent with a strictly capacity-limited focus of attention within which WM information can be transformed into a prospective action plan.

neuroscience↗

Phase separation of competing memories along the human hippocampal theta rhythm.

Competition between overlapping memories is considered one of the major causes of forgetting and it is still unknown how the human brain resolves such mnemonic conflict. In the present MEG study, we empirically tested a computational model that leverages an oscillating inhibition algorithm to minimise overlap between memories. We used a proactive interference task, where a reminder word could be associated with either a single image (non-competitive condition) or two competing images, and participants were asked to always recall the most recently learned word-image association. Time-resolved pattern classifiers were trained to detect the reactivated content of target and competitor memories from MEG sensor patterns, and the timing of these neural reactivations was analysed relative to the phase of the dominant hippocampal 3Hz theta oscillation. In line with our preregistered hypotheses, target and competitor reactivations locked to different phases of the hippocampal theta rhythm after several repeated recalls. Participants who behaviourally experienced lower levels of interference also showed larger phase separation between the two overlapping memories. The findings provide evidence that the temporal segregation of memories, orchestrated by slow oscillations, plays a functional role in resolving mnemonic competition by separating and prioritising relevant memories under conditions of high interference.

neuroscience↗

Clock time: a foreign measure to brain dynamics

Human thought is highly flexible, achieved by evolving patterns of brain activity across groups of cells. Neuroscience aims to understand cognition in the brain by analysing these intricate patterns. We argue this goal is impeded by the time format of our data - clock time. The brain is a system with its own dynamics and regime of time, with no intrinsic concern for the human-invented second. Here, we present the Brain Time Toolbox, a software library that retunes electrophysiology data in line with oscillations that orchestrate neural patterns of cognition. These oscillations continually slow down, speed up, and undergo abrupt changes, introducing a disharmony between the brains internal regime and clock time. The toolbox overcomes this disharmony by warping the data to the dynamics of coordinating oscillations, setting oscillatory cycles as the datas new time axis. This enables the study of neural patterns as they unfold in the brain, aiding neuroscientific inquiry into dynamic cognition. In support of this, we demonstrate that the toolbox can reveal results that are absent in a default clock time format.

neuroscience↗

Evidence for a reversal of the neural information flow between object perception and object reconstruction from memory

Remembering is a reconstructive process. Surprisingly little is known about how the reconstruction of a memory unfolds in time in the human brain. We used reaction times and EEG time-series decoding to test the hypothesis that the information flow is reversed when an event is reconstructed from memory, compared to when the same event is initially being perceived. Across three experiments, we found highly consistent evidence supporting such a reversed stream. When seeing an object, low-level perceptual features were discriminated faster behaviourally, and could be decoded from brain activity earlier, than high-level conceptual features. This pattern reversed during associative memory recall, with reaction times and brain activity patterns now indicating that conceptual information was reconstructed more rapidly than perceptual details. Our findings support a neurobiologically plausible model of human memory, suggesting that memory retrieval is a hierarchical, multi-layered process that prioritizes semantically meaningful information over perceptual detail.

neuroscience↗

Data-driven re-referencing of intracranial EEG based on independent component analysis (ICA)

Intracranial recordings from patients implanted with depth electrodes are a valuable source of information in cognitive neuroscience. They allow for the unique opportunity to record brain activity with a high spatial and temporal resolution. To extract the local signal of interest in stereotactic EEG (S-EEG) data, a common pre-processing choice is to re-reference the data with a bipolar montage.\n\nWith bipolar reference, each channel is subtracted from its neighbour in order to reduce commonalities between channels and isolate activity that is spatially confined. We here challenge the assumption that bipolar reference can effectively perform this task. We argue that in order to extract local activity, the distribution of the signal source of interest, as well as the distribution of interfering distant signals and noise sources need to be considered. Those can have a variable spatial extent and are modulated by electrode spacing, location and anatomical characteristics. Those factors are not accounted for by a fixed referencing scheme and bipolar reference can therefore not only decrease the signal to noise ratio (SNR) of the data, but also lead to mislocalization of activity and consequently to misinterpretation of results.\n\nWe promote the perspective of regarding referencing as a spatial filtering operation with fixed coefficients. As an alternative, we propose to use Independent Component Analysis (ICA), to derive filter coefficients that reflect the statistical dependencies of the data at hand. We argue that ICA performs the same task that bipolar referencing pursues, namely undoing the linear superposition of activity and can therefore be used to identify activity that is local. We first describe and demonstrate this procedure on human S-EEG recordings. In a simulation with real data, we then quantitatively show that ICA outperforms the bipolar referencing operation in sensitivity and importantly in specificity when it comes to revealing local time series from the superposition of neighbouring channels.

neuroscience↗