Search bioRxiv⌕ Search

Biology subjects

Linde-Domingo, J.

Publications and source records attributed to Linde-Domingo, J..

12 recordsLinked to original sources

Episodic memory adaptively expands retrieval through typicality-guided transformation while concrete details remain accessible

Memory faces a fundamental challenge. It has to become flexible enough to be accessed by novel cues without losing the specific information that defines each individual episode. Whether memory transformation solves this problem by sacrificing details or by adaptively expanding retrieval while preserving them is unclear. We tested this by manipulating the match between a memory and its retrieval cue. Participants retrieved object associations after 6, 24 and 48 hours using either the original encoded image or novel exemplars that were more typical or more distinctive of the same object category. Retrieval initially benefited from the originally encoded image, but this advantage was reduced across delay. By 48 hours, a never-seen, more typical exemplar triggered retrieval as effectively as the original one, while the same convergence was not evident for less-typical exemplars. Crucially, such cue expansion was not accompanied by a loss of perceptual specificity. Participants retained access to the originally encoded exemplar across delays, while errors increasingly favoured more typical alternatives. At the item level, stronger episodic memories predicted better access to perceptual detail, but did not predict the tendency of errors for category-like information, which instead increased with delay. This dissociation suggests that memory generalisation and the continued accessibility of visual detail reflect partly separable transformations rather than opposite ends of a single continuum.

neuroscience↗

Bayesian surprise tracks the strength of perceptual insight

Suddenly finding the solution to a problem after a period of impasse often comes with a feeling of insight. This subjective experience is proposed to arise as a consequence of prediction errors. Accordingly, previous studies have revealed that more incorrect initial predictions result in more intense insights. Crucially however, prominent models of Bayesian inference suggest levels of computationally-defined surprise are not a simple feature of distance between predictions and inputs, but also their precision or certainty. Yet, how these two factors interact to give rise to insight experiences remains unknown. In this pre-registered study, participants were exposed to ambiguous images while they tried to guess the correct label of the image (to derive prediction accuracy) and rated their confidence in that label (for prediction uncertainty). We then measured the intensity of their insight when a solution was given. As predicted, we found that the intensity of insight was a result of both the prediction accuracy and the uncertainty awarded to it. More specifically, when initial predictions were far from the true label, those made with lower confidence induced weaker insights, while the opposite pattern was observed when predictions were closer to the reality. Trial-by-trial estimations of prediction errors from participants responses closely mirrored insight ratings. Finally, we analysed data from two additional independent datasets with different modalities and setups and replicated the interaction between prediction accuracy and uncertainty on the intensity of insight. Altogether, these findings suggest that insight experiences are read out from prediction errors and highlight the key role of uncertainty in characterising this relationship.

neuroscience↗

Characterising semantic prioritisation in visual working memory

Cognitive operations require recently encountered information to remain available beyond the moment of sensory input. However, how such transient representations are accessed, and how they differ from sensory processing and long-term memory, remains unclear. Here, we combine hierarchical drift-diffusion modelling with behavioural manipulations to dissociate the decision processes underlying feature prioritisation in visual working memory. We first reanalysed a previously collected working memory dataset to characterise semantic and perceptual judgements at the level of latent decision processes. Semantic judgements were associated with reduced non-decision time across conditions, indicating faster access to task-relevant information, while advantages in evidence accumulation emerged selectively under higher cognitive demands. Two further experiments manipulated attentional prioritisation using retro-cues and dissociated the effects of interference from mere maintenance. Across manipulations, semantic prioritisation was selectively expressed in pre-accumulation processes and was amplified when representations fell outside the focus of attention or had to be maintained under interference. Together, these results suggest that semantic representations remain more readily accessible than perceptual details when working memory representations fall outside the focus of attention, consistent with a shift towards more abstract, long-term memory-like formats under conditions of limited attentional support.

neuroscience↗

Dynamic prioritization reshapes neural geometries for action in human working memory

Prior work has shown that control brain regions encode upcoming novel instructed actions. Similarly, visual working memory (WM) representations can reflect different priority states. However, it remains unknown whether the priority status of WM-guided novel actions similarly modulates their neural coding format, and how such dynamics unfold over time. We addressed these questions using EEG while human participants performed two consecutive choice reaction tasks. At the start of each trial, participants encoded two novel stimulus-response (S-R) mappings. A cue then indicated whether these mappings would be relevant immediately ("current" condition), later after an intervening task ("prospective"), or after a free delay ("delayed"). Using multivariate pattern analysis, we found that the S-R category was decodable in all conditions during relevant time windows. Critically, pattern similarity analyses revealed that while mere maintenance demands allow for temporary preservation of neural codes (i.e., between current and delayed trials), shielding from interference (i.e., prospective trials) induced significant alterations to the neural code. Further exploration of the representational geometry revealed that priority status gained prominence dynamically over S-R category coding when preparing for such shielding demands. Importantly, some of these changes emerged anticipatorily, prior to target onset. Overall, our results show that, similar to visual WM, the priority of intended actions dynamically and anticipatorily reshapes their neural format. They further reveal how different demands induce content geometries compatible with previously proposed coding schemes, and that such representational changes can be implemented flexibly in time. Significance statementSuccessfully translating visuomotor plans into action relies not only on maintaining such plans but also on prioritizing relevant information at the right time. While prior work has shown that working memory representations adapt to prioritize visual content, it remains unknown whether similar mechanisms apply to action-guiding content. Using EEG and multivariate analyses, we show that priority states--whether immediate, delayed, or prospectively relevant--modulate the representational geometry of novel stimulus-response mappings. Notably, the anticipation of interference compared to mere maintenance leads to greater alterations in the neural code during a retention interval. These results demonstrate that neural representations of novel instructed actions are shaped by their priority state and upcoming demands and reveal how goal- relevant information is restructured over time.

neuroscience↗

Determinants of visual ambiguity resolution

Visual inputs during natural perception are highly ambiguous: objects are frequently occluded, lighting conditions vary, and object identification depends significantly on prior experiences. However, why do certain images remain unidentifiable while others can be recognized immediately, and what visual features drive subjective clarification? To address these critical questions, we developed a unique dataset of 1,854 ambiguous images and collected more than 100,000 ratings (from a total of 947 participants) evaluating their identifiability before and after seeing undistorted versions of the images. Relating the representations of a brain-inspired neural network model in response to our images with human ratings, we show that subjective identification depends largely on the extent to which higher-level visual features from the original images are preserved in their ambiguous counterparts. In line with these results, an image-level regression analysis showed that the subjective identification of ambiguous images was best explained by high-level visual dimensions. Notably, the predominance of higher-level features over lower-level ones softens after participants disambiguate the images, suggesting that the visual system flexibly shifts between top-down guessing to bottom-up matching after disambiguation. Moreover, we found that the process of ambiguity resolution was accompanied by a notable decrease in semantic distance and a greater consistency in object naming among participants. However, the relationship between information gained after disambiguation and subjective identification was non-linear, indicating that acquiring more information does not necessarily enhance subjective clarity. Instead, we observed a U-shaped relationship, suggesting that subjective identification improves when the acquired information either strongly matches or mismatches prior predictions. Collectively, these findings advance our understanding on how we resolve ambiguity and extract meaning from incomplete visual information.

neuroscience↗

Reconstructing Spatio-Temporal Trajectories of Visual Object Memories in the Human Brain

Our understanding of how information unfolds when we recall events from memory remains limited. In this study, we investigate whether the reconstruction of visual object memories follows a backward trajectory along the ventral visual stream with respect to perception, such that their neural feature representations are gradually reinstated from late areas close to the hippocampus backwards to lower-level sensory areas. We use multivariate analyses of fMRI activation patterns to map high-and low-level features of the object memories onto the brain during retrieval, and EEG-fMRI fusion to track the temporal evolution of the reactivated patterns. Participants studied new associations between verbs and randomly paired object images in an encoding phase, and subsequently recalled the objects when presented with the corresponding verb cue. Decoding reactivated memory features from fMRI activity revealed that retrieval patterns were dominated by conceptual features, represented in comparatively late visual and parietal areas. Representational-similarity-based fusion then allowed us to map the EEG patterns that emerged at each given time point of a trial onto the spatially resolved fMRI patterns. This fusion suggests that memory reconstruction proceeds from anterior fronto-temporal to posterior occipital and parietal regions, partly in line with a semantic-to-perceptual gradient. A linear regression on the peak time points of reactivated brain regions statistically confirms that the temporal progression is reversed with respect to encoding in ventral stream areas. Together, the results shed light onto the spatio-temporal trajectories along which memories and their constituent features are reconstructed during associative retrieval. Significance statementIn our work, we combined EEG and fMRI to investigate which features of a visual object are reactivated when recalled from episodic memory, and how the memory reconstruction stream unfolds over time and across the brain. Our findings suggest that with respect to perception, memory retrieval follows a backwards information trajectory along a conceptual-to-perceptual gradient, and additionally relays retrieved information to multimodal fronto-parietal brain regions. These findings address the fundamental question of whether memories are more or less complete and truthful reconstructions of past events, or instead are subject to systematic biases that prioritise some types of features over others. Our data suggests that episodic memory retrieval is a dynamic and highly reconstructive process with clear prioritisation of abstract-conceptual over detailed-perceptual information.

neuroscience↗

Geometry of visual working memory information in human gaze patterns

Stimulus-dependent eye movements have been recognized as a potential confound in decoding visual working memory information from neural signals. Here, we combined eye-tracking with representational geometry analyses to uncover the very information in miniature gaze patterns while participants (n = 41) were cued to maintain visual object orientations. Although participants were discouraged from breaking fixation via real-time feedback, small gaze shifts (< 1 degree) robustly encoded the to-be-maintained stimulus orientation, with evidence for encoding two sequentially presented orientations at the same time. While the orientation encoding upon stimulus presentation was object-specific, it changed to a more object-independent format during cued maintenance, particularly when attention had been temporarily withdrawn from the memorandum. Finally, categorical reporting biases increased after unattended storage, with indications of biased gaze geometries emerging already during the maintenance periods prior to behavioral reporting. These findings disclose a wealth of information in gaze patterns during visuospatial working memory, and suggest systematic changes in representational format when memory contents have been unattended.

neuroscience↗

Prioritization of semantic over visuo-perceptual aspects in multi-item working memory

Working Memory (WM) keeps information temporarily available for upcoming tasks. How the contents of WM are distinguished from perceptual representations on the one hand, and from long-term memories on the other, is still debated. Here, we leveraged recent evidence for a reversal of processing dynamics when retrieving episodic long-term memories as opposed to perceiving visual input. In two experiments (n=75 and n=103), we asked participants to hold one or more items in WM and to report their low-level perceptual and high-level semantic qualities. In both experiments, we found faster responses to the items semantic qualities, indicating prioritization over visuo-perceptual aspects, when two or more items were held concurrently in WM. These dynamics of accessing information in multi-item WM were akin to those in retrieving episodic long-term memories and opposite to those in processing visual inputs. Little to no semantic prioritization was evident during single-item maintenance, consistent with a strictly capacity-limited focus of attention within which WM information can be transformed into a prospective action plan.

neuroscience↗

Asymmetric learning facilitates human inference of transitive relations

Humans and other animals are capable of inferring never-experienced relations (e.g., A>C) from other relational observations (e.g., A>B and B>C). The processes behind such transitive inference are subject to intense research. Here, we demonstrate a new aspect of relational learning, building on previous evidence that transitive inference can be accomplished through simple reinforcement learning mechanisms. We show in simulations that inference of novel relations benefits from an asymmetric learning policy, where observers update only their belief about the winner (or loser) in a pair. Across 4 experiments (n=145), we find substantial empirical support for such asymmetries in inferential learning. The learning policy favoured by our simulations and experiments gives rise to a compression of values which is routinely observed in psychophysics and behavioural economics. In other words, a seemingly biased learning strategy that yields well-known cognitive distortions can be beneficial for transitive inferential judgments.

neuroscience↗

Feature-specific reaction times reveal a semanticisation of memories over time and with repeated remembering

Memories are thought to undergo an episodic-to-semantic transformation in the course of their consolidation. We here tested if repeated recall induces a similar semanticization, and if the resulting qualitative changes in memories can be measured using simple feature-specific reaction time probes. Participants studied associations between verbs and object images, and then repeatedly recalled the objects when cued with the verb, immediately and after a two-day delay. Reaction times during immediate recall demonstrated that conceptual features were accessed faster than perceptual features. Consistent with a semanticization process, this perceptual-conceptual gap significantly increased across the delay. A significantly smaller perceptual-conceptual gap was found in the delayed recall data of a control group who repeatedly studied the verb-object pairings on the first day, instead of actively recalling them. Our findings suggest that wake recall and offline consolidation interact to transform memories over time, strengthening meaningful semantic information over perceptual detail.

neuroscience↗

Autobiographical memory reactivation in empathy

Empathy relies on the ability to mirror and to explicitly infer others inner states. Theoretical accounts suggest that memories play a role in empathy but direct evidence of a reactivation of autobiographical memories (AM) in empathy is yet to be shown. We addressed this question in two experiments. In experiment 1, electrophysiological activity (EEG) was recorded from 28 participants who performed an empathy task in which targets for empathy were depicted in contexts for which participants either did or did not have an AM, followed by a task that explicitly required memory retrieval of the AM and non-AM contexts. The retrieval task was implemented to extract the neural fingerprints of AM and non-AM contexts, which were then used to probe data from the empathy task. An EEG pattern classifier was trained and tested across tasks and showed evidence for AM reactivation when participants were preparing their judgement in the empathy task. Participants self-reported higher empathy for people depicted in situations they had experienced themselves as compared to situations they had not experienced. A second independent fMRI experiment replicated this behavioural finding and showed the predicted activation in the brain networks underlying both AM retrieval and empathy: precuneus, posterior parietal cortex, superior and inferior parietal lobule and superior frontal gyrus. Together, our study reports behavioural, electrophysiological and fMRI evidence that robustly supports the involvement of AM reactivation in empathy.

neuroscience↗

Evidence for a reversal of the neural information flow between object perception and object reconstruction from memory

Remembering is a reconstructive process. Surprisingly little is known about how the reconstruction of a memory unfolds in time in the human brain. We used reaction times and EEG time-series decoding to test the hypothesis that the information flow is reversed when an event is reconstructed from memory, compared to when the same event is initially being perceived. Across three experiments, we found highly consistent evidence supporting such a reversed stream. When seeing an object, low-level perceptual features were discriminated faster behaviourally, and could be decoded from brain activity earlier, than high-level conceptual features. This pattern reversed during associative memory recall, with reaction times and brain activity patterns now indicating that conceptual information was reconstructed more rapidly than perceptual details. Our findings support a neurobiologically plausible model of human memory, suggesting that memory retrieval is a hierarchical, multi-layered process that prioritizes semantically meaningful information over perceptual detail.

neuroscience↗