Search bioRxiv⌕ Search

bioRxiv · 10.1101/2024.12.23.628672

Reactivation of reward representations associated with the reinforcement of behavior

Abstract

Reward-related representations are found distributed throughout many human subcortical and neocortical regions that support different neural processes. These representations get reinstated for different but related tasks. There is rising evidence that representations reactivate during learning to reinforce prior rewarding choices. However, there remains a critical lack of understanding for whether and how reactivations in humans can facilitate behavioral reinforcement. To investigate this, we recorded from the temporal lobe and prefrontal cortex with intracranial electrocorticography while human subjects learnt two-choice decisions across two different scenes. Crucially, subjects were able to straightforwardly reactivate knowledge gained in a prior scene to make decisions in the current scene, but only when the reward contingencies stayed the same between the two scenes. Using a Bayesian learner, we inferred reward expectation from choice behavior, and measured representations of these reward expectations in electrocorticography data. We found that the representations of reward expectation in the medial temporal lobe and orbitofrontal cortex were reactivated, only when the subjects could straightforwardly transfer knowledge between the two scenes. In the anterior temporal lobe, the reactivation of reward representations increased as learning increased, suggesting an area of plasticity during learning. This work presents a novel framework for measuring the reinforcement, or reactivation, of representations from human electrophysiology during the reinforcement of behavior. Significance statementThis study provides a framework for how the brain processes and reinstates reward-related information during the reinforcement of behavior. Using intracranial electrocorticography, the researchers found that reward information is encoded in distant brain regions, the medial temporal lobe and orbitofrontal cortex. These representations are dynamically reinstated across scenes when reward contingencies align and when knowledge can be transferred. Additionally, reward-related representations in the anterior temporal lobe become increasingly reinforced or reinstated as learning progresses, revealing an area of plasticity during learning. These findings offer new insights into the neural mechanisms underlying decision-making and highlight potential avenues for addressing conditions like addiction or depression, where reward processing and decision-making are disrupted.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tong, A. P. S., Sreekumar, V., Inati, S. K., Zaghloul, K. A., Woolrich, M. W.. 2024-12-24. Reactivation of reward representations associated with the reinforcement of behavior. https://doi.org/10.1101/2024.12.23.628672

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Enhanced cortical tracking of unfamiliar languages in both monolinguals and bilinguals

Humans routinely encounter speech in languages they have never heard, yet how the brain responds to such input and whether bilingual experience shapes this response remains unknown. Here, we used electroencephalography (EEG) and temporal response function (TRF) modeling to examine cortical tracking of the speech envelope in 24 English-monolingual and 24 English-Mandarin bilingual adults. Participants listened to naturally produced continuous speech in three languages: English (familiar to all), Mandarin (familiar to bilinguals only), and Vietnamese (unfamiliar to all). We report two main findings. First, both monolinguals and bilinguals showed enhanced cortical tracking for unfamiliar relative to familiar languages, evidenced by higher EEG prediction accuracy (PA). Monolinguals showed enhanced tracking for both Mandarin and Vietnamese, whereas bilinguals showed enhancement only for Vietnamese, consistent with Mandarin being a familiar language for this group. This finding suggests that enhanced cortical encoding of unfamiliar speech is a general property of the listening brain, not a signature of listening to a non-native language or reduced language proficiency. Second, bilinguals strikingly showed stronger cortical tracking than monolinguals overall, in both PA and TRF peak weights, with the TRF peak weight advantage present across all three languages, suggesting a difference in how bilingual experience shapes the neural encoding of speech. These findings have implications for understanding how the brain navigates the linguistic diversity of everyday life in an increasingly global, multilingual world.

neuroscience↗

Endosomal pH Triggers Amyloid β Oligomerization and Maladaptive Phenotypic Plasticity in Alzheimers Disease

Endosomal dysfunction is a presymptomatic hallmark of neurodegeneration. Recent evidence highlights dysregulation of endosomal pH as a central pathogenic hub in Alzheimer's disease (AD); however, the mechanisms linking pH shifts to neurodegeneration remain incompletely defined. Here, we use a quantitative model of endosomal acidification driven by proton pumping via the vacuolar ATPase, proton leak via the endosomal Na/H exchanger NHE6, and other ion-regulating elements. The model recapitulates how downregulation of NHE6 in AD promotes endosomal hyperacidification, potentially triggering maladaptive phenotypic plasticity, an initially adaptive response that becomes pathological. Analysis of human brain datasets reveals reciprocal enrichment of NHE6 in neurons and the related NHE9 in glia, with NHE6 co-expression networks enriched for synaptic signalling. Systematic curation of NHE6 patient variants indicates that loss-of-function is associated with late regression, consistent with progressive endosomal hyperacidification, supporting a conceptual framework where early compensation transitions to neurodegeneration. Mathematical analyses calibrated for neuronal endosomes reveal a saturable relationship between luminal pH and NHE6 dosage, with threshold-like behaviour below ~50% expression that hyperacidifies endosomes, correlating with AD severity. Our model suggests this pH shift may exponentially accelerate A{beta} oligomerization and enhance {beta}-secretase activity. Furthermore, A{beta} oligomerization estimates correlate with dysregulation of calcium signalling and synaptic dysfunction. Model findings are compared with experimental results from NHE6-null mice and a cell culture model of AD. Drawing parallels to cancer, we propose that endosomal pH serves as a conserved regulator of adaptive-to-maladaptive transitions. Restoring physiological endosomal pH may offer a therapeutic window to prevent irreversible neurodegeneration in AD.

neuroscience↗

Diet Quality from Midlife to Later Life Relates to Late-Life Brain Health and Verbal Memory in the SG70 Cohort

Healthy diet across adulthood is associated with better late-life cognition, but how life-course diet quality relates to brain integrity, and whether brain measures mediate diet-cognition associations, remains unclear as studies with long-term diet records and detailed neurocognitive measures are lacking. We studied 892 participants from the SG70 study, nested within the Singapore Chinese Health Study, with adherence to the Dietary Approaches to Stop Hypertension diet (DASH) assessed between 1993--2025. Dietary quality during midlife, ages 44--55 years, and early elderhood, ages 61--73 years, was examined in relation to seven cognitive domains, brain morphometry, white matter hyperintensities and free-water MRI markers in late life, ages 68--82 years. Higher DASH adherence at both life stages was significantly associated with better late-ife verbal memory, and remained so when both life stages were modelled jointly. Higher midlife DASH adherence was associated with greater white matter volume in association tracts, whereas higher early-elderhood DASH adherence was associated with lower white matter hyperintensity (deep basal ganglia and anterior periventricular regions) and lower frontal and occipital grey matter free water, suggesting lower neurovascular and inflammatory burden. Mediation analyses indicated that white matter volume accounted for 12.3% in mediating the midlife DASH--verbal memory association, while cortical free water accounted for 12.5% in mediating the early-elderhood DASH--verbal memory association. Importantly, participants whose DASH adherence improved from lower adherence in midlife to better adherence in later life showed better verbal memory and more favourable brain integrity than those with persistently low adherence. These findings identify midlife and post-midlife diet quality as modifiable life-course exposures associated with late-life cognitive resilience through differences in macrostructural and microstructural brain integrity.

neuroscience↗