Mas-Herrero, E. | Search bioRxiv

bioRxiv2018

Intrinsically regulated learning is modulated by synaptic dopamine availability

We recently provided evidence that an intrinsic reward-related signal--triggered by successful learning in absence of any external feedback--modulated the entrance of new information into long-term memory via the activation of the dopaminergic midbrain, hippocampus, and ventral striatum (the SN/VTA-Hippocampal loop; Ripolles et al., 2016). Here, we used a double-blind, within-subject randomized pharmacological intervention to test whether this learning process is indeed dopamine-dependent. A group of healthy individuals completed three behavioural sessions of our learning task after the intake of different pharmacological treatments: a dopaminergic precursor, a dopamine receptor antagonist or a placebo. Results show that the pharmacological intervention bidirectionally modulated behavioral measures of both learning and pleasantness, inducing memory benefits after 24 hours only for those participants with a high sensitivity to reward. These results provide causal evidence for a dopamine-dependent mechanism instrumental in intrinsically regulated learning, and further suggest that subject-specific dopamine sensitivity drastically alters learning success.

neuroscience↗

bioRxiv2017

The contribution of striatal pseudo-reward prediction errors to value-based decision-making

Most studies that have investigated the brain mechanisms underlying learning have focused on the ability to learn simple stimulus-response associations. However, in everyday life, outcomes are often obtained through complex behavioral patterns involving a series of actions. In such scenarios, parallel learning systems are important to reduce the complexity of the learning problem, as proposed in the framework of hierarchical reinforcement learning (HRL). One of the key features of HRL is the computation of pseudo-reward prediction errors (PRPEs) which allow the reinforcement of actions that led to a sub-goal before the final goal itself is achieved. Here we wanted to test the hypothesis that, despite not carrying any rewarding value per se, pseudo-rewards might generate a bias in choice behavior when reward contingencies are not well-known or uncertain. Second, we also hypothesized that this bias might be related to the strength of PRPE striatal representations. In order to test these ideas, we developed a novel decision-making paradigm to assess reward prediction errors (RPEs) and PRPEs in two studies (fMRI study: n = 20; behavioural study: n = 19). Our results show that overall participants developed a preference for the most pseudo-rewarding option throughout the task, even though it did not lead to more monetary rewards. fMRI analyses revealed that this preference was predicted by individual differences in the relative striatal sensitivity to PRPEs vs RPEs. Together, our results indicate that pseudo-rewards generate learning signals in the striatum and subsequently bias choice behavior despite their lack of association with actual reward.

neuroscience↗