Dopamine and norepinephrine differentially mediate the exploration-exploitation tradeoff

Abstract

The catecholamines dopamine (DA) and norepinephrine (NE) have been implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although the two neuromodulators share a synthesis pathway and are co-activated, they engage in distinct circuits and roles in modulating neural activity across the brain. However, in the computational neuroscience literature, they have been assigned similar roles in modulating the exploration-exploitation tradeoff. Revealing how each neuromodulator contributes to this explore-exploit process is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of dopamine and norepinephrine in mediating exploration, a direct comparison using the same dynamic decision making task is needed. Here, we ran mice in a restless bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA antagonist (flupenthixol), a nonselective DA agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine receptor activity on exploration - increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. The modulation of exploration via beta-noradrenergic activity was mediated by sex. Computational model parameters revealed that dopamine modulation affected exploration via decision noise and norepinephrine modulation via outcome sensitivity. Together, these findings suggested that the mechanisms that govern the transition between exploration and exploitation are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration. Significance StatementBoth dopamine (DA) and norepinephrine (NE) has been implicated in the decision making process. Although these two catecholamines have shared aspects of their biosynthetic pathways and projection targets, they are thought to exert many core functions via distinct neural targets and receptor subtypes. However, the computational neuroscience literature often ascribes similar roles to these catecholamines, despite the above evidence. Resolving this discrepancy is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. This study examines the role of dopamine and norepinephrine on the explore-exploit tradeoff. By testing mice, we were able to compare multiple pharmacological agents within subjects, and examine source of individual differences, allowing direct comparison between the effects of these two catecholamines in modulating decision making.