Search bioRxiv⌕ Search

Biology subjects

Boorman, E.

Publications and source records attributed to Boorman, E..

3 recordsLinked to original sources

Neural mechanisms of credit assignment for delayed outcomes during contingent learning

Adaptive behavior in complex environments critically relies on the ability to appropriately link specific choices or actions to their outcomes. However, the neural mechanisms that support the ability to credit only those past choices believed to have caused the observed outcomes remain unclear. Here, we leverage multivariate pattern analyses of functional magnetic resonance imaging (fMRI) data and an adaptive learning task to shed light on the underlying neural mechanisms of such specific credit assignment. We find that the lateral orbitofrontal cortex (lOFC) and hippocampus (HC) code for the causal choice identity when credit needs to be assigned for choices that are separated from outcomes by a long delay, even when this delayed transition is punctuated by interim decisions. Further, we show when interim decisions must be made, learning is additionally supported by lateral frontopolar cortex (lFPC). Our results indicate that lFPC holds previous causal choices in a "pending" state until a relevant outcome is observed, and the fidelity of these representations predicts the fidelity of subsequent causal choice representations in lOFC and HC during credit assignment. Together, these results highlight the importance of the timely reinstatement of specific causes in lOFC and HC in learning choice-outcome relationships when delays and choices intervene, a critical component of real-world learning and decision making.

neuroscience↗

Goal-oriented predictive representations in the human hippocampus

Recent work in cognitive and systems neuroscience has suggested that the hippocampus might support planning, imagination, and navigation by forming "cognitive maps" that capture the structure of physical spaces, tasks, and situations. Critically, navigation involves planning within a context and disambiguating similar contexts to reach a goal. We examined hippocampal activity patterns in humans during a goal-directed navigation task to examine how contextual and goal information are incorporated in the construction and execution of navigational plans. Results demonstrate that, during planning, the hippocampus carries a context-specific representation of a future goal. Importantly, this effect could not be explained by stimulus or spatial information alone. During navigation, we observed reinstatement of activity patterns in the hippocampus ahead of participants required actions, which was strongest for behaviorally relevant points in the sequence. These results suggest that, rather than simply representing overlapping associations, hippocampal activity patterns are powerfully shaped by context and goals.

neuroscience↗

Representation of Task Structure in Human Hippocampus

The hippocampus is thought to support episodic memory, or memory for specific events, but recent work also suggests that it may be involved in extracting structure from the world to guide future decisions and predictions. Recent evidence in rodents suggests that the hippocampus supports decision-making in cooperation with orbitofrontal cortex (OFC), possibly based on representation of task structure. Here, we used functional magnetic resonance imaging (fMRI) to test how the human hippocampus and OFC represents decision-relevant information extracted from previous experiences. Participants performed a task in which they learned values of different foods in grocery store contexts. The task was structured such that we could examine the degree to which neural representations could reflect generalized information about different task structures. Specifically, we manipulated whether a foods desirability varied with store context or not. Some foods were desirable in some store contexts and not in others; some foods were always desirable or undesirable. Participants needed to extract these two task sub-structures (i.e., context-determined vs. context-invariant) from the task structure. We examined hippocampal and OFC activity patterns during a decision-making task after participants were trained with the task structure. Our results showed that both hippocampus and OFC carried task structure information that was relevant to the decision outcomes. Hippocampal and lateral OFC representations differentiated between context-determined (deterministic) and context-invariant (probabilistic) task structures. The degree of this differentiation, an index of task structure representation, was highly correlated between hippocampus and lateral OFC. These results add to a mounting evidence suggesting that the hippocampus and OFC support decision-making by representing task relevant information to the decision outcomes after the task structure is learned.

neuroscience↗