Sex differences in exploration-exploitation strategies during home-cage decision making

Abstract

The exploration-exploitation trade-off refers to the conflict between using known strategies that reliably yield reward (exploitation) and sampling uncertain options that might yield better outcomes (exploration). Dysregulation of this balance is implicated in neuropsychiatric disease, and while sex differences in this balance have been described, the biological bases remain unclear. To quantify sex differences in this trade-off, we tested mice (n=74 male, 62 female) on four home-cage based foraging tasks with an operant pellet dispensing device, Feeding Experimentation Device 3 (FED3). Mice completed the tasks continuously over multiple days and the tasks were their only source of food. Across multiple tasks, males showed higher win-stay behaviour than females, indicating greater exploitation of previously rewarded actions, an effect that was modest in size but highly significant. Power analyses revealed that >30 mice per sex were needed to detect these modest but significant sex differences with 80% power. No consistent sex differences were observed in pellet intake, suggesting that differences in exploitation did not reflect differences in hunger drive or demand for pellets. Exploitation is a more efficient strategy when environmental parameters are fixed, while exploration can be more advantageous when parameters such as reward locations are changing and uncertain. We tested this idea by re-running our mice in a probabilistic foraging task, where actions led to uncertain probabilities of reward. While males continued to show higher levels of win-stay behaviour on this task, this no longer led to increases in accuracy. Behavioural modelling also supported this framework, demonstrating that stronger win-stay behaviour was most advantageous in deterministic models, and less advantageous in probabilistic models. Together, our findings demonstrate that male and female mice have small but significant differences in their exploration-exploitation balance, which leads to more accurate foraging in certain, but not uncertain, environments.