Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/107078

Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans

Lee, J.·Keramati, M.
View original source ↗Export metadata ↓

Abstract

Decision-making in the real world presents the challenge of requiring flexible yet prompt behavior, a balance that has been characterized in terms of a trade-off between a slower, prospective goal-directed model-based (MB) strategy and a fast, retrospective habitual model-free (MF) strategy. Theory predicts that flexibility to changes in both reward values and transition contingencies can determine the relative influence of the two systems in reinforcement learning, but few studies have manipulated the latter. Therefore, we developed a novel two-level contingency change task in which transition contingencies between states change every few trials; MB and MF control predict different responses following these contingency changes, allowing their relative influence to be inferred. Additionally, we manipulated the rate of contingency changes in order to determine whether contingency change volatility would play a role in shifting subjects between a MB and MF strategy. We found that human subjects employed a hybrid MB/MF strategy on the task, corroborating the parallel contribution of MB and MF systems in reinforcement learning. Further, subjects did not remain at one level of MB/MF behavior but rather displayed a shift towards more MB behavior over the first two blocks that was not attributable to the rate of contingency changes but rather to the extent of training. We demonstrate that flexibility to contingency changes can distinguish MB and MF strategies, with human subjects utilizing a hybrid strategy that shifts towards more MB behavior over blocks, consequently corresponding to a higher payoff.\n\nAuthor SummaryTo make good decisions, we must learn to associate actions with their true outcomes. Flexibility to changes in action/outcome relationships, therefore, is essential for optimal decision-making. For example, actions can lead to outcomes that change in value - one day, your favorite food is poorly made and thus less pleasant. Alternatively, changes can occur in terms of contingencies - ordering a dish of one kind and instead receiving another. How we respond to such changes is indicative of our decision-making strategy; habitual learners will continue to choose their favorite food even if the quality has gone down, whereas goal-directed learners will soon learn it is better to choose another dish. A popular paradigm probes the effect of value changes on decision making, but the effect of contingency changes is still unexplored. Therefore, we developed a novel task to study the latter. We find that humans used a mixed habitual/goal-directed strategy in which they became more goal-directed over the course of the task, and also earned more rewards with increasing goal-directed behavior. This shows that flexibility to contingency changes is adaptive for learning from rewards, and indicates that flexibility to contingency changes can reveal which decision-making strategy is used.

Source connections

Explore related subjects

animal behavior and cognitionPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Lee, J., Keramati, M.. 2017-02-24. Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans. https://doi.org/10.1101/107078

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Development of the Highly Sensitive Horse questionnaire to assess horses' sensory processing sensitivity

It is well established that individuals vary in how they respond to situations, but might they also perceive their environment differently? Sensory Processing Sensitivity (SPS) is a multidimensional trait describing individual variation in the perception and response to sensory, emotional, and social stimuli. While extensively studied in humans, its presence in animals remains underexplored. We investigated whether horses might exhibit a comparable trait and developed the Highly Sensitive Horse questionnaire to assess equine SPS. A 104-item questionnaire was developed and refined using data from an online survey of 121 horses. The remaining 45 items were evaluated in an independent survey of 561 horses. Exploratory and confirmatory factor analyses identified a robust two-factor, 12-item structure reflecting dimensions similar to the human SPS dimensions of: Overstimulation, describing a tendency to become overwhelmed by intense or prolonged stimuli, and Sensitivity to subtleties, describing heightened perception of subtle environmental changes. The scale showed high internal consistency, excellent intra-rater and moderate inter-rater reliability. Although eSPS was associated with established behavioural traits, including fearfulness, it also explained unique behavioural variation beyond these traits. These findings suggest that horses differ in how they perceive their environment, providing a foundation to better understand equine behaviour, and opening new avenues for comparative sensory-processing research.

animal behavior and cognition↗
bioRxiv2026

Behavioral divergence across replicated predation regimes is species-specific in two sympatric poeciliid fishes

Predation is a potent driver of behavioral divergence across prey populations, yet whether shared predation regimes generate similar responses in coexisting prey species remains unclear. Species differences in reproductive and foraging traits may alter vulnerability to predators, generating species-specific responses. We compared behavior and cognition of two poeciliid fishes (Gambusia affinis and Poecilia latipinna) that differ in body size, the presence of male ornamentation, and mating tactics. We sampled both species across replicate high- and low-predation regimes and measured exploration, shyness, boldness, social motivation, and detour solve latency (N = 509). Multivariate behavior and cognition differed between predation regimes, and the magnitude of divergence varied with species but not body size. Consistent with the multivariate pattern, the more conspicuous P. latipinna exhibited higher boldness and overall lower exploration under high-predation, while high- and low-predation populations of G. affinis did not differ. These findings suggest either that the more conspicuous species experiences greater predation risk or that the less conspicuous species reduces its predation risk through alternative phenotypic responses. More broadly, species differences in reproductive phenotypes associated with sexual selection may help explain why shared predation regimes generate variable patterns of behavioral divergence across taxa.

animal behavior and cognition↗
bioRxiv2026

Capturing the rhythm: methodological choices shape inference from circadian activity data

Abstract 1. Statistical tools and analytical decisions for analysing animal activity data are often limited and poorly justified, particularly with respect to model choice, sampling design and temporal aggregation. These shortcomings can constrain our ability to draw accurate and biologically meaningful inferences about behaviour. 2. We interrogated 24 h activity data taken from individual males and females derived from five Drosophila melanogaster populations to generate a general framework for collecting and analysing activity data that systematically compares common model classes, continuous verses fragmented sampling strategies, and alternative temporal aggregation choices (time-bin sizes). 3. Our analyses identified generalised additive mixed models (GAMMs) applied to high-frequency continuous data with small-moderate bin sizes (1-5 minutes) as providing the most robust and interpretable inference for our complex, high-frequency activity data. 4. However, our interrogation of the data set confirmed that analytical and sampling decisions need to be tailored to the study species, the timing of activities and the nature of the behaviour of interest. Accordingly, polynomial and cosinor generalised linear models, increased but biologically targeted snapshot sampling, and bin sizes smaller than one hour yielded adequate analyses with similar biological conclusions when appropriately matched to the system. 5. Our approach provides an accessible decision-making framework for activity analyses that allows researchers across behavioural, ecological and evolutionary studies to justify and optimise choices about data collection and modelling. Such an approach improves the biological relevance of inference and supporting the use of modern tracking and analytical technologies.

animal behavior and cognition↗