bioRxiv · 10.1101/2024.06.10.598294
Neural Prioritisation of Past Solutions Supports Generalisation
Abstract
Generalisation from past experience is an important feature of intelligent systems. When faced with a new task, one efficient computational approach is to evaluate solutions to earlier tasks as candidates for reuse. Consistent with this idea, we found that human participants (n=38) learned optimal solutions to a set of training tasks and generalised them to novel test tasks in a reward selective manner. This behaviour was consistent with a computational process based on the successor representation known as successor features and generalised policy improvement (SF&GPI). Neither model-free perseveration or model-based control using a complete model of the environment could explain choice behaviour. Decoding from functional magnetic resonance imaging data revealed that solutions from the SF&GPI algorithm were activated on test tasks in visual and prefrontal cortex. This activation had a functional connection to behaviour in that stronger activation of SF&GPI solutions in visual areas was associated with increased behavioural reuse. These findings point to a possible neural implementation of an adaptive algorithm for generalisation across tasks.
Source connections
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Hall-McMaster, S., Tomov, M. S., Gershman, S. J., Schuck, N. W.. 2024-06-10. Neural Prioritisation of Past Solutions Supports Generalisation. https://doi.org/10.1101/2024.06.10.598294
Cite the original work for its findings. Save a collection to share your selection of sources.