Multiple task-demands flexibly optimize neural geometry in human ventral temporal cortex

Abstract

A hallmark of human intelligence is the ability to perform multiple tasks immediately upon instruction. Yet, the neural processes that implement such flexibility remain unclear. Using intracranial electrophysiology in epilepsy patients, we examined how representational geometries evolve as participants switched among three tasks - individuation, categorization, and conceptualization - on a trial-by-trial basis. Although tasks differed in the required representational geometries, neural representations across cortex were not immediately optimized following task cues. Instead, task-tailored geometries emerged gradually over successive stimulus repetitions within a trial. Ventral temporal cortex was the only region to exhibit task-specific adjustments for all three tasks, dynamically transforming within- and between-category distances in line with task demands. Importantly, these gradual representational changes were behaviorally relevant, predicting trial-level performance. Our results show that behavioral flexibility is supported by incremental, task-dependent refinement of representational geometry already within sensory cortex - far earlier in the processing hierarchy than previously thought.