Neural coding of fine-grained object knowledge in perirhinal cortex

Abstract

SummaryOver 40 years of research has examined the role of the ventral visual stream in transforming retinal inputs into high-level representations of object identity [1-6]. However, there remains an ongoing debate over the role of the ventral stream in coding abstract semantic content, which relies on stored knowledge, versus perceptual content that relies only on retinal inputs [7-12]. A major difficulty in adjudicating between these mechanisms is that the semantic similarity of objects is often highly confounded with their perceptual similarity (e.g., animate things are more perceptually similar to other animate things than to inanimate things). To address this problem, we developed a paradigm that exploits the statistical regularities of object colors while perfectly controlling for perceptual shape information, allowing us to dissociate lower-level perceptual features (i.e., color perception) from higher-level semantic knowledge (i.e., color meaning). Using multivoxel-pattern analyses of fMRI data, we observed a striking double dissociation between the processing of color information at a perceptual and at a semantic level along the posterior to anterior axis of the ventral visual pathway. Specifically, we found that the visual association region V4 assigned similar representations to objects with similar colors, regardless of object category. In contrast, perirhinal cortex, at the apex of the ventral visual stream, assigned similar representations to semantically similar objects, even when this was in opposition to their perceptual similarity. These findings suggest that perirhinal cortex untangles the representational space of lower-level perceptual features and organizes visual objects according to their semantic interpretations.