Search bioRxiv⌕ Search

Biology subjects

Karami, B.

Publications and source records attributed to Karami, B..

3 recordsLinked to original sources

The Spatial Frequency Representation Predicts Category Coding in the Inferior Temporal Cortex

Understanding the neural representation of spatial frequency (SF) in the primate cortex is vital for unraveling visual processing mechanisms in object recognition. While numerous studies concentrate on the representation of SF in the primary visual cortex, the characteristics of SF representation and its interaction with category representation remain inadequately understood. To explore SF representation in the inferior temporal (IT) cortex of macaque monkeys, we conducted extracellular recordings with complex stimuli systematically filtered by SF. Our findings disclose an explicit SF coding at single-neuron and population levels in the IT cortex. Moreover, the coding of SF content exhibits a coarse-to-fine pattern, declining as the SF increases. Temporal dynamics analysis of SF representation reveals that low SF (LSF) is decoded faster than high SF (HSF), and the SF preference dynamically shifts from LSF to HSF over time. Additionally, the SF representation for each neuron forms a profile that predicts category selectivity at the population level. IT neurons can be clustered into four groups based on SF preference, each exhibiting different category coding behaviors. Particularly, HSF-preferred neurons demonstrate the highest category decoding performance for face stimuli. Despite the existing connection between SF and category coding, we have identified uncorrelated representations of SF and category. In contrast to the category coding, SF is more sparse and places greater reliance on the representations of individual neurons. Comparing SF representation in the IT cortex to deep neural networks, we observed no relationship between SF representation and category coding. However, SF coding, as a category-orthogonal property, is evident across various ventral stream models. These results dissociate the separate representations of SF and object category, underscoring the pivotal role of SF in object recognition.

neuroscience↗

Visual Perceptual Learning of Feature Conjunctions Leverages Non-linear Mixed Selectivity

Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning conjunctions. Visual cortex is organized into separate compartments, each of which is devoted to processing a single feature. A prime example of this is are neurons purely selective to color and orientation, respectively. However, neurons that jointly encode multiple features (mixed selectivity) also exist across the brain and play critical roles in a multitude of tasks. Here, we sought to uncover the optimal policy that our brain adapts to achieve conjunction learning using these available resources. 59 human subjects practiced orientation-color conjunction learning in four psychophysical experiments designed to nudge the visual system towards using one or the other resource. We find that conjunction learning is possible by linear mixing of pure color and orientation information, but that more and faster learning takes place when pure and mixed selectivity neurons are involved. We also find that learning with mixed selectivity confers advantages in performing an untrained "exclusive or" (XOR) task several months after learning the original conjunction task. This study sheds light on possible mechanisms underlying conjunction learning and highlights the importance of learning by mixed selectivity in such accounts.

neuroscience↗

The Effect of Spatial Frequency on the Visual Category Representation in the Macaque Inferior Temporal Cortex

To expand our knowledge about the object recognition, it is critical to understand the role of spatial frequency (SF) in an object representation that occurs in the inferior temporal (IT) cortex at the final stage of processing the visual information across the ventral visual pathway. Object categories are being recognized hierarchically in at least three levels of abstraction: superordinate (e.g., animal), mid-level (e.g., human face), and subordinate (e.g., face identity). Psychophysical studies have shown rapid access to mid-level category information and low SF (LSF) contents. Although the hierarchical representation of categories has been shown to exist inside the IT cortex, the impact of SF on the multi-level category processing is poorly understood. To gain a deeper understanding of the neural basis of the interaction between SF and category representations at multiple levels, we examined the neural responses within the IT cortex of macaque monkeys viewing several SF-filtered objects. Each stimulus could be either intact or bandpass filtered into either the LSF (coarse shape information) or high SF (HSF) (fine shape information) bands. We found that in both High- and Low-SF contents, the advantage of mid-level representation has not been violated. This evidence suggests that mid-level category boundary maps are strongly represented in the IT cortex and remain unaffected with respect to any changes in the frequency content of stimuli. Our observations indicate the necessity of the HSF content for the superordinate category representation inside the IT cortex. In addition, our findings reveal that the representation of global category information is more dependent on the HSF than the LSF content. Furthermore, the lack of subordinate representation in both LSF and HSF filtered stimuli compared to the intact stimuli provide strong evidence that all SF contents are necessary for fine category visual processing.

neuroscience↗