Search bioRxiv⌕ Search

Biology subjects

Maniquet, T.

Publications and source records attributed to Maniquet, T..

2 recordsLinked to original sources

Can category-selective cortex predict categorisation behaviour?

One of the distinctive features of the human visual system is the presence in occipito-temporal cortex (OTC) of regions that show preferential activation to specific categories of visual objects. To understand how this selectivity relates to categorisation behaviour, studies have employed a distance-to-bound approach (DTB), where multivariate brain activity is used to estimate a decision boundary, from which behavioural performance can be predicted. Using this approach, correlations have been found between activity in OTC, and behavioural performance when carrying out certain categorisation tasks. However, it remains unclear what determines where in OTC this correlations can be found, and with which categorisation tasks they can be found. Here, we bridged this gap by relating category-selective regions of OTC, to behavioural performance while participants categorised images as belonging or not to their preferred categories. We adopted a more basic approach and considered simple, univariate activity, rather than relying on decoding to build our DTB. Our results show that activation in regions selective to faces (FFA & OFA), bodies (EBA), and scenes (PPA), is sufficient to predict behavioural performance while categorising images as being faces, bodies, or scenes, respectively. These results are largely consistent across reaction time and motor movements, and generalise to animacy classification. Overall, our data adds to evidence that category-selective regions in OTC can serve to guide categorisation behaviour, and underlines the validity of the DTB approach to address this relationship.

neuroscience↗

Recurrent issues with deep neural networks of visual recognition

Object recognition requires flexible and robust information processing, especially in view of the challenges posed by naturalistic visual settings. The ventral stream in visual cortex is provided with this robustness by its recurrent connectivity. Recurrent deep neural networks (DNNs) have recently emerged as promising models of the ventral stream, surpassing feedforward DNNs in the ability to account for brain representations. In this study, we asked whether recurrent DNNs could also better account for human behaviour during visual recognition. We assembled a stimulus set that included manipulations that are often associated with recurrent processing in the literature, like occlusion, partial viewing, clutter, and spatial phase scrambling. We obtained a benchmark dataset from human participants performing a categorisation task on this stimulus set. By applying a wide range of model architectures to the same task, we uncovered a nuanced relationship between recurrence, model size, and performance. While recurrent models reach higher performance than their feedforward counterpart, we could not dissociate this improvement from that obtained by increasing model size. We found consistency between humans and models patterns of difficulty across the visual manipulations, but this was not modulated in an obvious way by the specific type of recurrence or size added to the model. Finally, depth/size rather than recurrence makes model confusion patterns more human-like. Contrary to previous assumptions, our findings challenge the notion that recurrent models are better models of human recognition behaviour than feedforward models, and emphasise the complexity of incorporating recurrence into computational models.

neuroscience↗