Search bioRxiv⌕ Search

Biology subjects

Tsotsos, J. K.

Publications and source records attributed to Tsotsos, J. K..

5 recordsLinked to original sources

Equiluminant Border Ownership Cells as a Missing Link in Color Form Perception

We propose the existence of a sub-population of border ownership neurons that signal figure side along equiluminant borders, those defined purely by color contrast. We postulate that these neurons, similar to primate equiluminant V1 [26] and V4 [5] cells, are strongly activated by equiluminant contrast on their preferred side, with diminished response for strictly luminance contrast. To test this hypothesis, we propose a hierarchical and mechanistic model that explains how equiluminant border ownership signals can be achieved in the ventral stream. Our simulation results suggest that model equiluminant neurons are highly color-selective while exhibiting similar orientation and border ownership selectivity as their luminance counterparts. Additionally, our model equiluminant cells indeed exhibited the above postulated pattern of responses. We suggest that these neurons are the missing links in the equiluminance channels in the ventral stream that transform equiluminant oriented edge signals in V1 to equiluminant object-centered shape representations in V4. Our findings point to the importance of re-examining the border ownership neuron population to further detail their role in equiluminant channels in the ventral stream.

neuroscience↗

Attention to a point in time causes a suppressive wake for subsequent time points

The Selective Tuning model proposed that attention to a visual stimulus suppresses interfering portions of the processing hierarchy. This has been shown in spatial and featural domains and the proposal extends to the temporal dimension. We investigated whether attending to a point in time leads to processing suppression of nearby time points. We presented a sequence of letters with an embedded target, and observers indicated the targets orientation. In the neutral condition, the target appeared randomly in one of the frames. In the informative condition, the target appeared in the same frame on most of the trials ( expected trials), and the expected frame varied between blocks (Experiments 1-3) or groups (Experiment 4). On the remaining trials, it appeared before or after the most-probable frame ( unexpected trials). Four different experiments were conducted to adjust the method and in the final one we found higher accuracy in expected trials than in neutral trials, indicating the allocation of temporal attention to the expected frame. When the target appeared after the expected frame, accuracy was lower than in the same neutral condition frame, suggesting an attentional suppressive wake in time (because the effect of attention cannot be observed until after stimulus onset).

neuroscience↗

Real-world visual search goes beyond eye movements: Active searchers select 3D scene viewpoints too

Visual search is a ubiquitous task; people search for objects on a daily basis. However, the majority of the existing visual search literature focuses on passive search on a 2D computer screen, a far cry from emulating a real-world environment. Search is a real-world task that involves active observation. Search targets may be occluded, completely out of the observers line of sight, or oriented in unconventional ways. This is typically mitigated by actively selecting viewpoints, an important aspect of search behaviour with limited scope on a computer screen. Our goal was to explore viewpoint selection in active visual search. Subject eye and head movements were tracked as they moved freely while searching for toy objects in a controlled 3-dimensional environment, yielding the first such record of search-driven viewpoint selection. We found that subjects utilized their full range of eye and head motion to move from viewpoint to viewpoint, apparently employing a variety of objectives including changing viewing height and pose depending on object 3D pose. Subjects were also adept at selecting unobstructed views to search through otherwise occluded areas with objects. Furthermore, subjects completed the search task with high accuracy, even with no training on the environment. Although no learning was found in terms of accuracy over the duration of the experiment, increases in efficiency were found for other metrics such as response time, number of fixations, and distance travelled, particularly in target present trials where the target was not visible from the starting location. These results paint the story of a visual system that selects and moves to useful and informative views to facilitate the successful execution of an active visual search task, and stresses the significance of active vision research in understanding how vision is used in naturalistic environments.

neuroscience↗

Feature-based attention induces surround suppression during the perception of visual motion

Feature-based attention prioritizes the processing of the attended feature while strongly suppressing the processing of nearby ones. This creates a non-linearity or attentional suppressive surround predicted by the Selective Tuning model of visual attention. However, previously reported effects of feature-based attention on neuronal responses are linear, e.g., feature-similarity gain. Here, we investigated this apparent contradiction by neurophysiological and psychophysical approaches. Responses of motion direction-selective neurons in area MT/MST of monkeys were recorded during a motion task. When attention was allocated to a stimulus moving in the neurons preferred direction response tuning curves showed its minimum for directions 60-90 degrees away from the preferred direction, an attentional suppressive surround. This effect was modeled via the interaction of two Gaussian fields representing excitatory narrowly-tuned and inhibitory widely-tuned inputs into a neuron, with feature-based attention predominantly increasing the gain of inhibitory inputs. We further showed using a motion repulsion paradigm in humans that feature-based attention produces a similar non-linearity on motion discrimination performance. Our results link the gain modulation of neuronal inputs and tuning curves examined through the feature-similarity gain lens to the attentional impact on neural population responses predicted by the Selective Tuning model, providing a unified framework for the documented effects of feature-based attention on neuronal responses and behavior.

neuroscience↗

Multiplicative modulations in hue-selective cells enhance unique hue representation

There is still much to understand about the color processing mechanisms in the brain and the transformation from cone-opponent representations to perceptual hues. Moreover, it is unclear which areas(s) in the brain represent unique hues. We propose a hierarchical model inspired by the neuronal mechanisms in the brain for local hue representation, which reveals the contributions of each visual cortical area in hue representation. Local hue encoding is achieved through incrementally increasing processing nonlinearities beginning with cone input. Besides employing nonlinear rectifications, we propose multiplicative modulations as a form of nonlinearity. Our simulation results indicate that multiplicative modulations have significant contributions in encoding of hues along intermediate directions in the MacLeod-Boynton diagram and that model V4 neurons have the capacity to encode unique hues. Additionally, responses of our model neurons resemble those of biological color cells, suggesting that our model provides a novel formulation of the brains color processing pathway.

neuroscience↗