Search bioRxiv⌕ Search

Biology subjects

Welchman, A. E.

Publications and source records attributed to Welchman, A. E..

5 recordsLinked to original sources

Exploring and explaining properties of motion processing in biological brains using a neural network

Visual motion perception underpins behaviours ranging from navigation to depth perception and grasping. Our limited access to biological systems constrain our understanding of how motion is processed within the brain. Here we explore properties of motion perception in biological systems by training a neural network ( MotionNetxy) to estimate the velocity image sequences. The network recapitulates key characteristics of motion processing in biological brains, and we use our complete access to its structure explore and understand motion (mis)perception at the computational-, neural-, and perceptual-levels. First, we find that the network recapitulates the biological response to reverse-phi motion in terms of direction. We further find that it overestimates the speed of slow reverse-phi motion while underestimating the speed of fast reverse-phi motion because of the correlation between reverse-phi motion and the spatiotemporal receptive fields tuned to motion in opposite directions. Second, we find that the distribution of spatiotemporal tuning properties in the V1 and MT layers of the network are similar to those observed in biological systems. We then show that compared to MT units tuned to fast speeds, those tuned to slow speeds primarily receive input from V1 units tuned to high spatial frequency and low temporal frequency. Third, we find that there is a positive correlation between the pattern-motion and speed selectivity of MT units. Finally, we show that the network captures human underestimation of low coherence motion stimuli, and that this is due to pooling of noise and signal motion. These findings provide biologically plausible explanations for well-known phenomena, and produce concrete predictions for future psychophysical and neurophysiological experiments.

neuroscience↗

Functional organization of three-dimensional orientation encoding within the visual cortex

Visual perception of three-dimensional (3D) structure is important for object recognition, grasping, and manipulation. The 3D structure of a surface can be defined in terms of its slant and tilt. Previous work has shown that slant and tilt are represented in the posterior and ventral intraparietal sulcus of the human brain; however, it is unclear whether the representation of these features is functionally organized within this region. Here we use phase-encoded presentation of 3D planar surfaces with linear gradients defined by horizontal binocular disparity while measuring fMRI activity to test whether the representation of 3D surface tilt is functionally organized within visual cortex. We find functionally defined structures within V3A and V7. Most notably, in one participant we find that the tilt preference is unilaterally organized in a pinwheel-like structure, similar to those observed for orientation preference in V1, which encompasses most of area V3A. These findings indicate that 3D orientation is functionally organized within the human visual cortex, and the evidence suggesting the presence of a large pinwheel-like structure indicates that this type of organization may be applied canonically within the brain at multiple scales.

neuroscience↗

Adaptation to binocular anticorrelation results in increased neural excitability

Throughout the brain, information from individual sources converges onto higher order neurons. For example, information from the two eyes first converges in binocular neurons in area V1. Many neurons appear tuned to similarities between sources of information, which makes intuitive sense in a system striving to match multiple sensory signals to a single external cause, i.e., establish causal inference. However, there are also neurons that are tuned to dissimilar information. In particular, many binocular neurons respond maximally to a dark feature in one eye and a light feature in the other. Despite compelling neurophysiological and behavioural evidence supporting the existence of these neurons (Cumming & Parker, 1997; Janssen, Vogels, Liu, & Orban, 2003; Katyal, Vergeer, He, He, & Engel, 2018; Kingdom, Jennings, & Georgeson, 2018; Tsao, Conway, & Livingstone, 2003), their function has remained opaque. To determine how neural mechanisms tuned to dissimilarities support perception, here we use electroencephalography to measure human observers steady-state visually evoked potentials (SSVEPs) in response to change in depth after prolonged viewing of anticorrelated and correlated random-dot stereograms (RDS). We find that adaptation to anticorrelated RDS results in larger SSVEPs, while adaptation to correlated RDS has no effect. These results are consistent with recent theoretical work suggesting what not neurons play a suppressive role in supporting stereopsis (Goncalves & Welchman, 2017); that is, selective adaptation of neurons tuned to binocular mismatches reduces suppression resulting in increased neural excitability.

neuroscience↗

Mixed-polarity random-dot stereograms alter GABA and Glx concentration in the early visual cortex

The offset between images projected onto the left and right retinae (binocular disparity) provides a powerful cue to the three-dimensional structure of the environment. It was previously shown that depth judgements are better when images comprise both light and dark features, rather than only dark or only light elements. Since Harris and Parker (1995) discovered the "mixed-polarity benefit", there has been limited evidence supporting their hypothesis that the benefit is due to separate bright and dark channels. Goncalves and Welchman (2017) observed that single- and mixed-polarity stereograms evoke different levels of positive and negative activity in a deep neural network trained on natural images to make depth judgements, which also showed the mixed-polarity benefit. Motivated by this discovery, here we seek to test the potential for changes in the balance of excitation and inhibition that are produced by viewing these stimuli. In particular, we use magnetic resonance spectroscopy to measure Glx and GABA concentration in the early visual cortex of adult humans while viewing single- and mixed-polarity random-dot stereograms (RDS). We find that observers Glx concentration is significantly higher while GABA concentration is significantly lower when viewing mixed-polarity RDS than when viewing single-polarity RDS. These results indicate that excitation and inhibition facilitate processing of single- and mixed-polarity stereograms in the early visual cortex to different extents, consistent with recent theoretical work (Goncalves & Welchman, 2017).

neuroscience↗

Contextual effects on binocular matching are evident in primary visual cortex

Global context can dramatically influence local visual perception. This phenomenon is well-documented for monocular features, e.g., the Kanizsa triangle. It has been demonstrated for binocular matching: the disambiguation of the Wallpaper Illusion (Brewster, 1844) via the luminance of the background (Anderson & Nakayama, 1994). For monocular features, there is evidence that global context can influence neuronal responses as early as V1 (Muckli et al., 2015). However, for binocular matching, the activity in this area of the visual cortex is thought to represent local processing, suggesting that the influence of global context may occur at later stages of cortical processing. Here we sought to test if binocular matching is influenced by contextual effects in V1, using fMRI to measure brain activity while participants viewed perceptually ambiguous "wallpaper" stereograms whose depth was disambiguated by the luminance of the surrounding region. We localized voxels in V1 corresponding to the ambiguous region of the pattern, i.e., where the signal received from the eyes was not predictive of depth, and despite the ambiguity of the input signal, using multi-voxel pattern analysis we were able to reliably decode perceived (near/far) depth from the activity of these voxels. These findings indicate that stereoscopic related neural activity is influenced by global context as early as V1.

neuroscience↗