Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/075929

Cortical dynamics of saccade-target selection during free-viewing of natural scenes

Linda Henriksson·Kaisu Olander·Riitta Hari
View original source ↗Export metadata ↓

Abstract

Natural visual behaviour entails explorative eye movements, saccades, that bring different parts of a visual scene into the central vision. The neural processes guiding the selection of saccade targets are still largely unknown. Therefore, in this study, we tracked with magnetoencephalography (MEG) cortical dynamics of viewers who were freely exploring novel natural scenes. Overall, the viewers were largely consistent in their gaze behaviour, especially if the scene contained any persons. We took a fresh approach to relate the eye-gaze data to the MEG signals by characterizing dynamic cortical representations by means of representational distance matrices. Specifically, we compared the representational distances between the stimuli in the evoked MEG responses with predictions based (1) on the low-level visual similarity of the stimuli (as visually more similar stimuli evoke more similar responses in early visual areas) and (2) on the eye-gaze data. At 50-75 ms after the scene onset, the similarity of the occipital MEG patterns correlated with the low-level visual similarity of the scenes, and already at 75-100 ms the visual features attracting the first saccades predicted the similarity of the right parieto-occipital MEG responses. Thereafter, at 100-125 ms, the landing positions of the upcoming saccades explained MEG responses. These results indicate that MEG signals contain signatures of the rapid processing of natural visual scenes as well as of the initiation of the first saccades, with the processing of the saccade target preceding the processing of the landing position of the upcoming saccade.\n\nSIGNIFICANCE STATEMENTHumans naturally make eye movements to bring different parts of a visual scene to the fovea where our visual acuity is the best. Tracking of eye gaze can reveal how we make inferences about the content of a scene by looking at different objects, or which visual cues automatically attract our attention and gaze. The brain dynamics governing natural gaze behaviour is still largely unknown. Here we suggest a novel approach to relate eye-tracking results with brain activity, as measured with magnetoencephalography (MEG), and demonstrate signatures of natural gaze behaviour in the MEG data already before the eye movements occur.

Explore related subjects

NeurosciencePreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Linda Henriksson, Kaisu Olander, Riitta Hari. 2016-09-19. Cortical dynamics of saccade-target selection during free-viewing of natural scenes. https://doi.org/10.1101/075929

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Distinct contributions of post-traumatic stress and working memory to affective and sensory dimensions of chronic pain, with pain modulation as a shared mechanism

Chronic pain is highly heterogeneous, with individuals varying substantially in symptoms. pain severity, disability, affective distress, cognitive functioning, and trauma-related symptoms. This study examined whether working memory, post-traumatic stress symptoms (PTSS), trauma exposure, and pain modulation explain distinct or shared dimensions of chronic pain variability. Individuals with chronic pain completed clinical, cognitive, trauma-related, and behavioural pain modulation measures, as well as resting-state functional magnetic resonance imaging. Multivariate regressions were used to determine whether working memory, PTSS, trauma exposure, and pain modulation independently predicted chronic pain outcomes. Principal component analysis was used to identify latent dimensions of chronic pain, and mediation analyses tested whether behavioural pain modulation explained relationships between dlPFC to vlPAG resting-state functional connectivity and clinical pain outcomes. PTSS independently predicted affective outcomes, including depression, state anxiety, and trait anxiety, whereas working memory independently predicted pain severity and pain interference. Trauma exposure was associated with greater PTSS and poorer working memory, but did not independently predict core pain outcomes after accounting for these more proximal factors. Principal component analysis identified partially distinct affective and sensory-disability dimensions, while trauma exposure loaded primarily on a separate component characterized by greater PTSS and poorer working memory. Behavioural pain modulation showed broader relationships across symptom dimensions and was associated with dlPFC to vlPAG connectivity. Exploratory mediation analyses demonstrated that pain modulation mediated relationships between dlPFC to vlPAG connectivity and both pain severity and affective distress. These findings support an integrated model where PTSS and working memory are more proximal predictors of affect and severity respectively, and trauma exposure represents a more distal vulnerability factor that predicts both. Thus, pain modulation represents a shared mechanism linking cortico-brainstem connectivity to chronic pain intensity and affect. These variables need further testing for phenotyping people with chronic pain based on their specific clinical needs.

Neuroscience↗
bioRxiv2016

Temporal and spatial localization of prediction-error signals in the visual brain

It has been suggested that the brain pre-empts changes in the visual environment through generating predictions, although real-time eletrophysiological evidence of prediction violations remains elusive. In a series of experiments we showed participants sequences of images that followed a predictable implied sequence or whose final image violated the implied sequence. Through careful design we were able to use the same final image transitions across predictable and unpredictable conditions, ensuring that any differences in neural responses were due only to preceding context and not to the images themselves. EEG and MEG recordings showed that early/mid-latency visual evoked potentials were robustly modulated by images that violated the implied sequence across a range of types of image change (expression deformations, rigid-rotations and visual field location). This modulation occurred irrespective of stimulus object category. Although the stimuli were static images, MEG source reconstruction of the early latency signal (N/M170) localised expectancy violation signals to brain areas associated with motion perception. Our findings suggest that the N/M170 can index mismatches between predicted and actual visual inputs in a system that predicts trajectories based on ongoing context. This has important implications for understanding the N/M170 and investigating how the brain represents context to generate perceptual predictions.

Neuroscience↗
bioRxiv2016

AN OSCILLATORY NETWORK MODEL OF HEAD DIRECTION, SPATIALLY PERIODIC CELLS AND PLACE CELLS USING LOCOMOTOR INPUTS

We propose a computational modeling approach that explains the formation of a range of spatial cells like head direction cells, grid cells, border cells and place cells which are believed to play a pivotal role in the spatial navigation of an animal. Most existing models insert special symmetry conditions in the models in order to obtain such symmetries in the outcome; our models do not require such symmetry assumptions. Our modeling approach is embodied in two models: a simple one (Model #1) and a more detailed version (Model #2). In Model #1, velocity input is presented to a layer of Head Direction cells, with no special topology requirements, the outputs of which are presented to a layer of Path Integration neurons. A variety of spatially periodic responses resembling grid cells, are obtained using the Principal Components of Path Integration layer. In Model #2, the input consists of the locomotor rhythms from the four legs of a virtual animal. These rhythms are integrated into the phases of a layer of oscillatory neurons, whose outputs drive a layer of Head Direction cells. The Head Direction cells in turn drive a layer of Path Integration neurons, which in turn project to two successive layers of Lateral Anti Hebbian Networks (LAHN). Cells in the first LAHN resemble grid cells (with both hexagonal and square gridness), and border cells. Cells in the second LAHN exhibit place cell behaviour and a new cell type known as corner cell. Both grid cells and place cells exhibit phase precession in 1D and 2D spaces. The models outline the neural hierarchy necessary to obtain the complete range of spatial cell responses found in the hippocampal system.

Neuroscience↗