Search bioRxiv⌕ Search

Biology subjects

Masson, G. S.

Publications and source records attributed to Masson, G. S..

5 recordsLinked to original sources

Optimizing MR-based gaze-decoding for eyes-closed eye-tracking in fMRI

Eye movements provide valuable insights into human cognition and are a critical variable in numerous functional magnetic resonance imaging (fMRI) studies. Yet, when the eyes are closed, camera-based eye-tracking is unavailable, making studies of eyes-closed states challenging. Here, we address this gap using DeepMReye, a deep learning framework for camera-free gaze reconstruction from the MR-signal of the eyes. We first show that fine-tuning DeepMReye on visuomotor calibration data acquired with the eyes open significantly improves gaze decoding, and that this fine-tuning does not require simultaneous camera-based data. We next assessed whether decoding could be extended to eyes-closed states using a novel auditory-guided task, in which participants gazed at learned target positions with and without visual input, and with their eyes open, blinking, or closed. While DeepMReye was originally trained exclusively on eyes-open data, the network successfully generalized to eyes-closed periods, and this generalization was further improved through task-specific fine-tuning. Finally, fine-tuning also improved decoding of eyelid-state (open versus closed) directly from the MR-signal. These findings demonstrate that gaze and eyelid-state monitoring during eyes-closed periods is feasible, enabling broader integration of eye-tracking in fMRI research.

neuroscience↗

Sensorimotor learning compensates for irreducible perceptual bias

Because of the uncertainties present in the any sensory inflows, we experienced perceptual biases that often contaminate sensorimotor transformations. How these biases can be prevented through perceptual learning or adaptation is an open question in inference theories of perception and motor control. We revisited this debate using a classic example of low-level perceptual bias, the aperture problem in motion perception and its consequences for smooth pursuit. In a visuomotor tracking paradigm, participants pursued left-, right-tilted, or upright Gabor patches moving horizontally. As expected, initial pursuit direction was biased toward the oblique directions. This initial pursuit error remained unchanged when participants repeatedly tracked a single tilted Gabor during training sessions conducted over several days. By contrast, post-training error correction became faster for the trained Gabor orientation, but not for its untrained, mirror-symmetric counterpart. This change in dynamics was explained by the emergence of a delayed compensatory pursuit response, best revealed after training with an upright Gabor, a stimulus that would normally elicit unbiased tracking. This corrective eye movement was selective for both shape and motion features. It lagged by ~40 msec after pursuit onset suggesting that it was triggered by the biased motor command itself rather than by visual reafference. These results support a dissociation between low-level sensory computations, which cannot be modified over short timescales, and internal models of sensorimotor transformation, which can be rapidly updated to compensate for irreducible but predictable sensory-driven perceptual biases.

neuroscience↗

Anticipatory smooth eye movements scale with the probability of visual motion: role of target speed and acceleration

Sensory-motor systems can extract statistical regularities in dynamic uncertain environments, enabling quicker responses and anticipatory behavior for expected events. Anticipatory smooth pursuit eye movements (aSP) have been observed in primates when the temporal and kinematic properties of a forthcoming visual moving target are fully or partially predictable. To investigate the nature of the internal model of target kinematics underlying aSP, we tested the effect of varying the target kinematics and its predictability. Participants tracked a small visual target in a constant direction with either constant, accelerating or decelerating speed. Across experimental blocks, we manipulated the probability of each kinematic condition varying either speed or acceleration across trials; with either one kinematic condition (providing certainty) or with a mixture of conditions with a fixed probability within a block. We show that aSP is robustly modulated by target kinematics. With constant-velocity targets, aSP velocity scales linearly with target velocity in blocked sessions, and matches the probability-weighted average in the mixture sessions. Predictable target acceleration does also have an influence on aSP, suggesting that the internal model of motion which drives anticipation contains some information about the changing target kinematics, beyond the initial target speed. However, there is a large variability across participants in the precision and consistency with which this information is taken into account in order to control anticipatory behavior.

neuroscience↗

Mammals achieve common neural coverage of visual scenes using distinct sampling behaviors

Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across several fixations to construct a more complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact, and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of different species. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.

neuroscience↗

Anticipatory responses along motion trajectories in awake monkey area V1

What are the neural mechanisms underlying motion integration of translating objects? Visual motion integration is generally conceived of as a feedforward, hierarchical, information processing. However, feedforward models fail to account for many contextual effects revealed using natural moving stimuli. In particular, a translating object evokes a sequence of transient feedforward responses in the primary visual cortex but also propagations of activity through horizontal and feedback pathways. We investigated how these pathways shape the representation of a translating bar in monkey V1. We show that, for long trajectories, spiking activity builds-up hundreds of milliseconds before the bar enters the neurons receptive fields. Using VSDI and LFP recordings guided by a phenomenological model of propagation dynamics, we demonstrate that this anticipatory response arises from the interplay between horizontal and feedback networks driving V1 neurons well ahead of their feedforward inputs. This mechanism could subtend several perceptual contextual effects observed with translating objects. HighlightsO_LIOur hypothesis is that lateral propagation of activity in V1 contributes to the integration of translating stimuli C_LIO_LIConsistent with this hypothesis, we find that a translating bar induces anticipatory spiking activity in V1 neurons. C_LIO_LIA V1 model describes how this anticipation can arise from inter and intra-cortical lateral propagation of activity. C_LIO_LIThe dynamic of VSDi and LFP signals in V1 is consistent with the predictions made by the model. C_LIO_LIThe intra-cortical origin is further confirmed by the fact that a bar moving from the ipsilateral hemifield does not evoke anticipation. C_LIO_LIHorizontal and feedback input are not only modulatory but can also drive spiking responses in specific contexts. C_LI

neuroscience↗