Search bioRxiv⌕ Search

Biology subjects

VanRullen, R.

Publications and source records attributed to VanRullen, R..

At least 19 recordsLinked to original sources

Traveling waves support rhythmic attentional search

Brain activity unfolds across space and time, giving rise to spatiotemporal dynamics that can manifest as cortical traveling waves -smooth phase shifts propagating across the cortex. Although traveling waves have been observed across species and measurement scales, their functional role in human cognition remains largely inferred from correlational evidence. In healthy humans, large-scale neural dynamics must be studied non-invasively, which provides limited access to their neural origins. Here, we tested whether global traveling waves causally contribute to inter-areal communication during attention. Using transcranial magnetic stimulation (TMS), we induced long-range traveling waves detectable with electroencephalography and assessed their neural and behavioral consequences during an attentional search task. Double-pulse TMS applied over the right frontal eye field transiently disrupted ongoing global waves and selectively induced direction- and frequency-specific traveling waves propagating toward the occipital visual cortex. These TMS-induced anterior-to-posterior theta traveling waves were rhythmically modulated by stimulation latency relative to search-trial onset. Critically, behavioral performance exhibited the same rhythmic pattern, with improved attentional search performance when TMS-induced traveling waves were more prominent. Together, these findings provide causal evidence that large-scale traveling waves support inter-areal communication during rhythmic visual attention.

neuroscience↗

Modality-Agnostic Decoding of Vision and Language from fMRI

Humans perform tasks involving the manipulation of inputs regardless of how these signals are perceived by the brain, thanks to representations that are invariant to the stimulus modality. In this paper, we present modality-agnostic decoders that leverage such modality-invariant representations to predict which stimulus a subject is seeing, irrespective of the modality in which the stimulus is presented. Training these modality-agnostic decoders is made possible thanks to our new large-scale fMRI dataset SemReps-8K, released publicly along with this paper. It comprises 6 subjects watching both images and short text descriptions of such images, as well as conditions during which the subjects were imagining visual scenes. We find that modality-agnostic decoders can perform as well as modality-specific decoders, and even outperform them when decoding captions and mental imagery. Further, a searchlight analysis revealed that large areas of the brain contain modality-invariant representations. Such areas are also particularly suitable for decoding visual scenes from the mental imagery condition.

neuroscience↗

Random Tactile Noise Stimulation Reveals Beta-Rhythmic Impulse Response Function of the Somatosensory System

Both passive tactile stimulation and motor actions result in dynamic changes in beta-band (15-30 Hz Hz) oscillations over somatosensory cortex. Similar to alpha-band (8-12 Hz) power decrease in the visual system, beta-band power also decreases following stimulation of the somatosensory system. This relative suppression of alpha and beta oscillations is generally interpreted as an increase in cortical excitability. Here, next to traditional single-pulse stimuli, we employed a random intensity continuous right index finger tactile stimulation (white noise), which enabled us to uncover an impulse response function (IRF) of the somatosensory system. Contrary to previous findings, we demonstrate a burst-like initial increase rather than decrease of beta activity following white noise stimulation (human participants, N = 18, 8 female). These beta bursts, on average, lasted for 3 cycles and their frequency was correlated with resonant frequency of somatosensory cortex, as measured by a multi-frequency steady-state somatosensory evoked potential (SSSEP) paradigm. Furthermore, beta-band bursts shared spectro-temporal characteristics with evoked and resting-state beta oscillations. Taken together, our findings not only reveal a novel oscillatory signature of somatosensory processing that mimics the previously reported visual IRFs, but also point to a common oscillatory generator underlying spontaneous beta bursts in the absence of tactile stimulation and phase-locked beta bursts following stimulation, the frequency of which is determined by the resonance properties of the somatosensory system. Significance StatementThe investigation of the transient nature of oscillations has gained great popularity in recent years. The findings of bursting activity rather than sustained oscillations in the beta-band has provided important insights into its role in movement planning, working memory, inhibition and reactivation of neural ensembles. In this study, we show that also in response to tactile stimulation the somatosensory system responds with [~]3 cycle oscillatory beta-band bursts, whose spectro-temporal characteristics are shared with evoked and resting-state beta-band oscillatory signatures of the somatosensory system. As similar bursts have been observed in the visual domain, these oscillatory signatures might reflect an important supramodal mechanism in sensory processing.

neuroscience↗

Distinct roles of forward and backward alpha-band waves in spatial visual attention

Previous research has associated alpha-band [8-12Hz] oscillations with inhibitory functions (Klimesch et al., 2007; Jensen and Mazaheri, 2010): for instance, several studies showed that visual attention increases alpha-band power in the hemisphere ipsilateral to the attended location (Thut et al., 2006; Handel et al., 2011). However, other studies demonstrated that alpha oscillations positively correlate with visual perception (Busch et al., 2009; Vanrullen and MacDonald, 2012), hinting at different processes underlying their dynamics. Here, using an approach based on traveling waves, we demonstrate that there are two functionally distinct alpha-band oscillations propagating in different directions. We analyzed EEG recordings from two datasets of human participants (N=32, both genders) performing a covert visual attention task. Participants were instructed to detect a brief target by covertly attending to the screens left or right side. Our analysis reveals two distinct processes: allocating attention to one hemifield increases top-down alpha-band waves propagating from frontal to occipital regions ipsilateral to the attended location, both with or without visual stimulation. These top-down oscillatory waves correlate positively with alpha-band power in frontal and occipital regions. Yet, different alpha-band waves propagate from occipital to frontal regions and contralateral to the attended location. Crucially, these forward waves were present only during visual stimulation, suggesting a separate mechanism related to visual processing. Together, these results reveal two distinct processes reflected by different propagation directions, demonstrating the importance of considering oscillations as traveling waves when characterizing their functional role.

neuroscience↗

Periodic attention operates faster during more complex visual search

Attention has been found to sample visual information periodically, in a wide range of frequencies below 20 Hz. This periodicity may be supported by brain oscillations at corresponding frequencies. We propose that part of the discrepancy in periodic frequencies observed in the literature is due to differences in attentional demands, resulting from heterogeneity in tasks performed. To test this hypothesis, we used visual search and manipulated task complexity, i.e., target discriminability (high, medium, low) and number of distractors (set size), while electro-encephalography was simultaneously recorded. We replicated previous results showing that the phase of pre-stimulus low-frequency oscillations predicts search performance. Crucially, such effects were observed at increasing frequencies within the theta-alpha range (6-18 Hz) for decreasing target discriminability. In medium and low discriminability conditions, correct responses were further associated with higher post-stimulus phase-locking than incorrect ones, in increasing frequency and latency. Finally, the larger the set size, the later the post-stimulus effect peaked. Together, these results suggest that increased complexity (lower discriminability or larger set size) requires more attentional cycles to perform the task, partially explaining discrepancies between reports of attentional sampling. Low-frequency oscillations structure the temporal dynamics of neural activity and aid top-down, attentional control for efficient visual processing.

neuroscience↗

Alpha phase-amplitude tradeoffs predict visual perception

Spontaneous alpha oscillations (~10 Hz) have been associated with various cognitive functions, including perception. Their phase and amplitude independently predict cortical excitability and subsequent perceptual performance. Yet, the causal role of alpha phase-amplitude tradeoffs on visual perception remains ill-defined. We aimed to fill this gap and tested two clear predictions from the Pulsed Inhibition theory according to which alpha oscillations are associated with periodic functional inhibition. (1) High alpha amplitude induces cortical inhibition at specific phases, associated with low perceptual performance, while at opposite phases, inhibition decreases (potentially increasing excitation) and perceptual performance increases. (2) Low alpha amplitude is less susceptible to these phasic (periodic) pulses of inhibition, leading to overall higher perceptual performance. Here, cortical excitability was assessed in humans using phosphene (illusory) perception induced by single pulses of transcranial magnetic stimulation (TMS) applied over visual cortex at perceptual threshold, and its post-pulse evoked activity recorded with simultaneous electroencephalography (EEG). We observed that pre-pulse alpha phase modulates the probability to perceive a phosphene, predominantly for high alpha amplitude, with a non-optimal phase for phosphene perception between -{pi}/2 and -{pi}/4. The pre-pulse non-optimal phase further leads to an increase in post-pulse evoked activity (ERP), in phosphene-perceived trials specifically. Together, these results show that alpha oscillations create periodic inhibitory moments when alpha amplitude is high, leading to periodic decrease of perceptual performance. This study provides strong causal evidence in favor of the Pulsed Inhibition theory. Visual Abstract O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=83 SRC="FIGDIR/small/445552v3_ufig1.gif" ALT="Figure 1"> View larger version (16K): org.highwire.dtl.DTLVardef@1c6e4f8org.highwire.dtl.DTLVardef@e26614org.highwire.dtl.DTLVardef@19bc93forg.highwire.dtl.DTLVardef@b97b36_HPS_FORMAT_FIGEXP M_FIG C_FIG Significance StatementThe Pulsed Inhibition theory predicts that the functional inhibition induced by high alpha oscillations amplitude is periodic, with specific phases decreasing neural firing and perceptual performance. In turn, low alpha oscillations amplitude is less susceptible to phasic moments of pulsed inhibition leading to overall higher perceptual performance. Using TMS with simultaneous EEG recordings in humans, we found that specific phases of spontaneous alpha oscillations (~10 Hz) decrease cortical excitability and the subsequent perceptual outcomes predominantly when alpha amplitude is high. Our results provide strong causal evidence in favor of the Pulsed Inhibition theory.

neuroscience↗

Anticipatory reinstatement of expected perceptual events during visual sequence learning

Being able to predict future events in learned sequences is a fundamental cognitive ability. Successful behavior requires the brain to not only anticipate an upcoming event, but to also continue to keep track of the sequence in case of eventual disruptions, (e.g., when a predicted event does not occur). However, the precise neural mechanisms supporting such processes remain unknown. Here, using multivariate pattern classification based on electroencephalography (EEG) activity and time-frequency amplitude, we show that the visual system represents upcoming expected stimuli during a sequence-learning task. Stimulus-evoked neural representations were reinstated prior to expected stimulus onset, and when an anticipated stimulus was unexpectedly withheld, suggesting proactive reinstatement of sensory templates. Importantly, stimulus representation of the absent stimulus co-occurred with an emerging representation of the following stimulus in the sequence, showing that the brain actively maintained sequence order even when the sequence was perturbed. Finally, selective activity was evident in the alpha-beta band (9-20 Hz) amplitude topographies, confirming the role of alpha-beta oscillations in carrying information about the nature of sensory expectations. These results show that the brain dynamically implements anticipatory mechanisms that reinstate sensory representations, and that allow us to make predictions about events further in the future.

neuroscience↗

Nudging the N170 forward with prior stimulation - Bridging the gap between N170 and recognition potential

Some neural responses are classified by the stimulus conditions leading up to that response while other neural responses are also classified by the morphology of the responses themselves. However, morphology-based classification may not be appropriate if one can nudge a neural response into looking like another neural response. Morphology-based classification occurs with the N170 and RP (Recognition Potential), ERP components that are studied in separate literatures and yet share much in common in terms of functionality. In this study, we demonstrate a gradual transformation in the morphology of the N170 to the RP using a simple parametric manipulation of forward masks that is unlikely to cause a change in the underlying processing. Both the N170 and RP are N1 components, meaning that they are the first negative deflection of the evoked response. However, the RP is often measured with a forward mask that ends at stimulus onset whereas the N170 is often measured with no masking at all. This study investigates how ISI may delay and distort the N170 into an RP by manipulating the temporal gap (ISI) between forward mask and target. The results revealed reverse relationships between the ISI on the one hand, and the N170 latency, single-trial N1 jitter (an approximation of N1 width) and reaction time on the other hand. Importantly, we find that scalp topographies have a unique signature at the N1 peak across all conditions, from the longest gap (N170) to the shortest (RP). These findings prove that the mask-delayed N1 is still the same N170, even under conditions that are normally associated with a different component like the RP. In general, our results suggest that greater caution should be taken to interpret the time course of a measured effect when forward masks are employed.

physiology↗

Representational content of oscillatory brain activity during object recognition

Numerous theories propose a key role for brain oscillations in visual perception. Most of these theories postulate that sensory information is encoded in specific oscillatory components (e.g., power or phase) of specific frequency bands. These theories are often tested with whole-brain recording methods of low spatial resolution (EEG or MEG), or depth recordings that provide a local, incomplete view of the brain. Opportunities to bridge the gap between local neural populations and whole-brain signals are rare. Here, using representational similarity analysis we ask which MEG oscillatory components (power and phase, across various frequency bands) correspond to low or high-level visual object representations, using brain representations from fMRI, or layer-wise representations in Deep Neural Networks (DNNs) as a template for low/high-level object representations. The results showed that around stimulus onset and offset, most transient oscillatory signals correlated with low-level brain patterns (V1). During stimulus presentation, sustained beta ([~]20Hz) and gamma (>60Hz) power best correlated with V1, while oscillatory phase components correlated with IT representations. Surprisingly, this pattern of results did not always correspond to low- or high-level DNN layer activity. In particular, sustained beta-band oscillatory power reflected high-level DNN layers, suggestive of a feed-back component. These results begin to bridge the gap between whole-brain oscillatory signals and object representations supported by local neuronal activations.

neuroscience↗

Conscious perception modulates perceptual echoes

Alpha rhythms (~10Hz) in the human brain are classically associated with idling activities, being predominantly observed during quiet restfulness with closed eyes. However, recent studies demonstrated that alpha (~10Hz) rhythms can directly relate to visual stimulation, resulting in oscillations which can last for as long as one second. This alpha reverberation, dubbed Perceptual Echoes (PE), suggests that the visual system actively samples and processes visual information within the alpha-band frequency. Although PE have been linked to various visual functions, their underlying mechanisms and functional role are not completely understood. In the current study, we investigated whether conscious perception modulates the generation and the amplitude of PE. Specifically, we displayed two colored Gabor patches with different orientations on opposite sides of the screen, and using a set of dichoptic mirrors we induced a binocular rivalry between the two stimuli. We asked participants to continuously report which one of two Gabor patches they consciously perceived, while recording their EEG signals. Importantly, the luminance of each patch fluctuated randomly over time, generating random sequences from which we estimated two impulse-response functions (IRFs) reflecting the perceptual echoes generated by the perceived (dominant) and non-perceived (suppressed) stimulus respectively. We found that the alpha power of the PE generated by the consciously perceived stimulus was comparable with that of the PE generated during monocular vision (control condition), and significantly higher than the PE induced by the suppressed stimulus. Moreover, confirming previous findings, we found that all PEs propagated as a travelling wave from posterior to frontal brain regions, irrespective of conscious perception. All in all our results demonstrate that conscious perception modulates PE, suggesting that the synchronization of neural activity plays an important role in visual sampling and conscious perception.

neuroscience↗

DMT alters cortical travelling waves

Psychedelic drugs are potent modulators of conscious states and therefore powerful tools for investigating their neurobiology. N,N, Dimethyltryptamine (DMT) is a particularly interesting serotonergic psychedelic that can rapidly induce an extremely immersive state of consciousness characterized by vivid and elaborate visual imagery. In the present study, we investigated the electrophysiological correlates of the DMT-induced altered state, by recording EEG signals from a pool of participants receiving DMT and (separately) placebo (saline), intravenously, while instructed to keep their eyes closed (i.e. resting state). Consistent with our prior hypotheses, results revealed a spatio-temporal pattern of cortical activation (i.e., travelling waves) similar to that elicited by visual stimulation. Moreover, the typical top-down alpha-band rhythms of closed-eyes rest (i.e. a backward travelling wave) were significantly decreased, while the bottom-up forward travelling wave, was significantly increased. These results support a recent model proposing that psychedelics reduce the precision-weighting of priors, thus altering the balance of top-down versus bottom-up information passing, where properties of backward waves are considered correlates of this precision weighting. The robust hypothesis-confirming nature of the present findings imply the discovery of an important mechanistic principle underpinning psychedelic-induced altered states - i.e. reduced backward and increased forward travelling waves - and lend further support to prior assumptions about the functional significance of cortical travelling waves.

neuroscience↗

Turning the stimulus on and off dynamically changes the direction of alpha travelling waves

Traveling waves have been studied to characterize the complex spatiotemporal dynamics of the brain. Several studies have suggested that the propagation direction of alpha traveling waves can be task-dependent. For example, a recent EEG study from our group found that forward waves (i.e. occipital to frontal, FW waves) were observed during visual processing, whereas backward waves (i.e. frontal to occipital, BW waves) mostly occurred in the absence of sensory input. These EEG recordings, however, were obtained from different experimental sessions and different groups of subjects. To further examine how the waves direction changes between task conditions, 13 participants were tested on a target detection task while EEG signals were recorded simultaneously. We alternated visual stimulation (5 s display of visual luminance sequences) and resting state (5 s of black screen) within each single trial, allowing us to monitor the moment-to-moment progression of traveling waves. As expected, the direction of alpha waves was closely linked with task conditions. First, FW waves from occipital to frontal regions, absent during rest, emerged as a result of visual processing, while BW waves in the opposite direction dominated in the absence of visual inputs, and were reduced (but not eliminated) by external visual inputs. Second, during visual stimulation (but not rest), both waves coexisted on average, but were negatively correlated. In summary, we conclude that the functional role of alpha traveling waves is closely related with their propagating direction, with stimulus-evoked FW waves supporting visual processing and spontaneous BW waves involved more in top-down control.

neuroscience↗

Occipital Alpha-TMS causally modulates Temporal Order Judgements: Evidence for discrete temporal windows in vision

Recent advances in neuroscience have challenged the view of conscious visual perception as a continuous process. Behavioral performance, reaction times and some visual illusions all undergo periodic fluctuations that can be traced back to oscillatory activity in the brain. These findings have given rise to the idea of a discrete sampling mechanism in the visual system. In this study we seek to investigate the causal relationship between occipital alpha oscillations and Temporal Order Judgements using neural entrainment via rhythmic TMS. We find that certain phases of the entrained oscillation facilitate temporal order perception of two visual stimuli, whereas others hinder it. Our findings support the idea that the visual system periodically compresses information into discrete packages within which temporal order information is lost. Significance StatementCorrelational evidence for a relationship between brain states and perception is abundant. However, in order to truly understand the causal relationship between the two, we need to be able to manipulate one and observe changes in the other. Neural entrainment via TMS serves as a valuable tool to interfere with cortical rhythms and observe changes in perception. Here, using rhythmic TMS-pulses at 10 Hz, we investigate the effect of the phase of entrained oscillations on performance in a temporal order judgement (TOJ) task. We observe that the causally entrained oscillation indeed modulates time perception rhythmically. On top of previous work on discrete perception we were able to 1. causally influence brain rhythms in a far more direct fashion using TMS, and 2. show that previous work on discrete perception cannot simply be explained by rhythmic fluctuations in visibility. In conclusion our findings support the long discussed idea that the temporal organization of visual processing is discrete rather than continuous, and is causally modulated by cortical rhythms. To our knowledge, this is the first study providing causal evidence via TMS for an endogenous periodic modulation of time perception.

neuroscience↗

Revealing α oscillatory activity using voltage-sensitive dye imaging in monkey V1

The relevance of oscillations (7-12Hz) in neural processing, although recognized long ago, remains a major research question in the field. While intensively studied in humans, oscillations appear much less often investigated (and observed) in monkeys. Here we wish to provide data from non-human primates on stimulus-related rhythm. Indeed, in humans, EEG is enhanced in response to non-periodic dynamic visual stimulation ("perceptual echoes" or to a static stimulus ("flickering wheel illusion"). Do the same visual patterns induce an oscillatory response in monkey V1? We record voltage-sensitive dye signals from three anesthetized monkeys to investigate the population-based oscillatory neural response that is not resulting from attention-related feedback signals. We revealed oscillations in monkey V1 which, when they occur, react in a manner comparable to human studies.

neuroscience↗

Prefrontal attentional saccades explore space at an alpha rhythm

Recent studies suggest that attention samples space rhythmically through oscillatory interactions in the frontoparietal network. However, the precise mechanism through which the prefrontal cortex, at the source of attention control signals, organizes this rhythmic exploration of space remains unknown. We show that, when decoded at a high spatial (0.1{degrees}) and temporal resolution (50ms), the prefrontal covert attentional spotlight, aka the minds eye, continuously explores space at an alpha 7-12 Hz rhythm. When sensory events are presented at a specific optimal phase (resp. anti-phase) with respect to this rhythm, sensory encoding and behavioral report are accurate (resp. poor). We propose that this rhythmic prefrontal attentional spotlight dynamics corresponds to a continuous overt exploration of space via alpha-clocked attentional saccades. These attentional saccades are highly flexible, their pattern of space exploration depending both on within-trial and across-task contingencies. These results are discussed in the context of exploration and exploitation strategies and prefrontal top-down attentional control.\n\nHighlightsO_LIThe decoded prefrontal attentional spotlight samples visual space in rhythmic cycles\nC_LIO_LIThis rhythmic attentional exploration predicts neuronal sensory processing accuracy\nC_LIO_LIThis rhythmic attentional exploration predicts overt behavioral accuracy\nC_LIO_LIThese rhythmic cycles define alpha-clocked attentional saccades\nC_LIO_LISpace exploration by attentional saccades is highly flexible and under top-down control\nC_LI

neuroscience↗

Theta-phase dependent neuronal coding during sequence learning in human single neurons.

The ability to maintain a sequence of items in short-term memory (STM) is a fundamental cognitive function. In the rodent hippocampus, the representation of sequentially organized spatial locations is reflected by the phase of action potentials relative to the theta oscillation (phase precession). We investigated whether the timing of neuronal activity relative to the theta brain oscillation also reflects sequence order in the medial temporal lobe of humans. We used a task in which human subjects learned sequences of pictures and recorded single neuron and local field potential activity with implanted electrodes. We report that spikes for three consecutive items in the sequence (the preferred stimulus for each cell, as well as the stimuli immediately preceding and following it) were phase-locked at distinct phases of the theta oscillation. Consistent with phase precession, spikes were fired at progressively earlier phases as the sequence advanced. These findings generalize previous findings in the rodent hippocampus to the human temporal lobe and suggest that encoding stimulus information at distinct oscillatory phases may play a role in maintaining their sequential order in STM.

neuroscience↗

Attention differentially modulates the amplitude of resonance frequencies in the visual cortex

Rhythmic visual stimuli (flicker) elicit rhythmic brain responses at the frequency of the stimulus, and attention generally enhances these oscillatory brain responses (steady state visual evoked potentials, SSVEPs). Although SSVEP responses have been tested for flicker frequencies up to 100 Hz [Herrmann, 2001], effects of attention on SSVEP amplitude have only been reported for lower frequencies (up to ~30 Hz), with no systematic comparison across a wide, finely sampled frequency range. Does attention modulate SSVEP amplitude at higher flicker frequencies (gamma band, 30-80 Hz), and is attentional modulation constant across frequencies? By isolating SSVEP responses from the broadband EEG signal using a multivariate spatiotemporal source separation method, we demonstrate that flicker in the alpha and gamma bands elicit strongest and maximally phase stable brain responses (resonance), on which the effect of attention is opposite: positive for gamma and negative for alpha. Finding subject-specific gamma resonance frequency and a positive attentional modulation of gamma-band SSVEPs points to the untapped potential of flicker as a non-invasive tool for studying the causal effects of interactions between visual gamma-band rhythmic stimuli and endogenous gamma oscillations on perception and attention.

neuroscience↗

Visual Entrainment at 10 Hz causes periodic modulation of the Flash Lag Illusion

It has long been debated whether visual processing is, at least partially, a discrete process. Although vision appears to be a continuous stream of sensory information, sophisticated experiments reveal periodic modulations of perception and behavior. Previous work has demonstrated that the phase of endogenous neural oscillations in the 10 Hz range predicts the \"lag\" of the flash lag effect, a temporal visual illusion in which a static object is perceived to be lagging in time behind a moving object. Consequently, it has been proposed that the flash lag illusion could be a manifestation of a periodic, discrete sampling mechanism in the visual system. In this experiment we set out to causally test this hypothesis by entraining the visual system to a periodic 10 Hz stimulus and probing the flash lag effect (FLE) at different time points during entrainment. We hypothesized that the perceived FLE would be modulated over time, at the same frequency as the entrainer (10 Hz). A frequency analysis of the average FLE time-course indeed reveals a significant peak at 10 Hz as well as a strong phase consistency between subjects (N=26). Our findings provide evidence for a causal relationship between alpha oscillations and fluctuations in temporal perception.

neuroscience↗