Search bioRxivSearch

Biology subjects

Fahrenfort, J. J.

Publications and source records attributed to Fahrenfort, J. J..

6 recordsLinked to original sources

Beta and theta oscillations differentially support free versus forced control over target selection in visual search

Many important situations require human observers to simultaneously search for more than one object. Despite a long history of research into visual search, the behavioral and neural mechanisms associated with multiple-target search are poorly understood. Here we test the novel theory that the efficiency of looking for multiple targets critically depends on the mode of cognitive control the environment affords to the observer. We used an innovative combination of EEG and eye tracking while participants searched for two targets, within two different contexts: Either both targets were present in the search display and observers were free to prioritize either one of them, thus enabling proactive control over selection; or only one of the two targets would be present in each search display, which requires reactive control to reconfigure selection when the wrong target is prioritized. During proactive control, both univariate and multivariate signals of beta-band (15-35 Hz) power suppression prior to display onset predicted switches between target selections. This signal originated over midfrontal and sensorimotor regions and has previously been associated with endogenous state changes. In contrast, imposed target selections requiring reactive control elicited prefrontal power enhancements in the delta/theta-band (2-8 Hz), but only after display onset. This signal predicted individual differences in associated oculomotor switch costs, reflecting reactive reconfiguration of target selection. The results provide compelling evidence that multiple target representations are differentially prioritized during visual search, and for the first time reveal distinct neural mechanisms underlying proactive and reactive control over multiple-target search.\n\nSignificance StatementSearching for more than one object in complex visual scenes can be detrimental for search performance. While perhaps annoying in daily life, this can have severe consequences in professional settings such as medical and security screening. Previous research has not yet resolved whether multiple-target search involves changing priorities in what people attend to, and how such changes are controlled. We approached these questions by concurrently measuring cortical activity and eye movements using EEG and eye tracking, while observers searched for multiple possible targets. Our findings provide the first unequivocal support for the existence of two modes of control during multiple-target search, which are expressed in qualitatively distinct time-frequency signatures of the EEG both before and after visual selection.

neuroscience

Current and future goals are represented in opposite patterns in object-selective cortex

Adaptive behavior requires the separation of current from future goals in working memory. We used fMRI of object-selective cortex to determine the representational (dis)similarities of memory representations serving current and prospective perceptual tasks. Participants remembered an object drawn from three possible categories as the target for one of two consecutive visual search tasks. A cue indicated whether the target object should be looked for first (currently relevant), second (prospectively relevant), or if it could be forgotten (irrelevant). Prior to the first search, representations of current, prospective and irrelevant objects were similar, with strongest decoding for current representations compared to prospective (Experiment 1) and irrelevant (Experiment 2). Remarkably, during the first search, prospective representations could also be decoded, but revealed anti-correlated voxel patterns compared to currently relevant representations of the same category. We propose that the brain separates current from prospective memories within the same neuronal ensembles through opposite representational patterns.

neuroscience

Unattended but actively stored: EEG dynamics reveal a dissociation between selective attention and storage in working memory

Selective attention plays a prominent role in prioritizing information in working memory (WM), improving performance for attended representations. However, it remains unclear what the consequences of selection are for the maintenance of unattended WM representations, and whether this results in information loss. Here we tested the hypothesis that within WM, selectively attending to an item and the decision to stop storing other items involve independent mechanisms. We recorded EEG while participants performed a WM recall task in which the item most likely to be tested was cued retrospectively. By manipulating retro-cue reliability (i.e. the ratio of valid to invalid cue trials) we varied the incentive to retain uncued items. Contralateral alpha power suppression, a proxy for attention, indicated that, initially, the cued item was attended equally following high and low reliability cues, but attention was sustained throughout the delay period only after high reliability cues. Furthermore, contralateral delay activity (CDA), a proxy for storage, indicated that non-cued items were dropped sooner from WM after highly reliability cues than after cues with low reliability. These results show that attention and storage in WM are distinct processes that can behave differently depending on the relative importance of WM representations, as expressed in dissociable EEG signals.

neuroscience

Criterion Setting Modulates Neural Excitability of Human Visual Cortex

Decision bias is traditionally conceptualized as an internal reference against which sensory evidence is compared. Instead, we show that individuals implement decision bias by shifting the rate of sensory evidence accumulation towards a decision bound. Participants performed a target detection task while we recorded EEG. We experimentally manipulated participants decision criterion for reporting targets using different stimulus-response reward contingencies, inducing either a liberal or a conservative bias. Drift diffusion modeling revealed that a liberal strategy biased sensory evidence accumulation towards target-present choices. Moreover, a liberal bias resulted in stronger midfrontal pre-stimulus 2-6 Hz (theta) power and suppression of pre-stimulus 8--12 Hz (alpha) power in posterior cortex. The alpha suppression in turn mediated the output activity of visual cortex, as expressed in 59--100 Hz (gamma) power. These findings show that observers can intentionally control cortical excitability to strategically bias evidence accumulation towards the decision bound that maximizes their reward.

neuroscience

Working memory implements distinct maintenance mechanisms depending on task goals

Working memory is the function by which we temporarily maintain information to achieve current task goals. Models of working memory typically debate where this information is stored, rather than how it is stored. Here we ask instead what neural mechanisms are involved in storage, and how these mechanisms change as a function of task goals. Participants either had to reproduce the orientation of a memorized bar (continuous recall task), or identify the memorized bar in a search array (visual search task). The sensory input and retention interval were identical in both tasks. Next, we used decoding and forward modeling on multivariate electroencephalogram (EEG) and time-frequency decomposed EEG to investigate which neural signals carry more informational content during the retention interval. In the continuous recall task, working memory content was preferentially carried by induced oscillatory alpha-band power, while in the visual search task it was more strongly carried by the distribution of evoked (consistently elevated and non-oscillatory) EEG activity. To show the independence of these two signals, we were able to remove informational content from one signal without affecting informational content in the other. Finally, we show that the tuning characteristics of both signals change in opposite directions depending on the current task goal. We propose that these signals reflect oscillatory and elevated firing-rate mechanisms that respectively support location-based and object-based maintenance. Together, these data challenge current models of working memory that place storage in particular regions, but rather emphasize the importance of different distributed maintenance signals depending on task goals.\n\nSignificance statement (120 words)Without realizing, we are constantly moving things in and out of our minds eye, an ability also referred to as working memory. Where did I put my screwdriver? Do we still have milk in the fridge? A central question in working memory research is how the brain maintains this information temporarily. Here we show that different neural mechanisms are involved in working memory depending on what the memory is used for. For example, remembering what a bottle of milk looks like invokes a different neural mechanism from remembering how much milk it contains: the first one primarily involved in being able to find the object, and the other one involving spatial position, such as the milk level in the bottle.

neuroscience

Multivariate EEG analyses support high-resolution tracking of feature-based attentional selection

The primary electrophysiological marker of feature-based selection is the N2pc, a lateralized posterior negativity emerging around 180-200 ms. As it relies on hemispheric differences, its ability to discriminate the locus of focal attention is severely limited. Here we demonstrate that multivariate analyses of raw EEG data provide a much more fine-grained spatial profile of feature-based target selection. When training a pattern classifier to determine target position from EEG, we were able to decode target positions on the vertical midline, which cannot be achieved using standard N2pc methodology. Next, we used a forward encoding model to construct a channel tuning function that describes the continuous relationship between target position and multivariate EEG in an eight-position display. This model can spatially discriminate individual target positions in these displays and is fully invertible, enabling us to construct hypothetical topographic activation maps for target positions that were never used. When tested against the real pattern of neural activity obtained from a different group of subjects, the constructed maps from the forward model turned out statistically indistinguishable, thus providing independent validation of our model. Our findings demonstrate the power of multivariate EEG analysis to track feature-based target selection with high spatial and temporal precision.\n\nSignificance StatementFeature-based attentional selection enables observers to find objects in their visual field. The spatiotemporal profile of this process is difficult to assess with standard electrophysiological methods, which rely on activity differences between cerebral hemispheres. We demonstrate that multivariate analyses of EEG data can track target selection across the visual field with high temporal and spatial resolution. Using a forward model, we were able to capture the continuous relationship between target position and EEG measurements, allowing us to reconstruct the distribution of cortical activity for target locations that were never shown during the experiment. Our findings demonstrate the existence of a temporally and spatially precise EEG signal that can be used to study the neural basis of feature-based attentional selection.

neuroscience