Search bioRxiv⌕ Search

Biology subjects

Denison, R. N.

Publications and source records attributed to Denison, R. N..

14 recordsLinked to original sources

Time-resolved decoding of uncertainty about stimulus features from human EEG

Internal and external noise produce uncertainty in the neural representations of sensory stimuli. Uncertainty about basic stimulus features can be decoded from responses in sensory brain regions by estimating full probability distributions over stimulus features, rather than point estimates. Such decoded uncertainty correlates with subjective uncertainty reports, providing insight into the neural basis of metacognitive judgments. However, in humans, probabilistic decoding has only been applied to functional magnetic resonance imaging (fMRI) data, which has low temporal resolution and thus can give only limited insight into the dynamics of uncertainty in the brain. Here, we assessed whether probabilistic decoding of uncertainty about stimulus features could be extended to electroencephalography (EEG) data, which has higher temporal resolution but lower spatial resolution and different noise properties compared to fMRI. Participants performed a spatial location estimation task and provided subjective uncertainty reports. We found that time-resolved probabilistic decoding in EEG was feasible, as decoders produced accurate predictions of stimulus location following stimulus onset, and decoding error correlated trial-by-trial with decoded uncertainty. The choice of noise covariance structure critically impacted these metrics. Further, decoded uncertainty was a more reliable trial-by-trial indicator of stimulus information than decoding error, illustrating the advantages of probabilistic decoding over standard decoding approaches. However, uncertainty decoded from EEG had no significant trial-by-trial correlation with subjective uncertainty at any time point. Based on these results, uncertainty decoded from EEG provides a time-resolved estimate of stimulus information available from the brain signal on a single trial but may not relate to metacognitive reports.

neuroscience↗

Voluntary temporal attention improves perception even in the absence of temporal competition

When successive stimuli occur close enough together in time, their perception can be impaired. Such impairments indicate temporal competition between successive stimuli for processing resources. Voluntary temporal attention can bias processing resources in favor of a behaviorally relevant moment, improving perception at the attended time at the expense of impairments at unattended times. However, it is unclear whether these perceptual tradeoffs across time arise because voluntary temporal attention selects among actively competing stimulus representations, such as within visual working memory, or if, instead, temporal attention facilitates stimulus processing prior to a competitive stage. Here we used a temporal cueing task with up to two grating targets in succession to test whether and how the effects of temporal attention depend on temporal competition. Participants reported whether at a probed time the target was present or absent, and if present, performed a difficult orientation discrimination judgment. To isolate the effects of voluntary temporal attention from those of temporal expectation, we manipulated the task-relevance of the two possible target times while controlling stimulus timing predictability. Temporal competition was manipulated via stimulus presence or absence at the unprobed time. We found that voluntary temporal attention improved perceptual discriminability even in the absence of temporal competition, when only one stimulus appeared during the trial. Critically, the magnitude of attentional enhancement was comparable with and without temporal competition. These results suggest that voluntary temporal attention enhances perception by facilitating processing prior to a competitive stage, rather than by resolving conflicts between actively competing stimulus representations.

neuroscience↗

Temporal cueing improves audition with no evidence for attentional tradeoffs

Temporal cues help us focus attention at just the right moment. Whereas visual temporal attention selectively boosts perception at attended times at a cost to other moments, it remains unclear whether auditory temporal attention operates under the same constraints. To address this question, we designed a two-target temporal cueing task where participants discriminated the frequency sweep direction of one of two successive auditory stimuli, separated by 250 ms, while temporal attention was directed to one or both time points. We found that temporal attention improved auditory discrimination only for the first time point and could then remain sustained across the interval, without evidence of attentional tradeoffs in perceptual discriminability across time. Further, manipulating auditory feature uncertainty changed overall performance but did not modulate the impact of temporal attention or yield tradeoffs. Finally, comparison to previous data from a closely matched visual task confirmed that while temporal attention enhanced perception in both vision and audition, only vision shows tradeoffs at this timescale. Altogether the results suggest that the temporal constraints on attention are modality-dependent.

neuroscience↗

Perceptual Support for Temporal Normalization Across Hundreds of Milliseconds

Perception across time is limited: phenomena like masking and temporal crowding reveal perceptual interference between sequential stimuli, even when separated by hundreds of milliseconds. However the underlying causes of these suppressive temporal interactions remain unclear. A potential explanatory mechanism is temporal normalization, a form of divisive suppression proposed to operate across time in the visual cortex, but largely untested behaviorally. Here in three experiments we tested a key perceptual prediction of temporal normalization: contrast-dependent suppression between sequential stimuli. By independently manipulating the contrasts of two sequential gratings presented 250 ms apart, we found that perceptual sensitivity to a targets orientation decreased when a high-vs. low-contrast non-target appeared either before or after it. Reduced sensitivity arose from both decreased orientation precision and increased "swapping" errors. The results provide perceptual support for a temporal normalization computation operating across hundreds of milliseconds, offering a theoretical framework for perceptual limits across time. Public significance statementTemporal context strongly affects perception, but a general theoretical framework that captures such effects is lacking. Neural studies support the existence of temporal normalization, the divisive suppression of information across time. However the behavioral impact of temporal normalization on perception remains unclear. Here we tested a key behavioral prediction of temporal normalization: contrast-dependant suppression between sequential stimuli. We found evidence for such suppression across hundreds of milliseconds both forward and backward in time. Our results provide perceptual evidence for temporal normalization, linking neural data to behavior, and support a theoretical framework that could bridge a range of temporal phenomena such as visual masking, adaptation, and temporal crowding.

neuroscience↗

Attention reshapes the representational geometry of a perceptual feature space

Department of Psychological and Brain Sciences, Boston University Our perception of the world is transformed by attention, both in terms of the efficiency of information processing and the appearance of attended stimuli. A standard theory is that attention regulates how competing stimuli vie for resources. However, an alternative perspective is that attention alters the representational geometry of stimulus spaces, such that changes in processing are not isolated to the particular competing stimuli, but are reflected across the entire perceptual space. To test this representational hypothesis, we conducted an experiment in which participants reported the perceived similarity of orientations spanning the full stimulus space when attention was directed or not directed to specific orientations. We used these similarity judgments to measure the representational geometry of orientation, finding that attention reliably expanded the representational space in a narrow range around the attended orientations. We also found evidence for compression of the representational space in a broad range around unattended orientations. Our findings support the idea that attention acts to reshape the representation of entire perceptual spaces in a way that supports processing of relevant stimulus features. By simultaneously manipulating attention while measuring perceptual similarity, our methodological framework opens the door for future work investigating the interaction between cognitive and perceptual processes from the perspective of representational geometry.

neuroscience↗

Attention robustly dissociates objective performance and subjective visibility reports

Visual experience can sometimes depart from visual performance, providing a powerful lens into the mechanisms generating conscious perception. In one proposed dissociation--subjective inflation--unattended locations in the periphery appear stronger than attended ones despite equated performance. Subjective inflation has played a central role in motivating theories of consciousness that reject the sufficiency of sensory signals for conscious perception. Yet the empirical basis for subjective inflation is limited. Here, in a large-scale adversarial collaboration, we conducted four simultaneously-replicated experiments testing the strength, character, and extent of subjective inflation under inattention. We used a new analytic approach to quantify inattentional inflation over full psychometric functions, beyond single matched-performance levels. We found robust inattentional inflation for contrast-dependent and texture-based perception, at and above the visual threshold. However at suprathreshold, we found inattentional inflation for the overall stimulus but not the specific feature relevant for performance. Finally, we establish the unifying principle that inattentional inflation occurs if and only if attention reduces performance thresholds more than visibility thresholds. Thus what we think we see may regularly exceed what we can visually discriminate, placing constraints on theories of conscious perception.

neuroscience↗

A dynamic spatiotemporal normalization model for continuous vision

How does the visual system process dynamic inputs? Perception and neural activity are shaped by the spatial and temporal context of sensory input, which has been modeled by divisive normalization over space or time. However, theoretical work has largely treated normalization separately within these dimensions and has not explained how future stimuli can suppress past ones. Here we introduce a dynamic spatiotemporal normalization model (D-STAN) with a unified spatiotemporal receptive field structure that implements normalization across both space and time and ask whether this model captures the bidirectional effects of temporal context on neural responses and behavior. D-STAN implements temporal normalization through excitatory and suppressive drives that depend on the recent history of stimulus input, controlled by separate temporal windows. We found that biphasic temporal receptive fields emerged from this normalization computation, consistent with empirical observations. The model also reproduced several neural response properties, including surround suppression, nonlinear response dynamics, subadditivity, response adaptation, and backwards masking. Further, spatiotemporal normalization captured bidirectional temporal suppression that depended on stimulus contrast, consistent with human behavior. Thus, D-STAN captured a wide range of neural and behavioral effects, demonstrating that a unified spatiotemporal normalization computation could underlie dynamic stimulus processing and perception.

neuroscience↗

Temporal attention recruits fronto-cingulate cortex to amplify stimulus representations

The human brain faces significant constraints in its ability to process every item in a sequence of stimuli. Voluntary temporal attention can selectively prioritize a task-relevant item over its temporal competitors to alleviate these constraints. However, it remains unclear when and where in the brain selective temporal attention modulates the visual representation of a prioritized item. Here, we manipulated temporal attention to successive stimuli in a two-target temporal cueing task, while controlling for temporal expectation with fully predictable stimulus timing. We used MEG and time-resolved decoding to track the spatiotemporal evolution of stimulus representations in human observers. We found that temporal attention enhanced the representation of the first target around 250 milliseconds after target onset, in a contiguous region spanning left frontal cortex and cingulate cortex. The results indicate that voluntary temporal attention recruits cortical regions beyond the ventral stream at an intermediate processing stage to amplify the representation of a target stimulus. This routing of stimulus information to anterior brain regions may provide protection from interference in visual cortex by a subsequent stimulus. Thus, voluntary temporal attention may have distinctive neural mechanisms to support specific demands of the sequential processing of stimuli. Significance statementWhen viewing a rapid sequence of visual input, the brain cannot fully process every item. Humans can attend to an item they know will be important to enhance its processing. However, how the brain selects one moment over others is little understood. We found that attending to visual information at a precise moment in time enhances visual representations around 250 ms after an item appears. Unexpectedly, this enhancement occurred not in the visual cortex, but in the left fronto-cingulate cortex. The involvement of frontal rather than posterior cortical regions in representing visual stimuli has not typically been observed for spatial or feature-based attention, suggesting that temporal attention may have specialized neural mechanisms to handle the distinctive demands of sequential processing.

neuroscience↗

Dynamics of temporal attention and expectation revealed by continuous tracking of visual cortical responses

We can often anticipate the precise moment when a stimulus will be relevant for our behavioral goals. Voluntary temporal attention, the prioritization of sensory information at task-relevant time points, enhances visual perception. However, the neural mechanisms of voluntary temporal attention have not been isolated from those of temporal expectation, which reflects timing predictability rather than relevance. Here we used time-resolved steady-state visual evoked responses (SSVER) to investigate how temporal attention dynamically modulates visual activity when temporal expectation is controlled. We recorded MEG while observers directed temporal attention to one of two sequential grating targets with predictable timing. Meanwhile, we used a co-localized SSVER probe to continuously track visual cortical modulations both before and after the target stimuli. In the pre-target period, the SSVER gradually ramped up as the targets approached, reflecting temporal expectation. Furthermore, we found a low-frequency modulation of the SSVER, which shifted approximately half a cycle in phase according to which target was attended. In the post-target period, temporal attention to the first target transiently modulated the SSVER shortly after target onset. Thus, temporal attention dynamically modulates visual cortical responses via both periodic pre-target and transient post-target mechanisms to prioritize sensory information at precise moments.

neuroscience↗

Informational masking vs. crowding - A mid-level trade-off between auditory and visual processing

In noisy or cluttered environments, sensory cortical mechanisms help combine auditory or visual features into perceived objects. Knowing that individuals vary greatly in their ability to suppress unwanted sensory information, and knowing that the sizes of auditory and visual cortical regions are correlated, we wondered whether there might be a corresponding relation between an individuals ability to suppress auditory vs. visual interference. In auditory masking, background sound makes spoken words unrecognizable. When masking arises due to interference at central auditory processing stages, beyond the cochlea, it is called informational masking (IM). A strikingly similar phenomenon in vision, called visual crowding, occurs when nearby clutter makes a target object unrecognizable, despite being resolved at the retina. We here compare susceptibilities to auditory IM and visual crowding in the same participants. Surprisingly, across participants, we find a negative correlation (R = -0.7) between IM susceptibility and crowding susceptibility: Participants who have low susceptibility to IM tend to have high susceptibility to crowding, and vice versa. This reveals a mid-level trade-off between auditory and visual processing.

neuroscience↗

A dynamic normalization model of temporal attention

Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention-the prioritization of visual information at specific points in time-to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modeled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.

neuroscience↗

Modeling pupil responses to rapid sequential events

Pupil size is an easily accessible, noninvasive online indicator of various perceptual and cognitive processes. Pupil measurements have the potential to reveal continuous processing dynamics throughout an experimental trial, including anticipatory responses. However, the relatively sluggish ([~]2 s) response dynamics of pupil dilation make it challenging to connect changes in pupil size to events occurring close together in time. Researchers have used models to link changes in pupil size to specific trial events, but such methods have not been systematically evaluated. Here we developed and evaluated a general linear model (GLM) pipeline that estimates pupillary responses to multiple rapid events within an experimental trial. We evaluated the modeling approach using a sample dataset in which multiple sequential stimuli were presented within 2-s trials. We found: (1) Model fits improved when the pupil impulse response function (puRF) was fit for each observer. PuRFs varied substantially across individuals but were consistent for each individual. (2) Model fits also improved when pupil responses were not assumed to occur simultaneously with their associated trial events, but could have non-zero latencies. For example, pupil responses could anticipate predictable trial events. (3) Parameter recovery confirmed the validity of the fitting procedures, and we quantified the reliability of the parameter estimates for our sample dataset. (4) A cognitive task manipulation modulated pupil response amplitude. We provide our pupil analysis pipeline as open-source software (Pupil Response Estimation Toolbox: PRET) to facilitate the estimation of pupil responses and the evaluation of the estimates in other datasets.

neuroscience↗

Directing voluntary temporal attention increases fixational stability

Our visual input is constantly changing, but not all moments are equally relevant. Temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here we asked whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged brief stimuli presented within a short sequence. They were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted, such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore impacts microsaccades, helping to stabilize fixation at the most relevant moments, over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.\n\nSignificance statementWe pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

neuroscience↗

Humans flexibly incorporate attention-dependent uncertainty into perceptual decisions and confidence

Perceptual decisions are better when they take uncertainty into account. Uncertainty arises not only from the properties of sensory input but also from cognitive sources, such as different levels of attention. However, it is unknown whether humans appropriately adjust for such cognitive sources of uncertainty during perceptual decision making. Here we show that human categorization and confidence decisions take into account uncertainty related to attention. We manipulated uncertainty in an orientation categorization task from trial to trial using only an attentional cue. The categorization task was designed to disambiguate decision rules that did or did not depend on attention. Using formal model comparison to evaluate decision behavior, we found that category and confidence decision boundaries shifted as a function of attention in an approximately Bayesian fashion. This means that the observers attentional state on each trial contributed probabilistically to the decision computation. This responsiveness of an observers decisions to attention-dependent uncertainty should improve perceptual decisions in natural vision, in which attention is unevenly distributed across a scene.

neuroscience↗