Search bioRxiv⌕ Search

Biology subjects

Buhmann, Z.

Publications and source records attributed to Buhmann, Z..

2 recordsLinked to original sources

Violated predictions enhance the representational fidelity of visual features in perception

Predictive coding theories argue that recent experience establishes expectations that generate prediction errors when violated. In humans, brain imaging studies have revealed unique signatures of violated predictions in sensory cortex, but the perceptual consequences of these effects remain unknown. We had observers perform a dual-report task on the orientation of a briefly presented target grating within predictable or random sequences, while we recorded pupil size as an index of surprise. Observers first made a speeded response to categorize the orientation of the target grating (clockwise or counterclockwise from vertical), then reproduced its orientation without time pressure by rotating a bar. This allowed us to separately assess response speed and precision for the same stimuli. Critically, on half the trials, the target orientation deviated from the spatiotemporal structure established by the preceding gratings. Observers responded faster and more accurately to unexpected gratings, and pupillometry provided physiological evidence of observers surprise in response to these events. In a second experiment, we cued the spatial location and timing of the grating and found the same pattern of results, demonstrating that unexpected orientation information is sufficient to produce faster and more precise responses, even when the location and timing of the relevant stimuli are fully expected. These findings indicate that unexpected events are prioritized by the visual system both in terms of processing speed and representational fidelity.

neuroscience↗

Inverted encoding of neural responses to audiovisual stimuli reveals super-additive multisensory enhancement

A central challenge for the brain is how to combine separate sources of information from different sensory modalities to optimally represent objects and events in the external world, such as combining someones speech and lip movements to better understand them in a noisy environment. At the level of individual neurons, audiovisual stimuli often elicit super-additive interactions, where the neural response is greater than the sum of auditory and visual responses. However, investigations using electroencephalography (EEG) to record brain activity have revealed inconsistent interactions, with studies reporting a mix of super- and sub-additive effects. A possible explanation for this inconsistency is that standard univariate analyses obscure multisensory interactions present in EEG responses by overlooking multivariate changes in activity across the scalp. To address this shortcoming, we investigated EEG responses to audiovisual stimuli using inverted encoding, a population tuning approach that uses multivariate information to characterise feature-specific neural activity. Participants (n = 41) completed a spatial localisation task for both unisensory stimuli (auditory clicks, visual flashes) and combined audiovisual stimuli (spatiotemporally congruent clicks and flashes). To assess multivariate changes in EEG activity, we used inverted encoding to recover stimulus location information from event-related potentials (ERPs). Participants localised audiovisual stimuli more accurately than unisensory stimuli alone. For univariate ERP analyses we found an additive multisensory interaction. By contrast, multivariate analyses revealed a super-additive interaction [~]180 ms following stimulus onset, such that the location of audiovisual stimuli was decoded more accurately than that predicted by maximum likelihood estimation. Our results suggest that super-additive integration of audiovisual information is reflected within multivariate patterns of activity rather than univariate evoked responses.

neuroscience↗