Biology subjects

Kaiser, D.

Publications and source records attributed to Kaiser, D..

At least 55 records · Page 3Linked to original sources

bioRxiv2022

Moving and static faces, bodies, objects and scenes are differentially represented across the three visual pathways

Models of human cortex propose the existence of neuroanatomical pathways specialised for different behavioural functions. These pathways include a ventral pathway for object recognition, a dorsal pathway for performing visually guided physical actions and a recently proposed third pathway for social perception. In the current study we tested the hypothesis that different categories of moving stimuli are differentially processed across the dorsal and third pathways according to their behavioural implications. Human participants (N=30) were scanned with functional magnetic resonance imaging (fMRI) while viewing moving and static stimuli from five categories (faces, bodies, scenes, objects, and scrambled objects). Whole brain group analyses showed that moving bodies and moving objects increased neural responses in bilateral V5/MT+ and intraparietal sulcus (IPS), parts of the dorsal pathway. In addition, moving faces and moving bodies increased neural responses in bilateral V5/MT+ and the right posterior superior temporal sulcus (rpSTS), parts of the third pathway. This pattern of results was also supported by a separate region of interest (ROI) analysis showing that moving stimuli produced more robust neural responses for all visual object categories, particularly in lateral and dorsal brain areas. Our results suggest that dynamic naturalistic stimuli from different categories are routed along specific visual pathways that process their unique behavioural implications.

neuroscience↗

bioRxiv2022

Spectral brain signatures of aesthetic natural perception in the alpha and beta frequency bands

During our everyday lives, visual beauty is often conveyed by sustained and dynamic visual stimulation, such as when we walk through an enchanting forest or watch our pets playing. Here, I devised an MEG experiment that mimics such situations: Participants viewed 8s videos of everyday situations and rated their beauty. Using multivariate analysis, I linked aesthetic ratings to (1) sustained MEG broadband responses and (2) spectral MEG responses in the alpha and beta frequency bands. These effects were not accounted for by a set of high- and low-level visual descriptors of the videos, suggesting that they are genuinely related to aesthetic perception. My findings provide a first characterization of spectral brain signatures linked to aesthetic experiences in the real world.

neuroscience↗

bioRxiv2022

Characterizing dynamic neural representations of scene attractiveness

Aesthetic experiences during natural vision are varied: they can arise from viewing scenic landscapes, interesting architecture, or attractive people. Recent research in the field of neuroaesthetics has taught us a lot about where in the brain such aesthetic experiences are represented. Much less is known about when such experiences arise during the cortical processing cascade. Particularly, the dynamic neural representation of perceived attractiveness for rich natural scenes is not well understood. Here, I present data from an EEG experiment, in which participants provided attractiveness judgments for a set of diverse natural scenes. Using multivariate pattern analysis, I demonstrate that scene attractiveness is mirrored in early brain signals that arise within 200ms of vision, suggesting that the aesthetic appeal of scenes is first resolved during perceptual processing. In more detailed analyses, I show that even such early neural correlates of scene attractiveness are partly related to inter-individual variation in aesthetic preferences and that they generalize across scene contents. Together, these results characterize the time-resolved neural dynamics that give rise to aesthetic experiences in complex natural environments.

neuroscience↗

bioRxiv2021

Benchmarking GE-BOLD, SE-BOLD, and SS-SI-VASO sequences for depth-dependent separation of feedforward and feedback signals in high-field MRI

Recent advances in high-field fMRI have allowed differentiating feedforward and feedback information in the grey matter of the human brain. For continued progress in this endeavor, it is critical to understand how MRI data acquisition parameters impact the read-out of information from laminar response profiles. Here, we benchmarked three different MR-sequences at 7T - gradient-echo (GE), spin-echo (SE) and vascular space occupancy imaging (VASO) - in differentiating feedforward and feedback signals in human early visual cortex (V1). The experiment (N=4) consisted of two complementary tasks: a perception task that predominantly evokes feedforward signals and a working memory task that relies on feedback signals. In the perception task, participants saw flickering oriented gratings while detecting orthogonal color-changes. In the working memory task, participants memorized the precise orientation of a grating. We used multivariate pattern analysis to read out the perceived (feedforward) and memorized (feedback) grating orientation from neural signals across cortical depth. Analyses across all the MR-sequences revealed perception signals predominantly in the middle cortical compartment of area V1 and working memory signals in the deep compartment. Despite an overall consistency across sequences, SE-EPI was the only sequence where both feedforward and feedback information were differently pronounced across cortical depth in a statistically robust way. We therefore suggest that in the context of a typical cognitive neuroscience experiment as the one benchmarked here, SE-EPI may provide a favorable trade-off between spatial specificity and signal sensitivity. HighlightsHere, we benchmarked three sequences at high-field fMRI -GE-BOLD, SE-BOLD and VASO - in differentiating feedforward and feedback signals across grey matter depth of area V1. We show that: O_LIAll the MR-sequences revealed the feedforward and feedback signals at the middle and deep cortical bins, respectively. C_LIO_LISuch correspondence across the sequences indicates that widely used GE-BOLD is a suitable method for the exploration of signals in cortical depth. C_LIO_LIOnly SE-BOLD yielded statistically reliable differences between the cortical bins carry- ing feedforward and feedback signals. C_LI

neuroscience↗

bioRxiv2021

Resolving the time course of visual and auditory object categorization

Humans can effortlessly categorize objects, both when they are conveyed through visual images and spoken words. To resolve the neural correlates of object categorization, studies have so far primarily focused on the visual modality. It is therefore still unclear how the brain extracts categorical information from auditory signals. In the current study we used EEG (N=47) and time-resolved multivariate pattern analysis to investigate (1) the time course with which object category information emerges in the auditory modality and (2) how the representational transition from individual object identification to category representation compares between the auditory modality and the visual modality. Our results show that (1) that auditory object category representations can be reliably extracted from EEG signals and (2) a similar representational transition occurs in the visual and auditory modalities, where an initial representation at the individual-object level is followed by a subsequent representation of the objects category membership. Altogether, our results suggest an analogous hierarchy of information processing across sensory channels. However, we did not find evidence for a shared supra-modal code, suggesting that the contents of the different sensory hierarchies are ultimately modality-unique.

animal behavior and cognition↗

bioRxiv2021

Semantic scene-object consistency modulates N300/400 EEG components, but does not automatically facilitate object representations

During natural vision, objects rarely appear in isolation, but often within a semantically related scene context. Previous studies reported that semantic consistency between objects and scenes facilitates object perception, and that scene-object consistency is reflected in changes in the N300 and N400 components in EEG recordings. Here, we investigate whether these N300/400 differences are indicative of changes in the cortical representation of objects. In two experiments, we recorded EEG signals while participants viewed semantically consistent or inconsistent objects within a scene; in Experiment 1, these objects were task-irrelevant, while in Experiment 2, they were directly relevant for behavior. In both experiments, we found reliable and comparable N300/400 differences between consistent and inconsistent scene-object combinations. To probe the quality of object representations, we performed multivariate classification analyses, in which we decoded the category of the objects contained in the scene. In Experiment 1, in which the objects were not task-relevant, object category could be decoded from around 100 ms after the object presentation, but no difference in decoding performance was found between consistent and inconsistent objects. By contrast, when the objects were task-relevant in Experiment 2, we found enhanced decoding of semantically consistent, compared to semantically inconsistent, objects. These results show that differences in N300/400 components related to scene-object consistency do not index changes in cortical object representations, but rather reflect a generic marker of semantic violations. Further, our findings suggest that facilitatory effects between objects and scenes are task-dependent rather than automatic.

neuroscience↗

bioRxiv2021

Modelling brain representations of abstract concepts

Abstract conceptual representations are critical for human cognition. Despite their importance, key properties of these representations remain poorly understood. Here, we used computational models of distributional semantics to predict multivariate fMRI activity patterns during the activation and contextualization of abstract concepts. We devised a task in which participants had to embed abstract nouns into a story that they developed around a given background context. We found that representations in inferior parietal cortex were predicted by concept similarities emerging in models of distributional semantics. By constructing different model families, we reveal the models learning trajectories and delineate how abstract and concrete training materials contribute to the formation of brain-like representations. These results inform theories about the format and emergence of abstract conceptual representations in the human brain.

neuroscience↗

bioRxiv2021

Perceived and mentally rotated contents are differentially represented in cortical depth of V1

Primary visual cortex (V1) in humans is known to represent both veridically perceived external input and internally-generated contents underlying imagery and mental rotation. However, it is unknown how the brain keeps these contents separate thus avoiding a mixture of the perceived and the imagined which could lead to potentially detrimental consequences. Inspired by neuroanatomical studies showing that feedforward and feedback connections in V1 terminate in different cortical layers, we hypothesized that this anatomical compartmentalization underlies functional segregation of external and internally-generated visual contents, respectively. We used high-resolution layer-specific fMRI to test this hypothesis in a mental rotation task. We found that rotated contents were predominant at outer cortical depth bins (i.e. superficial and deep). At the same time perceived contents were represented stronger at the middle cortical bin. These results identify how through cortical depth compartmentalization V1 functionally segregates rather than confuses external from internally-generated visual contents. These results indicate that feedforward and feedback manifest in distinct subdivisions of the early visual cortex, thereby reflecting a general strategy for implementing multiple cognitive functions within a single brain region.

neuroscience↗

bioRxiv2020

Coherent natural scene structure facilitates the extraction of task-relevant object information in visual cortex

Looking for objects within complex natural environments is a task everybody performs multiple times each day. In this study, we explore how the brain uses the typical composition of real-world environments to efficiently solve this task. We recorded fMRI activity while participants performed two different categorization tasks on natural scenes. In the object task, they indicated whether the scene contained a person or a car, while in the scene task, they indicated whether the scene depicted an urban or a rural environment. Critically, each scene was presented in an "intact" way, preserving its coherent structure, or in a "jumbled" way, with information swapped across quadrants. In both tasks, participants categorization was more accurate and faster for intact scenes. These behavioral benefits were accompanied by stronger responses to intact than to jumbled scenes across high-level visual cortex. To track the amount of object information in visual cortex, we correlated multi-voxel response patterns during the two categorization tasks with response patterns evoked by people and cars in isolation. We found that object information in object- and body-selective cortex was enhanced when the object was embedded in an intact, rather than a jumbled scene. However, this enhancement was only found in the object task: When participants instead categorized the scenes, object information did not differ between intact and jumbled scenes. Together, these results indicate that coherent scene structure facilitates the extraction of object information in a task-dependent way, suggesting that interactions between the object and scene processing pathways adaptively support behavioral goals.

neuroscience↗

bioRxiv2020

Processing of subjectively and objectively invisible stimuli in human visual cortex

The study of unconscious processing requires a measure of conscious awareness. Awareness measures can be either subjective (based on participants report) or objective (based on perceptual performance). The preferred awareness measure depends on the theoretical position about consciousness, and may influence conclusions about the extent of unconscious processing and about the neural correlates of consciousness. We obtained fMRI measurements from 43 subjects while they viewed masked faces and houses that were either subjectively or objectively invisible. We show that neural representations of objectively invisible faces and houses are limited to visual (shape-related) object properties, while subjectively invisible stimuli are processed up to more abstract, categorical levels of representation. These results demonstrate that the hypothesized extent of unconscious information processing is determined by the measurement approach. Furthermore, our data show that subjective and objective approaches are associated with different neural correlates of consciousness and thus have implications for neural theories of consciousness.

neuroscience↗

bioRxiv2020

Tracking cortical representations of facial attractiveness using time-resolved representational similarity analysis

When we see a face, we rapidly form an impression of its attractiveness. Here, we investigated how rapidly representations of facial attractiveness emerge in the human brain. In an EEG experiment, participants viewed 100 face photographs and rated them for their attractiveness. Using time-resolved representational similarity analysis on the EEG data, we reveal representations of facial attractiveness after 150-200ms of cortical processing. Interestingly, we show that these representations are related to individual participants personal attractiveness judgments, suggesting that already early perceptual representations of facial attractiveness convey idiosyncratic attractiveness preferences. Further, we show that these early representations are genuinely related to attractiveness, as they are neither explained by other high-level face attributes, such as face sex or age, nor by features extracted by an artificial deep neural network model of face processing. Together, our results demonstrate early, individually specific, and genuine representations of facial attractiveness, which may underlie fast attractiveness judgments.

neuroscience↗

bioRxiv2020

Real-world structure facilitates the rapid emergence of scene category information in visual brain signals

In everyday life, our visual surroundings are not arranged randomly, but structured in predictable ways. Although previous studies have shown that the visual system is sensitive to such structural regularities, it remains unclear whether the presence of an intact structure in a scene also facilitates the cortical analysis of the scenes categorical content. To address this question, we conducted an EEG experiment during which participants viewed natural scene images that were either "intact" (with their quadrants arranged in typical positions) or "jumbled" (with their quadrants arranged into atypical positions). We then used multivariate pattern analysis to decode the scenes category from the EEG signals (e.g., whether the participant had seen a church or a supermarket). The category of intact scenes could be decoded rapidly within the first 100ms of visual processing. Critically, within 200ms of processing category decoding was more pronounced for the intact scenes compared to the jumbled scenes, suggesting that the presence of real-world structure facilitates the extraction of scene category information. No such effect was found when the scenes were presented upside-down, indicating that the facilitation of neural category information is indeed linked to a scenes adherence to typical real-world structure, rather than to differences in visual features between intact and jumbled scenes. Our results demonstrate that early stages of categorical analysis in the visual system exhibit tuning to the structure of the world that may facilitate the rapid extraction of behaviorally relevant information from rich natural environments.

neuroscience↗

bioRxiv2020

Rapid contextualization of fragmented scene information in the human visual system

Real-world environments are extremely rich in visual information. At any given moment in time, only a fraction of this information is available to the eyes and the brain, rendering naturalistic vision a collection of incomplete snapshots. Previous research suggests that in order to successfully contextualize this fragmented information, the visual system sorts inputs according to spatial schemata, that is knowledge about the typical composition of the visual world. Here, we used a large set of 840 different natural scene fragments to investigate whether this sorting mechanism can operate across the diverse visual environments encountered during real-world vision. We recorded brain activity using electroencephalography (EEG) while participants viewed incomplete scene fragments at fixation. Using representational similarity analysis on the EEG data, we tracked the fragments cortical representations across time. We found that the fragments typical vertical location within the environment (top or bottom) predicted their cortical representations, indexing a sorting of information according to spatial schemata. The fragments cortical representations were most strongly organized by their vertical location at around 200ms after image onset, suggesting rapid perceptual sorting of information according to spatial schemata. In control analyses, we show that this sorting is flexible with respect to visual features: it is neither explained by commonalities between visually similar indoor and outdoor scenes, nor by the feature organization emerging from a deep neural network trained on scene categorization. Demonstrating such a flexible sorting across a wide range of visually diverse scenes suggests a contextualization mechanism suitable for complex and variable real-world environments.

neuroscience↗

bioRxiv2019

Cortical sensitivity to natural scene structure

Natural scenes are inherently structured, with meaningful objects appearing in predictable locations. Human vision is tuned to this structure: When scene structure is purposefully jumbled, perception is strongly impaired. Here, we tested how such perceptual effects are reflected in neural sensitivity to scene structure. During separate fMRI and EEG experiments, participants passively viewed scenes whose spatial structure (i.e., the position of scene parts) and categorical structure (i.e., the content of scene parts) could be intact or jumbled. Using multivariate decoding, we show that spatial (but not categorical) scene structure profoundly impacts on cortical processing: Scene-selective responses in occipital and parahippocampal cortices (fMRI) and after 255ms (EEG) accurately differentiated between spatially intact and jumbled scenes. Importantly, this differentiation was more pronounced for upright than for inverted scenes, indicating genuine sensitivity to spatial structure rather than sensitivity to low-level attributes. Our findings suggest that visual scene analysis is tightly linked to the spatial structure of our natural environments. This link between cortical processing and scene structure may be crucial for rapidly parsing naturalistic visual inputs.

neuroscience↗

bioRxiv2018

The neural dynamics of familiar face recognition

In real-life situations, the appearance of a persons face can vary substantially across different encounters, making face recognition a challenging task for the visual system. Recent fMRI decoding studies have suggested that face recognition is supported by identity representations located in regions of the occipito-temporal cortex. Here, we used EEG to elucidate the temporal emergence of these representations. Human participants (both sexes) viewed a set of highly variable face images of four highly familiar celebrities (two male, two female), while performing an orthogonal task. Univariate analyses of event-related EEG responses revealed a pronounced differentiation between male and female faces, but not between identities of the same sex. Using multivariate representational similarity analysis, we observed a gradual emergence of face identity representations, with an increasing degree of invariance. Face identity information emerged rapidly, starting shortly after 100ms from stimulus onset. From 400ms after onset and predominantly in the right hemisphere, identity representations showed two invariance properties: (1) they equally discriminated identities of opposite sexes and of the same sex, and (2) they were tolerant to image-based variations. These invariant representations may be a crucial prerequisite for successful face recognition in everyday situations, where the appearance of a familiar person can vary drastically.\n\nSignificance StatementRecognizing the face of a friend on the street is a task we effortlessly perform in our everyday lives. However, the necessary visual processing underlying familiar face recognition is highly complex. As the appearance of a given person varies drastically between encounters, for example across viewpoints or emotional expressions, the brain needs to extract identity information that is invariant to such changes. Using multivariate analyses of EEG data, we characterize how invariant representations of face identity emerge gradually over time. After 400ms of processing, cortical representations reliably differentiated two similar identities (e.g., two famous male actors), even across a set of highly variable images. These representations may support face recognition under challenging real-life conditions.

neuroscience↗

bioRxiv2018

Spatial attention follows category-based attention during naturalistic visual search: evidence from MEG decoding

In daily life, attention is often directed to high-level object attributes, such as when we look out for cars before crossing a road. Previous work used MEG decoding to investigate the influence of such category-based attention on the time course of object category representations. Attended object categories were more strongly represented than unattended categories from 180 ms after scene onset. In the present study, we used a similar approach to determine when, relative to this category-level modulation, attention is spatially focused on the target. Participants completed two tasks. In the first, they detected cars and people at varying locations in photographs of real-world scenes. In the second, they detected a cross that appeared at salient locations in an array of lines. Multivariate classifiers were trained on data of the artificial salience experiment and tested on data of the naturalistic visual search experiment. Results showed that the location of both target and distracter objects could be accurately decoded shortly after scene onset (50 ms). However, the emergence of spatial attentional selection - reflected in better decoding of target location than distracter location - emerged only later in time (240 ms). Target presence itself (irrespective of location and category) could be decoded from 180 ms after stimulus onset. Combined with earlier work, these results indicate that naturalistic category search operates through an initial spatially-global modulation of category processing that then guides attention to the location of the target.

neuroscience↗

bioRxiv2018

Typical visual-field locations facilitate access to awareness for everyday objects

In real-world vision, humans are constantly confronted with complex environments that contain a multitude of objects. These environments are spatially structured, so that objects have different likelihoods of appearing in specific parts of the visual space. Our massive experience with such positional regularities prompts the hypothesis that the processing of individual objects varies in efficiency across the visual field: when objects are encountered in their typical locations (e.g., we are used to seeing lamps in the upper visual field and carpets in the lower visual field), they should be more efficiently perceived than when they are encountered in atypical locations (e.g., a lamp in the lower visual field and a carpet in the upper visual field). Here, we provide evidence for this hypothesis by showing that typical positioning facilitates an objects access to awareness. In two continuous flash suppression experiments, objects more efficiently overcame inter-ocular suppression when they were presented in visual-field locations that matched their typical locations in the environment, as compared to non-typical locations. This finding suggests that through extensive experience the visual system has adapted to the statistics of the environment. This adaptation may be particularly useful for rapid object individuation in natural scenes.

neuroscience↗

bioRxiv2017

MEG sensor patterns reflect perceptual but not categorical similarity of animate and inanimate objects

Human high-level visual cortex shows a distinction between animate and inanimate objects, as revealed by fMRI. Recent studies have shown that object animacy can similarly be decoded from MEG sensor patterns. Which object properties drive this decoding? Here, we disentangled the influence of perceptual and categorical object properties by presenting perceptually matched objects (e.g., snake and rope) that were nonetheless easily recognizable as being animate or inanimate. In a series of behavioral experiments, three aspects of perceptual dissimilarity of these objects were quantified: overall dissimilarity, outline dissimilarity, and texture dissimilarity. Neural dissimilarity of MEG sensor patterns was modeled using regression analysis, in which perceptual dissimilarity (from the behavioral experiments) and categorical dissimilarity served as predictors of neural dissimilarity. We found that perceptual dissimilarity was strongly reflected in MEG sensor patterns from 80ms after stimulus onset, with separable contributions of outline and texture dissimilarity. Surprisingly, when controlling for perceptual dissimilarity, MEG patterns did not carry information about object category (animate vs inanimate) at any time point. Nearly identical results were found in a second MEG experiment that required basic-level object recognition. These results suggest that MEG sensor patterns do not capture object animacy independently of perceptual differences between animate and inanimate objects. This is in contrast to results observed in fMRI using the same stimuli, task, and analysis approach: fMRI showed a highly reliable categorical distinction in visual cortex even when controlling for perceptual dissimilarity. Results thus point to a discrepancy in the information contained in multivariate fMRI and MEG patterns.

neuroscience↗