Search bioRxiv⌕ Search

Biology subjects

Klotzsche, F.

Publications and source records attributed to Klotzsche, F..

7 recordsLinked to original sources

Expectation Shapes Neural Preparation for AI-generated and Real Image Processing: Evidence from EEG

AbstractAI-generated images, videos, and news have become an inseparable part of daily life, leading to increasing skepticism toward online information. Understanding how expectations about the presence of AI-generated content influence perception is crucial for elucidating the underlying neural mechanisms and facilitating the generation of naturalistic avatars. In this study, we analyzed an existing EEG dataset (N = 29) in which participants viewed emotional facial photographs of only real individuals while being informed that upcoming faces were either real ("REAL") or AI-generated ("FAKE"). We examined pre-stimulus oscillatory activities in the one-second EEG interval before stimulus onset and found significantly lower alpha power when participants expected "FAKE" compared to "REAL" faces. This effect was region-specific, particularly in right occipito-parietal and temporo-parietal regions, as identified by both sensor- and source- level analyses. In addition, the modulation effect between pre-stimulus alpha activity and post-stimulus event-related potentials (ERPs) was measured. A significant correlation between changes in late positive potential (LPP) amplitudes and pre-stimulus alpha power was observed exclusively for "FAKE" smiling faces, consistent with our previous findings. These results suggest that AI-related expectations modulate neural preparatory states, with lower alpha activity presumably reflecting increased attentional demands for stimuli believed to be artificially generated. This study demonstrates that top-down beliefs systematically shape both pre- and post-stimulus neural dynamics, providing new insights into how cognitive expectations bias perceptual processing, with implications for understanding human-AI interaction and improving the design and evaluation of AI- generated content in real-world contexts.

neuroscience↗

EEG-decodability of facial expressions and their stereoscopic depth cues in immersive virtual reality

Face perception typically occurs in three-dimensional space, where stereoscopic depth cues enrich the perception of facial features. Yet, most neurophysiological research on face processing relies on two-dimensional displays, potentially overlooking the role of stereoscopic depth information. Here, we combine immersive virtual reality (VR), electroencephalography (EEG), and eye tracking to examine the neural representation of faces under controlled manipulations of stereoscopic depth. Thirty-four participants viewed computer-generated faces with neutral, happy, angry, and surprised expressions in frontal view under monoscopic and stereoscopic viewing conditions. Using time-resolved multivariate decoding, we show that EEG signals in immersive VR conditions can reliably differentiate facial expressions. Stereoscopic depth cues elicited a distinct and decodable neural signature, confirming the sensitivity of our approach to depth-related processing. Yet, expression decoding remained robust across depth conditions, indicating that under controlled frontal viewing, the neural representation of behaviorally distinguishable facial expressions is invariant to binocular depth cues. Eye tracking showed that expression-related gaze patterns contained comparable information but did not account for neural representations, while depth information was absent in gaze patterns--consistent with dissociable representational processes. Our findings demonstrate the feasibility of EEG-based neural decoding in fully immersive VR as a tool for investigating face perception in naturalistic settings and provide new evidence for the stability of expression representations across depth variations in three-dimensional viewing conditions.

neuroscience↗

No cardiac phase bias for threat perception under naturalistic conditions in immersive virtual reality

Previous studies have found that threatening stimuli are more readily perceived and more intensely experienced when presented during cardiac systole compared to diastole. Also, threatening stimuli are judged as physically closer than neutral ones. In a pre-registered study, we tested these effects and their interaction using a naturalistic (interactive, 3D) experimental design in immersive virtual reality: We briefly displayed threatening and non-threatening animals (four each) at varying distances (1.5-5.5 meters) to a group of young, healthy participants (n = 41), while recording their ECGs (electrocardiograms). Participants then pointed to the location where they had seen the animal (ca. 29k trials in total). Our pre-registered analyses indicated that perceived distances to both threatening and non-threatening animals did not differ significantly between cardiac phases - with Bayesian analysis supporting the null hypothesis. There was also no evidence for an association between subjective fear and perceived proximity to threatening animals. These results contrast with previous findings that used verbal or declarative distance measures in less naturalistic experimental conditions. Furthermore, our findings suggest that the cardiac phase-related variation in threat processing may not generalize across different paradigms and may be less relevant in naturalistic scenarios than under more abstract experimental conditions. Impact statementTo our knowledge, this is the first study to assess the influence of interoceptive cardiac signals on visual perception using naturalistic stimuli in immersive virtual reality. We based the design of our experiment on previous reports about threat processing biases and the role of the cardiac cycle but did not observe the expected effects. This poses the question of their generalizability from abstract settings to more naturalistic setups, featuring greater behavioral engagement and a richer sensory environment.

physiology↗

Linking brain-heart interactions to emotional arousal in immersive virtual reality

The subjective experience of emotions is linked to the contextualized perception and appraisal of changes in bodily (e.g., heart) activity. Increased emotional arousal has been related to attenuated high-frequency heart rate variability (HF-HRV), lower EEG parieto-occipital alpha power, and higher heartbeat-evoked potential (HEP) amplitudes. We studied emotional arousal-related brain- heart interactions using immersive virtual reality (VR) for naturalistic yet controlled emotion induction. 29 healthy adults (13 women, age: 26{+/-}3) completed a VR experience that included rollercoasters while EEG and ECG were recorded. Continuous emotional arousal ratings were collected during a video replay immediately after. We analyzed emotional arousal-related changes in HF-HRV as well as in BHIs using HEPs. Additionally, we used the oscillatory information in the ECG and the EEG to model the directional information flows between the brain and heart activity. We found that higher emotional arousal was associated with lower HEP amplitudes in a left fronto- central electrode cluster. While parasympathetic modulation of the heart (HF-HRV) and parieto- occipital EEG alpha power were reduced during higher emotional arousal, there was no evidence for the hypothesized emotional arousal-related changes in bidirectional information flow between them. Whole-brain exploratory analyses in additional EEG (delta, theta, alpha, beta and gamma) and HRV (low-frequency, LF, and HF) frequency bands revealed a temporo-occipital cluster, in which higher emotional arousal was linked to decreased brain-to-heart (i.e., gamma[->]HF-HRV) and increased heart-to-brain (i.e., LF-HRV[->]gamma) information flow. Our results confirm previous findings from less naturalistic experiments and suggest a link between emotional arousal and brain-heart interactions in temporo-occipital gamma power.

neuroscience↗

Visual short-term memory related EEG components in a virtual reality setup

Virtual reality (VR) offers a powerful tool for investigating cognitive processes, as it allows researchers to gauge behaviors and mental states in complex, yet highly controlled, scenarios. The use of VR head-mounted displays in combination with physiological measures such as EEG presents new challenges and raises the question whether established findings also generalize to a VR setup. Here, we used a VR headset to assess the spatial constraints underlying two well-established EEG correlates of visual short-term memory: the amplitude of the contralateral delay activity (CDA) and the lateralization of induced alpha power during memory retention. We tested observers visual memory in a delayed match-to-sample task with bilateral stimulus arrays of either two or four items while varying the horizontal eccentricity of the memory arrays (4, 9, or 14 degrees of visual angle). The CDA amplitude differed between high and low memory load at the two smaller eccentricities, but not at the largest eccentricity. Neither memory load nor eccentricity significantly influenced the observed alpha lateralization. We further fitted time-resolved spatial filters to decode memory load from the event-related potential as well as from its time-frequency decomposition. Classification performance during the retention interval was above chance level for both approaches and did not vary significantly across eccentricities. We conclude that commercial VR hardware can be utilized to study the CDA and lateralized alpha power, and we provide caveats for future studies targeting these EEG markers of visual memory in a VR setup. Impact statementCombining EEG with virtual reality, we studied how the eccentricity of a memory array during encoding affects well-known neural markers of visual short-term memory. We reveal that the previously reported occurrence of these EEG components during visual memory retention can be replicated in such a setup. These EEG markers were differently affected by eccentricity, hence providing valuable constraints for future experimental designs.

neuroscience↗

Decoding subjective emotional arousal from EEG during an immersive Virtual Reality experience

Immersive virtual reality (VR) enables naturalistic neuroscientific studies while maintaining experimental control, but dynamic and interactive stimuli pose methodological challenges. We here probed the link between emotional arousal, a fundamental property of affective experience, and parieto-occipital alpha power under naturalistic stimulation: 37 young healthy adults completed an immersive VR experience, which included rollercoaster rides, while their EEG was recorded. They then continuously rated their subjective emotional arousal while viewing a replay of their experience. The association between emotional arousal and parieto-occipital alpha power was tested and confirmed by (1) decomposing the continuous EEG signal while maximizing the comodulation between alpha power and arousal ratings and by (2) decoding periods of high and low arousal with discriminative common spatial patterns and a Long Short-Term Memory recurrent neural network. We successfully combine EEG and a naturalistic immersive VR experience to extend previous findings on the neurophysiology of emotional arousal towards real-world neuroscience.

neuroscience↗

Active vision varies across the cardiac cycle

Perception and cognition oscillate with fluctuating bodily states. For example, visual processing has been shown to change with alternating cardiac phases. Here, we study the heartbeats role for active information sampling--testing whether humans implicitly act upon their environment so that relevant signals appear during preferred cardiac phases. During the encoding period of a visual memory experiment, participants clicked through a set of emotional pictures to memorize them for a later recognition test. By self-paced key press, they actively prompted the onset of shortly (100-ms) presented pictures. Simultaneously recorded electrocardiograms allowed us to analyse the self-initiated picture onsets relative to the heartbeat. We find that self-initiated picture onsets vary across the cardiac cycle, showing an increase during cardiac systole, while memory performance was not affected by the heartbeat. We conclude that active information sampling integrates heart-related signals, thereby extending previous findings on the association between body-brain interactions and behaviour.

neuroscience↗