Search bioRxiv⌕ Search

Biology subjects

Urgen, B. A.

Publications and source records attributed to Urgen, B. A..

15 recordsLinked to original sources

Naturalistic Stimulus Reconstruction from fMRI: A Primer in the Natural Scenes Dataset

Reconstructing natural images from brain activity represents one of the most compelling demonstrations of the synergy between modern neuroimaging and machine learning. However, the computational pipelines underlying these results remain scarcely accessible, difficult to reproduce, and offer limited opportunities for hands-on experimentation. They depend on large codebases, expensive hardware, and multiple representational stages whose interactions are not obvious. We present a step-by-step tutorial, organized across six notebooks, for reconstructing natural images from fMRI responses in the Natural Scenes Dataset. The workflow walks the reader through three main stages: predicting coarse image structure from brain activity by targeting the latent space of a pretrained image autoencoder, predicting semantic content by targeting learned vision-language embeddings, and combining both signals through a pretrained generative model that produces a final image reflecting both the recovered layout and the recovered meaning. Each notebook explains the reasoning behind its pipeline stage and provides runnable code to reproduce and build on each component. We present qualitative and quantitative metrics for all of our pipeline stages. Every notebook runs end-to-end on free-tier Google Colab hardware, and each stage can be inspected, modified, and replaced independently.

neuroscience↗

Behind and Beyond the Screen: Neural Differences Between Live vs. Video-Based Action Perception Under Attentional Load

Perceiving others actions is essential for survival, interaction, and communication, yet most neuroscience studies rely on 2D videos or images that lack the presence and social affordances of real actions. This limits our understanding of real-world action perception and the development of neurally grounded models. Here, we directly compare behavioral and neural responses to real (live) versus video-based actions. Using a novel experimental setup (Pekcetin et al. 2023), we conducted a two-session EEG study (N = 26) in which participants viewed peripheral actions presented live or via video while performing a central task under low and high attentional load. We examined behavioral performance, mass-univariate ERPs, time-frequency responses, and time-resolved representational similarity (RSA). Behaviorally, real actions imposed a greater cognitive cost than video actions, with the largest "Realness Effect" under high load. ERPs showed reliable Live-Video differences within 150-450 ms after action onset. Time-frequency analyses over occipital and parietal regions revealed weaker alpha (8-12 Hz) and beta (15-25 Hz) suppression for video actions, indicating reduced perceptual engagement. Time-resolved RSA also robustly separated live and video conditions between 250-750 ms. Together, these results show that live actions engage perceptual systems more strongly than their video-based counterparts, underscoring the limitations of screen-mediated paradigms and motivating more ecologically grounded approaches in social and action perception research.

neuroscience↗

Direction Selectivity in Naturalistic Action Observation: Distributed Representations Across the Action Observation Network

Perceiving the direction of observed actions is critical for interpreting intentions and guiding social interaction. While direction selectivity has been extensively studied with simple stimuli such as dots, gratings, or point-light displays (PLDs), little is known about how the brain encodes direction in naturalistic, repetitive actions that are seen frequently in daily life. The present fMRI study investigated direction-selective representations during observation of complex actions performed along three bidirectional dimensions (left-right, up-down, front-back) within a 96-video stimulus set. The brain activity was analyzed using multivariate pattern analysis (MVPA) and multiple regression representational similarity analysis (RSA). MVPA revealed above-chance classification of action direction across occipital, parietal, and motor cortices, with the highest decoding in occipital, primary motor, and somatosensory regions. Crucially, RSA demonstrated that when accounting for low-level and motor features, direction information was still represented in early visual cortex, occipito-temporal areas, parietal regions, and motor-related regions. These findings indicate that action direction is represented across multiple levels of the action observation network (AON), extending from early sensory regions to higher-order parietal and frontal cortices. By using naturalistic, repetitive action videos, this study provides new evidence that the coding of action direction in the human brain is broadly distributed, reflecting the complexity of perceiving actions in everyday life. These findings suggest that direction selectivity is a core feature of the action observation network, linking basic motion processing with higher-level action understanding.

neuroscience↗

The Role of Predictive Processing and Perceptual Load in Selective Visual Attention: An Examination with Semantically Salient and Less Salient Distractors

Our attentional resources are allocated to the various aspects of the environment based on the context, and predictive coding has been used as a model to explain the interaction between sensory-based information and top-down expectations in visual attention (Spratling, 2008; Rauss et al., 2011). On the other hand, the saliency of the environmental stimuli is also hypothesized to be capturing the attentional resources of the individuals involuntarily, and thus, it is thought to be playing a crucial role in attentional resource allocation. The current study investigates the role of predictive processing of task difficulty in selective visual attention in the presence of various distractors. Utilizing a letter search task, we provided brief cues about the upcoming tasks difficulty, and participants were asked to detect the target letters. We investigated whether predictive processing about task demands may cause a difference in behavioral measures in the presence of semantically less salient distractors in Experiment 1 (Gabor patches) and semantically more salient distractors in Experiment 2 (faces). Results showed that unmet expectations about the task demands caused longer reaction times in both studies. We observed that all independent variables, which are task difficulty, cue congruency, and distractor presence, affected reaction times in both experiments, but cue congruency interacted with distractor presence only in Experiment 2. Here, we argue that though predictive processing plays a role in attentional resource allocation and, distractors characteristics are also crucial as the saliency level interacts with the cue congruency.

neuroscience↗

A database of digital line drawings that depict expected and unexpected action-place relationships

In the present study, we introduce an image database created with a simple digital line-drawing tool to represent the expected and unexpected action-place relationships. This database consists of 70 drawings. We validated the dataset with 207 participants. They evaluated the actions, places, and the probability of an action taking place in the respective location. The comprehensibility of each drawing was evaluated using three measures: H-statistics (entropy), which is a measure of the uncertainty of the definition; the definition similarity percentages which is a measure of the naming agreement that is consistent among participants; and the mean probability of the depicted action taking place in the depicted location. Each drawing includes different agents and environments, providing researchers with the opportunity to use this dataset in various fields of cognitive neuroscience, including visual recognition, memory, predictive coding, and novelty detection.

neuroscience↗

Top-Down Modulation of Visual Action Perception: Distinct Task Effects in the Action Observation Network

Perceiving others actions is essential for survival and social interaction. Cognitive neuroscience research has identified a network of brain regions crucial to visual action perception, known as the Action Observation Network (AON), comprising the posterior superior temporal cortex (pSTS), posterior parietal cortex, and premotor cortex. Recent research highlights the importance of integrating top-down processes, such as attention, to gain a deeper understanding of action perception. This study investigates how attention modulates the AON during human action perception. We conducted a two-session fMRI experiment with 27 participants. They viewed eight videos of pushing actions, varying in actor (female vs. male), effector (hand vs. foot), and target (human vs. object). In the first session, participants focused on specific features of the videos (actor, effector, or target). In the second, they passively viewed the videos. From the passive viewing session data, we defined regions of interest (ROIs) in the pSTS, parietal, and premotor cortices for each hemisphere. We then performed model-based representational similarity analysis (RSA) and decoding analysis. RSA results showed that only the task model, among all tested models, exhibited a significant correlation with neural representational similarity matrices (RDMs) across all ROIs, indicating a specific alignment between AON nodes and the ongoing task. Decoding analysis further showed that different task types uniquely affected each AON node, indicating feature- and region-specific interactions. These findings underscore that top-down attentional processes significantly alter neural representations within the AON, highlighting the dynamic interplay between attention and action perception in the brain.

neuroscience↗

The Interplay of Prior Information and Motion Cues in Resolving Visual Ambiguity in Agent Perception

Agent perception is essential for social interaction, allowing individuals to interpret and respond to the actions of others within dynamic environments. In this study, we examined on how prior knowledge and motion cues are integrated to influence the temporal dynamics of perceiving agents. In order to make realistic but ambiguous stimuli in motion and form characteristics, we used human, robot, and android agents. Using temporal representational similarity analysis (RSA) on EEG recordings, we analyzed the representation of agent identities under varying conditions--Still versus Moving stimuli and Prior versus Naive contexts. Our findings revealed that prior knowledge and motion cues interact to produce distinct temporal patterns of representation. In the naive condition, information about the agent persisted longer during still presentations than during moving ones, suggesting that the processing of agents depends on the availability of motion information and prior information. Moreover, motion information affects the temporal processing of agents when no prior information about agents is available. These results highlight the critical roles of both bottom-up sensory inputs and top-down expectations and their interactions in resolving the ambiguities inherent in agent perception.

neuroscience↗

Predictive processing in biological motion perception: Evidence from human behavior

Biological motion perception plays a crucial role in understanding the actions of other animals, facilitating effective social interactions. While foundation of biological motion perception is rooted in bottom-up processes, as evidenced by point-light display studies, real-world complexities necessitate the involvement of top-down processes, such as attention and expectation. This study investigates the impact of expectations on biological motion perception using a cued individuation task with point-light display stimuli. We conducted three experiments, each providing advance information about distinct aspects of the subsequent biological motion stimuli - specifically information about action, emotion, and gender. Our results revealed a pattern in the action experiment, where participants demonstrated significantly slower response times for incongruent trials than congruent ones, but only under the 75% cue validity condition. This effect was notably absent in the emotion and gender experiments. Our exploration underscores the multi-faceted nature of biological motion perception, highlighting that while the brain adeptly harnesses prior cues to anticipate and interpret stimuli, the nature and reliability of these cues play a pivotal role on their effects. Specifically, action-related information stands out as an important modulator, possibly due to its evolutionary significance and unique neural processing pathway. These findings not only agree with the principles of predictive processing but also pave the way for future research, emphasizing the need to utilize naturalistic, complex stimuli together with neuroimaging methods to create more comprehensive models of biological motion perception.

neuroscience↗

Task-Modulated Neural Responses in Scene-Selective Regions of the Human Brain

The study of scene perception is crucial to the understanding of how one interprets and interacts with their environment, and how the environment impacts various cognitive functions. The literature so far has mainly focused on the impact of low-level and categorical properties of scenes and how they are represented in the scene-selective regions in the brain, PPA, RSC, and OPA. However, higher-level scene perception and the impact of behavioral goals has not been explored in depth. Moreover, the selection of the stimuli has not been systematic and mainly focused on outdoor environments. In this fMRI experiment, we adopted multiple behavioral tasks, selected real-life indoor stimuli with a systematic categorization approach, and used various multivariate analysis techniques to explain the neural modulation of scene perception in the scene-selective regions of the human brain. Participants (N=21) performed categorization and approach-avoidance tasks during fMRI scans while they were viewing scenes from built environment categories based on different affordances ((i)access and (ii)circulation elements, (iii)restrooms and (iv)eating/seating areas). Searchlight-based classification analysis revealed that the OPA was significantly successful in decoding scene category regardless of the task, and that the task condition affected category decoding performances of all the scene-selective regions. Model-based representational similarity analysis (RSA) revealed that the activity patterns in scene-selective regions are best explained by task. These results contribute to the literature by extending the task and stimulus content of scene perception research, and uncovering the impact of behavioral goals on the scene-selective regions of the brain.

neuroscience↗

Biological motion perception in the theoretical framework of perceptual decision-making: An event-related potential study

Biological motion perception plays a critical role in various decisions in daily life for humans. Failure to decide accordingly in such a perceptual task could have life-threatening consequences. Neurophysiological studies on non-human primates and computational modeling studies suggest two processes that mediate perceptual decision-making. One of these signals is associated with the accumulation of sensory evidence and the other with response selection. Recent EEG studies with human participants have introduced an event-related potential called Centroparietal Positive Potential (CPP) as a neural marker aligned with the sensory evidence accumulation while effectively distinguishing it from motor-related event-related potential, namely lateralized readiness potential (LRP). The present study aims to investigate the neural mechanisms of biological motion perception in the theoretical framework of perceptual decision-making, which has been overlooked before. More specifically, we examine whether CPP would track the coherence of the biological motion stimuli and could be distinguished from the LRP signal. We recorded EEG from human participants while they were engaged in a direction discrimination task of a point-light walker whose coherence was manipulated by embedding it in various levels of noise. Our behavioral findings revealed shorter reaction times and reduced miss rates as the coherence of the target stimuli increased. In addition, CPP tracked the coherence of the biological motion stimuli with a tendency to reach a common level during the response, albeit with a later onset than the previously reported results in random-dot motion paradigms. Furthermore, CPP was distinguished from the LRP signal based on its temporal profile. Overall, our results suggest that the mechanisms underlying perceptual decision-making generalize to more complex and socially significant stimuli like biological motion. We discuss the implications of these findings for advancing computational models of biological motion perception and perceptual decision-making.

neuroscience↗

The interplay of cortical magnification and perceptual load in the visual processing of task-irrelevant biological motion across the visual field

Perceptual load theory argues that attention is a limited resource and stimuli cannot be processed if there is insufficient perceptual capacity available. Although attention is known to modulate biological motion processing, whether this modulation differs among different perceptual loads remains unknown. To answer this question, three experiments are conducted in which biological motion is utilized as a task-irrelevant distractor. The first experiment showed that biological motion is processed differently than non-biological motion across different perceptual load conditions. The second experiment investigated the effect of attention on biological motion processing, revealing that higher eccentricities enhance biological motion processing but only when the perceptual load is low. The last experiment investigated the same question but with cortically magnified stimuli. It found that when the stimuli are cortically magnified, the enhancement effect of eccentricity is present regardless of the perceptual load. Overall, the results suggest that perceptual load modulates the processing of task-irrelevant biological motion and interacts with other factors (such as eccentricity) that modulate this processing.

neuroscience↗

Neural processing of bottom up perception of biological motion under attentional load

Considering its importance for ones survival and social significance, biological motion (BM) perception is assumed to occur automatically. Indeed, Thornton and Vuong (2004) showed that task-irrelevant BM in the periphery interfered with task performance at the fovea. However, the neural underpinnings of this bottom-up processing of BM lacks thorough examination in the field. Under selective attention, BM perception is supported by a network of regions including the occipito-temporal, parietal, and premotor cortices. A retinotopy mapping study on BM showed distinct maps for its processing under and away from selective attention (Saygin & Sereno, 2008). Based on these findings, we investigated how bottom-up perception of BM would be processed in the human brain under attentional load when it was shown away from the focus of attention as a task-irrelevant stimulus. Participants (N=31) underwent an fMRI study in which they performed an attentionally demanding visual detection task at the fovea while intact or scrambled PLDs of BM were shown at the periphery. Our results showed the main effect of attentional load in fronto-parietal regions and the main effect of peripheral stimuli in occipito-temporal cortex. Both univariate activity maps and multivariate pattern analysis results support the attentional load modulation on BM in the occipito-temporal cortex. In conclusion, BM is processed within the motion sensitive regions in the occipito-temporal cortex even when it is away from selective attention, and is modulated by the top-down factor of attentional load.

neuroscience↗

Task-Dependent Warping of Semantic Representations During Search for Visual Action Categories

Object and action perception in cluttered dynamic natural scenes relies on efficient allocation of limited brain resources to prioritize the attended targets over distractors. It has been suggested that during visual search for objects, distributed semantic representation of hundreds of object categories is warped to expand the representation of targets. Yet, little is known about whether and where in the brain visual search for action categories modulates semantic representations. To address this fundamental question, we studied human brain activity recorded via functional magnetic resonance imaging while subjects viewed natural movies and searched for either communication or locomotion actions. We find that attention directed to action categories elicits tuning shifts that warp semantic representations broadly across neocortex, and that these shifts interact with intrinsic selectivity of cortical voxels for target actions. These results suggest that attention serves to facilitate task performance during social interactions by dynamically shifting semantic selectivity towards target actions, and that tuning shifts are a general feature of conceptual representations in the brain.

neuroscience↗

The unique role of parietal cortex in action observation: Functional organization for communicative and manipulative actions

Action observation is supported by a network of regions in occipito-temporal, parietal, and premotor cortex in primates. Recent research suggests that the parietal node has regions dedicated to different action classes including manipulation, interpersonal, skin-displacing, locomotion, and climbing. The goals of the current study consist of: 1) extending this work with new classes of actions that are communicative and specific to humans, 2) investigating how parietal cortex differs from the occipito-temporal and premotor cortex in representing action classes. Human subjects underwent fMRI scanning while observing three action classes: indirect communication, direct communication, and manipulation, plus two types of control stimuli, static controls which were static frames from the video clips, and dynamic controls consisting of temporally-scrambled optic flow information. Using univariate analysis, MVPA, and representational similarity analysis, our study presents several novel findings. First, we provide further evidence for the anatomical segregation in parietal cortex of different action classes: We have found a new region that is specific for representing human-specific indirect communicative actions in cytoarchitectonic parietal area PFt. Second, we found that the discriminability between action classes was higher in parietal cortex than the other two levels suggesting the coding of action identity information at this level. Finally, our results advocate the use of the control stimuli not just for univariate analysis of complex action videos but also when using multivariate techniques.

neuroscience↗

Predictive coding account of action perception: Evidence from effective connectivity in the Action Observation Network

Visual perception of actions is supported by a network of brain regions in the occipito-temporal, parietal, and premotor cortex in the primate brain, known as the Action Observation Network (AON). Although there is a growing body of research that characterizes the functional properties of each node of this network, the communication and direction of information flow between the nodes is unclear. According to the predictive coding account of action perception, this network is not a purely feedforward system but has feedback connections through which prediction error signals are communicated between the regions of the AON. In the present study, we investigated the effective connectivity of the AON in an experimental setting where the human subjects predictions about the observed agent were violated, using fMRI and Dynamical Causal Modeling (DCM). We specifically examined the influence of the lowest and highest nodes in the AON hierarchy, pSTS and ventral premotor cortex, respectively, on the middle node, inferior parietal cortex during prediction violation. Our DCM results suggest that the influence on the inferior parietal node is through a feedback connection from ventral premotor cortex during perception of actions that violate peoples predictions.

neuroscience↗