Search bioRxiv⌕ Search

Biology subjects

Moerel, D.

Publications and source records attributed to Moerel, D..

14 recordsLinked to original sources

A multibrain advantage for cooperative human behaviour

Collaboration is a cornerstone of human behaviour, enabling individuals to achieve complex goals that transcend individual capabilities. While previous research has largely focused on the alignment of neural representations across brains during social interactions, real-world cooperation frequently involves complementary roles, where success depends on integrating distinct yet interdependent representations. Here, we combined electroencephalography (EEG) hyperscanning and multivariate pattern analysis (MVPA) methods to investigate neural representations in pairs of participants as they jointly performed a speeded two-dimensional visual matching task with asymmetric controls to encourage task division (i.e., attending to different stimulus features). Our results provide direct neural evidence of the emergence of selective information encoding within individual brains and complementary information encoding across brains during successful cooperation. Specifically, optimally divided task dimensions give rise to a late (> 485 ms) multibrain advantage, wherein the combined neural signals of the two participants carry more target-related information than that of either brain individually. Notably, the magnitude of these information-processing modulations within and across brains robustly predicted pairs collective task performance. These findings have broader implications for future research on collaboration, highlighting the need to move beyond representational alignment to harness diverse human as well as machine capabilities across our societies to unlock collective potential.

neuroscience↗

The effect of hunger and state preferences on the neural processing of food images

Visual information plays a key role in guiding food-related decisions. While previous studies have shown that features such as calories and naturalness are encoded by the brain, upon simply seeing the stimuli, it remains unclear how this encoding is shaped by the observers current state. In this study, we explore the effect of 1) hunger state, 2) task relevance, and 3) current individual preference on the processing of visual food information. Participants (N = 23) underwent two EEG sessions: one after fasting overnight and another after eating normally. During each session, participants did two separate tasks, one where the stimuli were task-relevant and one where attention was distracted away. We used multivariate analysis methods to assess the impact of hunger on the representation of food-related features, and to determine the time-course of information related to food flavour, personal appeal, and arousal, across both tasks. Results showed that information about edibility (food versus non-food object), food identity (e.g. hamburger versus pizza), flavour profile, or personal appeal and arousal was not influenced by the hunger manipulation. Flavour was represented regardless of attentive state, whereas personal appeal and arousal information emerged later and were only observed when the food was task relevant. We found that food appeal and arousal encoding were more closely aligned with behavioural ratings within rather than between sessions, suggesting the nature of the encoding was driven by current state. The study provides insights into how personal preferences and physiological states influence the representation of food information in the brain.

neuroscience↗

A comprehensive EEG dataset for investigating visual touch perception

Visual touch perception is fundamental to body awareness and social bonding, helping us perceive ourselves and connect with others. However, understanding its neural basis has been limited by a lack of comprehensive public datasets. To address this, we present an electroencephalography (EEG) and self-report dataset from 80 participants. It includes neural responses from 2,880 trials per participant, during which participants viewed touch interactions between two hands involving either direct skin contact or object-mediated touch. Complementing the EEG data are self-report measures on empathy, perspective-taking, vicarious touch, and mirror-touch synaesthesia, providing a robust resource for exploring individual differences in visual touch perception. Ninety unique videos were presented in four orientations, with trials evenly split between self- and other-perspectives, and showing touch to either the left or right hand. This design supports investigation into how viewing perspective and hand laterality influence touch processing. Technical validation reveals distinct neural patterns associated with visual, sensory, and emotional touch dimensions, highlighting the datasets potential to advance research into diverse aspects of visual touch perception.

neuroscience↗

The neural processes of illusory occlusion in object recognition

Fast and accurate object recognition is crucial for effective behaviour in dynamic visual environments. In some cases, the visual system must overcome ambiguity in visual input during object recognition, such as when an object is partially hidden behind another. Recurrent processing between higher- and lower-order areas is thought to play a role in resolving such ambiguity, enabling the filling in of missing visual information. Here we examined this claim using a novel paradigm in which partial object images appear occluded by an illusory Kanizsa figure, perception of which also depends on recurrent processing by the grouping of Pacmen inducers. If both recognising the partial object and perceiving the illusory shape depend on recurrent processing, object recognition should vary as a function of the presence of illusory shape. Across two behavioural experiments and a separate EEG decoding study, we found no evidence for an interaction between illusion perception and object recognition, and different neural time courses for the illusory figures alone compared to those of the partial objects, which were decoded earlier. Ultimately, our study highlights the robustness of the visual system to solve the identity of the ambiguous object, independently from the processing of different ambiguities occurring at the same time, providing new insights into the mechanisms of recurrence in the early and late stages of information processing and its application to ambiguous object recognition.

neuroscience↗

Neural decoding of competitive decision-making in Rock-Paper-Scissors using EEG hyperscanning

Social interactions are fundamental to daily life, yet social neuroscience research has often studied individuals brains in isolation. Hyperscanning, the simultaneous recording of neural data from multiple participants, enables real-time investigation of social processes by examining multiple brains while they interact. Previous hyperscanning research has largely focused on cooperative tasks, with fewer studies examining competitive contexts. Here, we obtained electroencephalography (EEG) hyperscanning data from 62 participants (31 pairs) who played a computerised version of the Rock-Paper-Scissors game, a classic paradigm for studying competitive decision-making. Although the optimal strategy is to be unpredictable and thus act randomly, participants exhibited behavioural biases, deviating from this ideal. Using multivariate decoding methods to measure neural representations within the two players brains in interaction, we found information about decisions made by participants during gameplay, revealing certain strategies. Notably, losers uniquely represented information about prior trials, suggesting this may impair optimal performance. These results reveal how competitive decision-making is shaped by cognitive biases and previous outcomes, highlighting the difficulty of achieving randomness in strategic contexts. This work advances our understanding of decision-making and cognitive dynamics in competitive interactions.

neuroscience↗

Unlocking information alignment between interacting brains with EEG hyperscanning

Social interactions shape our perception of the world, influencing how we interpret incoming information. Alignment between interacting individuals sensory and cognitive processes is key to successful cooperation and communication, but the neural processes underlying this alignment remain unknown. Here, we leveraged Representational Similarity Analysis (RSA) on electroencephalography (EEG) hyperscanning techniques to investigate information alignment in 24 pairs of participants who performed a categorisation task together based on agreed upon rules. Significant interbrain information alignment emerged within 45 ms of stimulus presentation and persisted for hundreds of milliseconds. Early alignment (45-180 ms) occurred in both real and randomly matched pseudo-pairs, reflecting shared sensory responses. Importantly, alignment after 200 ms strengthened with practice and was unique to real pairs, driven by shared representations associated with, and extending beyond, the categorisation rules they formed. Together, these findings highlight distinct processes underpinning interbrain information alignment during social interactions, that can be effectively captured and disentangled with Interbrain RSA.

neuroscience↗

Rapid visual engagement in neural processing of detailed touch interactions

Touch perception is an inherently multisensory process in which vision plays an essential role. However, our understanding of how vision encodes sensory and emotional-affective aspects of observed touch, and the timing of these processes, is still limited. Here we address this gap by investigating the neural dynamics of visual touch observation by analysing electroencephalographic (EEG) data from participants viewing detailed hand interactions from the Validated Touch-Video Database. We examined how the brain encodes basic body cues such as hand orientation and viewing perspective, in addition to sensory aspects, including the type of touch (e.g., stroking vs. pressing; hand vs. object touch) and the object involved (e.g., knife, brush), as well as emotional-affective dimensions. Using multivariate decoding, information about body cues was present within 60 ms, with sensory and emotional details, including valence, arousal, and pain present around 130 ms, demonstrating efficient early visual processing. Threat was most clearly identified by approximately 265 ms, similarly involving visual regions, suggesting that such evaluations require slightly extended neural engagement. Our findings reveal that bottom-up, automatic visual processing is integral to complex tactile assessments, important for rapidly extracting both the personal relevance and the sensory and emotional dimensions of touch.

neuroscience↗

Domain general frontoparietal regions show modality-dependent coding of auditory and visual rules

A defining feature of human cognition is our ability to respond flexibly to what we see and hear, changing how we respond depending on our current goals. In fact, we can rapidly associate almost any input stimulus with any arbitrary behavioural response. This remarkable ability is thought to depend on a frontoparietal "multiple demand" circuit which is engaged by many types of cognitive demand and widely referred to as domain general. However, it is not clear how responses to multiple input modalities are structured within this system. Domain generality could be achieved by holding information in an abstract form that generalises over input modality, or in a modality-tagged form, which uses similar resources but produces unique codes to represent the information in each modality. We used a stimulus-response task, with conceptually identical rules in two sensory modalities (visual and auditory), to distinguish between these possibilities. Multivariate decoding of functional magnetic resonance imaging data showed that representations of visual and auditory rules recruited overlapping neural resources but were expressed in modality-tagged non-generalisable neural codes. Our data suggest that this frontoparietal system may draw on the same or similar resources to solve multiple tasks, but does not create modality-general representations of task rules, even when those rules are conceptually identical between domains.

neuroscience↗

The Time-Course of Food Representation in the Human Brain

Humans make decisions about food every day. The visual system provides important information that forms a basis for these food decisions. Although previous research has focused on visual object and category representations in the brain, it is still unclear how visually presented food is encoded by the brain. Here, we investigate the time-course of food representations in the brain. We used time-resolved multivariate analyses of electroencephalography (EEG) data, obtained from human participants (both sexes), to determine which food features are represented in the brain, and whether focused attention is needed for this. We recorded EEG while participants engaged in one of two tasks. In one task the stimuli were task relevant, whereas in the other task the stimuli were not task relevant. Our findings indicate that the brain can differentiate between food and non-food items from approximately 112 milliseconds after stimulus onset. The neural signal at later latencies contained information about food naturalness, how much the food was transformed, as well as the perceived caloric content. This information was present regardless of the task. Information about whether food is immediately ready to eat, however, was only present when the food was task relevant and presented at a slow presentation rate. Furthermore, the recorded brain activity correlated with the behavioural responses in an odd-item-out task. The fast representation of these food features, along with the finding that this information is used to guide food categorisation decision-making, suggests that these features are important dimensions along which the representation of foods is organised.

neuroscience↗

Precise overlapping neural representations between feeling and seeing touch in people with high tactile empathy

Simulation theories propose that vicarious touch arises when seeing someone else being touched triggers corresponding representations of being touched. Prior electroencephalography (EEG) findings show that seeing touch modulates both early and late somatosensory responses (measured with or without direct tactile stimulation). Functional Magnetic Resonance Imaging (fMRI) studies have shown that seeing touch increases somatosensory cortical activation. These findings have been taken to suggest that when we see someone being touched, we simulate that touch in our sensory systems. The somatosensory overlap when seeing and feeling touch differs between individuals, potentially underpinning variation in vicarious touch experiences. Increases in amplitude (EEG) or cerebral blood flow response (fMRI), however, are limited in that they cannot test for the information contained in the neural signal: seeing touch may not activate the same information as feeling touch. Here, we use time-resolved multivariate pattern analysis on whole-brain EEG data from people with and without vicarious touch experiences to test whether seen touch evokes overlapping neural representations with the first-hand experience of touch. Participants felt touch to the fingers (tactile trials) or watched carefully matched videos of touch to another persons fingers (visual trials). In both groups, EEG was sufficiently sensitive to allow decoding of touch location (little finger vs. thumb) on tactile trials. However, only in individuals who reported feeling touch when watching videos of touch could a classifier trained on tactile trials distinguish touch location on visual trials. This demonstrates that, for people who experience vicarious touch, there is overlap in the information about touch location held in the neural patterns when seeing and feeling touch. The timecourse of this overlap implies that seeing touch evokes similar representations to later stages of tactile processing. Therefore, while simulation may underlie vicarious tactile sensations, our findings suggest this involves an abstracted representation of directly felt touch.

neuroscience↗

An empirically-driven guide on using Bayes Factors for M/EEG decoding

Bayes Factors can be used to provide quantifiable evidence for contrasting hypotheses and have thus become increasingly popular in cognitive science. However, Bayes Factors are rarely used to statistically assess the results of neuroimaging experiments. Here, we provide an empirically-driven guide on implementing Bayes Factors for time-series neural decoding results. Using real and simulated Magnetoencephalography (MEG) data, we examine how parameters such as the shape of the prior and data size affect Bayes Factors. Additionally, we discuss benefits Bayes Factors bring to analysing multivariate pattern analysis data and show how using Bayes Factors can be used instead or in addition to traditional frequentist approaches.

neuroscience↗

Undivided attention: The temporal effects of attention dissociated from decision, memory, and expectation

Selective attention prioritises relevant information amongst competing sensory input. Time-resolved electrophysiological studies have shown stronger representation of attended compared to unattended stimuli, which has been interpreted as an effect of attention on information coding. However, because attention is often manipulated by making only the attended stimulus a target to be remembered and/or responded to, many reported attention effects have been confounded with target-related processes such as visual short-term memory or decision-making. In addition, the effects of attention could be influenced by temporal expectation. The aim of this study was to investigate the dynamic effect of attention on visual processing using multivariate pattern analysis of electroencephalography (EEG) data, while 1) controlling for target-related confounds, and 2) directly investigating the influence of temporal expectation. Participants viewed rapid sequences of overlaid oriented grating pairs at fixation while detecting a "target" grating of a particular orientation. We manipulated attention, one grating was attended and the other ignored, and temporal expectation, with stimulus onset timing either predictable or not. We controlled for target-related processing confounds by only analysing non-target trials. Both attended and ignored gratings were initially coded equally in the pattern of responses across EEG sensors. An effect of attention, with preferential coding of the attended stimulus, emerged approximately 230ms after stimulus onset. This attention effect occurred even when controlling for target-related processing confounds, and regardless of stimulus onset predictability. These results provide insight into the effect of attention on the dynamic processing of competing visual information, presented at the same time and location.

neuroscience↗

Selective attention and decision-making have separable neural bases in space and time

Attention and decision-making processes are fundamental to cognition. However, they are usually experimentally confounded, making it difficult to link neural observations to specific processes. Here we separated the effects of selective attention from the effects of decision-making on human brain activity, using a two-stage task where the attended stimulus and decision were orthogonal and separated in time. Multivariate pattern analyses of multimodal neuroimaging data revealed the dynamics of perceptual and decision-related information coding through time (magnetoencephalography (MEG)), space (functional Magnetic Resonance Imaging (fMRI)), and their combination (MEG-fMRI fusion). Our MEG results showed an effect of attention before decision-making could begin, and fMRI results showed an attention effect in early visual and frontoparietal regions. Model-based MEG-fMRI fusion suggested that attention boosted stimulus information in frontoparietal and early visual regions before decision-making was possible. Together, our results suggest that attention affects neural stimulus representations in frontoparietal regions independent of decision-making.

neuroscience↗

Towards an individualised neural assessment of receptive language in children

PurposeWe aimed to develop a non-invasive neural test of language comprehension to use with non-speaking children for whom standard behavioural testing is unreliable (e.g., minimally-verbal autism). Our aims were three-fold. First, we sought to establish the sensitivity of two auditory paradigms to elicit neural responses in individual neurotypical children. Second, we aimed to validate the use of a portable and accessible electroencephalography (EEG) system, by comparing its recordings to those of a research-grade system. Third, in light of substantial inter-individual variability in individuals neural responses, we assessed whether multivariate decoding methods could improve sensitivity. MethodsWe tested the sensitivity of two child-friendly covert N400 paradigms. Thirty-one typically developing children listened to identical spoken words that were either strongly predicted by the preceding context or violated lexical-semantic expectations. Context was given by a cue word (Experiment 1) or sentence frame (Experiment 2) and participants either made an overall judgement on word relatedness or counted lexical-semantic violations. We measured EEG concurrently from a research-grade system, Neuroscans SynAmps2, and an adapted gaming system, Emotivs EPOC+. ResultsWe found substantial inter-individual variability in the timing and topology of N400-like effects. For both paradigms and EEG systems, traditional N400 effects at the expected sensors and time points were statistically significant in around 50% of individuals. Using multivariate analyses, detection rate increased to 88% of individuals for the research-grade system in the sentences paradigm, illustrating the robustness of this method in the face of inter-individual variations in topography. ConclusionsThere was large inter-individual variability in neural responses, suggesting inter-individual variation in either the cognitive response to lexical-semantic violations, and/or the neural substrate of that response. Around half of our neurotypical participants showed the expected N400 effect at the expected location and time point. A low-cost, accessible EEG system provided comparable data for univariate analysis but was not well suited to multivariate decoding. However, multivariate analyses with a research-grade EEG system increased our detection rate to 88% of individuals. This approach provides a strong foundation to establish a neural index of language comprehension in children with limited communication.

animal behavior and cognition↗