Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2024.03.21.586134

Cross Modal Correspondence based MultisensoryIntegration: A pilot study showing how HAV cues can modulate the reaction time.

BANERJEE, S.
View original source ↗Export metadata ↓

Abstract

We live in a multisensory world, where all our senses work together for giving us a fulfilling experience of the environment that we are in or during our use of immersive technologies. For gaining more insight into the temporal scale understanding of the integration phenomenon EEG based BCI can give us the understanding of the transient changes in the brain. In this study, we investigated the potential of incorporating haptics into crossmodal correspondence based research to induce MSI effect through either the active touch users feedback or crossmodal correspondences with visual and auditory modalities, such as Kiki Bouba effect. We designed two experiments: O_LIVisual stimuli were presented on a standard computer monitor, and auditory stimuli were delivered through computer dynamics. Participants responded using left or right hand by pressing either CapsLock or Enter buttons respectively. Visual cue consisted of a red circle displayed randomly either on the left or on the right side of the screen. Auditory cue was a brief high tone presented through left or right headphones for 500 ms. Text stimuli that appeared on the screen instructed participants to respond with their left or right hand. Before each trial there was a fixation central cross displayed for 500 ms. C_LIO_LIThis experiment was inspired by previous studies on Kiki-Bouba correspondence. Visual stimuli consisted of 4 shapes - circle, triangle, polygon with 6 vertices, and star - presented on a computer screen. Locations of the visual stimuli were randomized. Auditory stimuli were generated using the Online Tone Generator website (https://onlinetonegenerator.com/). 2 sets of sounds were used: the first set included sine, triangle, square, and sawtooth waveforms, each at a frequency of 500 Hz; the second set included sawtooth waveforms at frequencies of 50 Hz, 300 Hz, 600 Hz, and 2000 Hz (summarised in Table 2). C_LI O_TBL View this table: org.highwire.dtl.DTLVardef@4b63fdorg.highwire.dtl.DTLVardef@191b6cborg.highwire.dtl.DTLVardef@177e6f4org.highwire.dtl.DTLVardef@dba414org.highwire.dtl.DTLVardef@1f13b3c_HPS_FORMAT_FIGEXP M_TBL O_FLOATNOTable 2:C_FLOATNO O_TABLECAPTIONVisual and auditory stimuli used in Experiment 2 C_TABLECAPTION C_TBL Results suggested that it is indeed possible to achieve this type of integration without relying on complex haptic devices. Introducing haptics into BCI technologies through feedback touch or crossmodal correspondances holds potential to improve the user experience and information transfer rate (ITR). Participants, as expected, showed the lowest reaction times in congruent sequential test and the highest - in incongruent HAV cues based test. This indicates the importance preference for sequential cue presentation over simultaneous one. The time was significantly higher in case of Incongruent Haptic cues.

Explore related subjects

animal behavior and cognitionPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

BANERJEE, S.. 2024-03-27. Cross Modal Correspondence based MultisensoryIntegration: A pilot study showing how HAV cues can modulate the reaction time.. https://doi.org/10.1101/2024.03.21.586134

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Deconstructing Boldness: Latent behavioural structure across novelty, predation, and exploration in an endangered species translocation program

Risk-related behaviours including neophobia, exploration, and predator avoidance are often assumed to covary along a general boldness axis. Although some translocation studies have linked one or more of these behaviours with fitness, it is possible that the underlying behavioural structure varies under different selective environments. Conservation breeding programs provide a unique opportunity to evaluate the structure of behavioural correlations in a non-domestic species under artificial conditions. We tested whether risk-related behaviours represent a unified boldness syndrome in a captive population of the endangered Attwaters prairie chicken (APC; Tympanuchus cupido attwateri). We quantified the repeatable behaviours of 257 juveniles and compared 11 models of behavioural covariation structure using multivariate mixed models and confirmatory factor analysis. There was no support for a single risk-taking axis; instead, we found three dimensions representing responses to novelty and environmental stimuli (Engagement), predator avoidance (Threat Response), and maze exploration (Maze Progression). Our results indicate that these risk-related behaviours are not organized along a single axis in captive APCs, challenging assumptions that risk-taking represents a universal behavioural syndrome. To anticipate post-release success accurately, conservation managers should understand the exact behavioural architecture of the captive population rather than assume that the classical bold-shy structure occurs in all contexts.

animal behavior and cognition↗
bioRxiv2026

Shared brain transcriptome signatures of social evolution and plasticity in shell-dwelling cichlid fishes

Inter-individual variability in phenotypic traits is widespread in nature both across and within species, with similar patterns of variation often occurring between and within species. Given that these two types of variation are generated by evolutionary and plasticity processes respectively, it raises the question to what extent the causal mechanisms underlying such variability at these two different levels are shared or not. To address this question, we studied the variation in brain transcriptomes in Tanganyikan cichlids that exhibit both intra- and interspecific variation in social behavior. We compared two facultatively social cichlid species, each containing naturally occurring solitary and social-living individuals, with a closely related obligatory solitary resembling the ancestral state. Differential gene expression and Gene Set Enrichment Analyses were performed in the telencephalon and diencephalon transcriptomes to investigate the molecular basis of both behavioral plasticity and the evolution of sociality. Behavioral plasticity involved few differentially expressed genes but extensive changes in biological pathways, supporting a highly polygenic architecture of social behavior. Across both species, social-living individuals consistently upregulated pathways involved in translation, protein homeostasis, and energy metabolism, whereas solitary individuals showed enrichment of neuronal morphogenesis, cell adhesion, and structural plasticity. Remarkably, these same functional programs were associated with the independent evolution of sociality, revealing a strong overlap between evolutionary and plastic transcriptional responses. This convergence was largely restricted to the telencephalon, while the diencephalon showed limited and inconsistent functional signatures. Together, our results support the repeated recruitment of gene regulatory programs during the evolution of sociality and demonstrate that behavioral plasticity and evolutionary transitions share common neurogenomic responses, consistent with a conserved genetic toolkit for social behavior.

animal behavior and cognition↗
bioRxiv2026

Inductive bias anchors a scaling law for biological learning

The speed of animal learning varies substantially across individuals and task domains, and does not always track intuitive notions of task complexity. A nominally simple binary decision task can take thousands of rewards to reach proficiency, whereas seemingly complex naturalistic tasks can be learned within dozens. A long-standing explanation is that learning speed reflects the alignment between an animal's inductive biases and the task at hand. However, without a precise notion of alignment, it is difficult to translate this idea into quantitative predictions. Here, modeling an animal as a Bayesian learner that improves through iterative reward feedback, we use statistical learning theory to derive a scaling law for biological learning. The law makes two predictions. First, inductive bias multiplicatively sets the speed of learning through a single quantity, the effective complexity. This quantity measures how well the task aligns with the animal's prior, and corresponds to the number of bits required to represent the task solution under that prior. We demonstrate this multiplicative scaling in a human motor learning dataset, where behavioral measurements before learning can precisely predict subsequent learning speed. Second, task performance improves as a power law in experience. We validate this power law in a large-scale mouse learning dataset and show that a two-parameter rescaling collapses individual learning curves onto a universal function predicted by the theory. These results suggest that behavioral measurements before learning can be used to predict task-dependent learning speeds, and they explain why learning speed reflects alignment with prior knowledge rather than nominal task complexity.

animal behavior and cognition↗