Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2024.03.21.586134

Cross Modal Correspondence based MultisensoryIntegration: A pilot study showing how HAV cues can modulate the reaction time.

BANERJEE, S.
View original source ↗Export metadata ↓

Abstract

We live in a multisensory world, where all our senses work together for giving us a fulfilling experience of the environment that we are in or during our use of immersive technologies. For gaining more insight into the temporal scale understanding of the integration phenomenon EEG based BCI can give us the understanding of the transient changes in the brain. In this study, we investigated the potential of incorporating haptics into crossmodal correspondence based research to induce MSI effect through either the active touch users feedback or crossmodal correspondences with visual and auditory modalities, such as Kiki Bouba effect. We designed two experiments: O_LIVisual stimuli were presented on a standard computer monitor, and auditory stimuli were delivered through computer dynamics. Participants responded using left or right hand by pressing either CapsLock or Enter buttons respectively. Visual cue consisted of a red circle displayed randomly either on the left or on the right side of the screen. Auditory cue was a brief high tone presented through left or right headphones for 500 ms. Text stimuli that appeared on the screen instructed participants to respond with their left or right hand. Before each trial there was a fixation central cross displayed for 500 ms. C_LIO_LIThis experiment was inspired by previous studies on Kiki-Bouba correspondence. Visual stimuli consisted of 4 shapes - circle, triangle, polygon with 6 vertices, and star - presented on a computer screen. Locations of the visual stimuli were randomized. Auditory stimuli were generated using the Online Tone Generator website (https://onlinetonegenerator.com/). 2 sets of sounds were used: the first set included sine, triangle, square, and sawtooth waveforms, each at a frequency of 500 Hz; the second set included sawtooth waveforms at frequencies of 50 Hz, 300 Hz, 600 Hz, and 2000 Hz (summarised in Table 2). C_LI O_TBL View this table: org.highwire.dtl.DTLVardef@4b63fdorg.highwire.dtl.DTLVardef@191b6cborg.highwire.dtl.DTLVardef@177e6f4org.highwire.dtl.DTLVardef@dba414org.highwire.dtl.DTLVardef@1f13b3c_HPS_FORMAT_FIGEXP M_TBL O_FLOATNOTable 2:C_FLOATNO O_TABLECAPTIONVisual and auditory stimuli used in Experiment 2 C_TABLECAPTION C_TBL Results suggested that it is indeed possible to achieve this type of integration without relying on complex haptic devices. Introducing haptics into BCI technologies through feedback touch or crossmodal correspondances holds potential to improve the user experience and information transfer rate (ITR). Participants, as expected, showed the lowest reaction times in congruent sequential test and the highest - in incongruent HAV cues based test. This indicates the importance preference for sequential cue presentation over simultaneous one. The time was significantly higher in case of Incongruent Haptic cues.

Explore related subjects

animal behavior and cognitionPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

BANERJEE, S.. 2024-03-27. Cross Modal Correspondence based MultisensoryIntegration: A pilot study showing how HAV cues can modulate the reaction time.. https://doi.org/10.1101/2024.03.21.586134

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Who rests with whom? Sex composition and group demography shape resting associations in free-ranging dogs

Free-ranging dogs frequently rest near conspecifics, but the demographic factors structuring their resting associations remain poorly understood. We quantified dyadic resting associations in 26 free-ranging dog groups in West Bengal, India, observed between 2019 and 2023. Association strength was estimated from scan based resting co-occurrences using the Half-Weight Index. We tested whether dyadic association strength varied with dyad sex composition, dyad life stage composition, group size, and group sex ratio using a generalised additive model for location, scale and shape that accounted for group identity and repeated occurrence of individuals across dyads. Male-male dyads had lower association strengths than female-female dyads, whereas mixed-sex dyads did not differ from female-female dyads. Association strength decreased with increasing group size but increased as the male-to-female ratio within the group increased, while life-stage composition had no detectable effect. Individual level network metrics, including strength, reach, clustering coefficient, affinity, and eigenvector centrality, did not vary with sex or season. Mixed-sex pairs were also frequently represented among the strongest dyadic associations within groups. These findings indicate that resting associations in free-ranging dogs vary with dyad sex composition and group demography. Further opportunity-controlled analyses are required to determine whether the prominence of mixed-sex dyads reflects preferential association rather than group composition alone.

animal behavior and cognition↗
bioRxiv2026

Exploring rhythmic and melodic preferences in budgerigars: Individual and possible sex-related variation

Budgerigars (Melopsittacus undulatus) are vocal-learning birds with well-developed auditory abilities, but how they behaviorally evaluate melodic and rhythmic structure in sound sequences remains unclear. We examined whether budgerigars show preferences for these acoustic features and whether such preferences differ between the sexes. Three male and three female budgerigars were presented with four 8-s sound sequences in a preference apparatus: Simple (no pitch or temporal variation), Melody (pitch variation only), Rhythm (temporal variation only), and Complex (both pitch and temporal variation). Preference was quantified as the time spent in the area associated with each stimulus. No statistically significant differences among the four stimuli were detected within individuals. However, effect-size estimates indicated that two females spent more time with sequences containing rhythmic structure, whereas males showed no consistent preference related to either melodic or rhythmic components. Multidimensional scaling further suggested greater separation among stimulus conditions in females than in males. Consistent with this pattern, condition differentiation indices were higher in all three females than in all three males, although the sex difference was not statistically significant. These results suggest a possible sex-related difference in how budgerigars behaviorally weight temporal structure, with females showing greater differentiation among auditory sequence types under the present testing conditions.

animal behavior and cognition↗
bioRxiv2026

Copulation calls indicate fertility but do not reflect female mate competition in wild Guinea baboons

Across different modalities, signals play a core role in attracting mates and influencing mating success. In several non-human primate species, females produce calls during mating that are thought to promote male competition over receptive females. The extent to which social system characteristics modulate the function of copulation calls remains less clear. We studied copulation calls in wild Guinea baboons (Papio papio), who live in a multilevel society structured around units in which females associate and mate almost exclusively with a single male. We hypothesised that females use copulation calls as an indirect form of mate competition, with competition increasing in larger units. In addition, we hypothesised that females are more likely to mate again after calling. We analysed 6116 copulations between 2014 and 2025, involving 99 reproductively active females and 78 subadult and adult males. Females produced copulation calls in 72.7% of copulations, with large inter-individual variation. Neither unit size nor its interaction with the female's swelling size or the presence of simultaneously receptive females affected the probability of calling. A survival analysis with a subset of the data (2353 copulations) revealed no effect of calling on the latency to the next mating. Our results render the hypothesis that female Guinea baboons use calls in indirect mate competition unlikely. Yet, the probability of calling varied with sexual swelling size, suggesting that calls signal female fertility. Possibly, Guinea baboon copulation calls represent an evolutionary remnant, no longer under selective pressure, and can be considered index signals of female fertility.

animal behavior and cognition↗