Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.64898/2026.06.03.729954

Multisensory Continuous Psychophysics: Perceived Visual Object Location is Improved by Auditory Cues

Jörges, B.·Kim, J.-J.·Harris, L. R.
View original source ↗Export metadata ↓

Abstract

Continuous Psychophysics, which couples a continuous stimulus with a continuous response, is a promising tool to break out of the confines of traditional designs based on discrete trials. In this pre-registered study, we explore to what extent this paradigm is useful in the study of multisensory integration. We expand on Tonelli et al.s (2025) seminal study by additionally examining the role of eye-movements, using a Kalman filter to estimate the sensory noise underlying behavioral tracking parameters and employing a virtual reality set-up. We immersed two cohorts of participants (n = 30 each) in a virtual meadow environment and asked them to continuously track a drone (Experiment 1) or a swarm of flies (Experiment 2) with a controller, while simultaneously recording their eye movements. We manipulated the reliability of visual cues using four levels of fog (from a completely clear view to impenetrable fog where no visual cues to the targets position were available) as well as the presence of sound cues emitted from the object (sound present/absent). The maximum correlation between stimulus and response was higher when sound was present in some conditions, particularly when visual uncertainty was high, while the tracking delay remained unaffected across all fog levels. Using a Kalman filter to estimate the underlying sensory noise, we found strong evidence that sensory noise was lower when sound was present than when sound was absent both for manual and for ocular tracking, particularly for those conditions with higher visual uncertainty. In exploratory analyses, we further show strong correlations between manual and ocular tracking in all measures (maximum correlation, tracking delay, sensory precision). However, when isolating the multisensory advantage, these correlations all but disappeared for maximum correlation and tracking delay, while remaining substantial for sensory precision. Similarly, behavioral tracking correlated generally strongly with underlying sensory noise, but much less so when it came to the advantage conferred by added sound cues. Our results show that continuous psychophysics is well-suited for the study of multisensory integration, particularly when a Kalman filter analysis is used to estimate sensory uncertainty from behavioral data.

Explore related subjects

animal behavior and cognitionPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Jörges, B., Kim, J.-J., Harris, L. R.. 2026-06-08. Multisensory Continuous Psychophysics: Perceived Visual Object Location is Improved by Auditory Cues. https://doi.org/10.64898/2026.06.03.729954

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

roostR: An R package to examine diel activity patterns from Motus radio telemetry data

1. Monitoring the diel activity patterns of free-living animals is a methodological challenge. Signal strength fluctuations from Very High Frequency (VHF) radio transmitters deployed within the Motus Wildlife Tracking System can be used as a proxy for activity. However, analytical tools to extract behavioral metrics that quantify activity patterns from these data are needed. 2. We developed roostR, an open-source R package that converts Motus detection data into quantitative behavioral metrics, including roost initiation and departure, roost duration, observation time, and restlessness. The package uses a sequential pipeline built around signal volatility and rolling medians to detect transitions between active and inactive states. Default parameter values were tuned using data from 55 dark-eyed juncos (Junco hyemalis) overwintering in southeastern Ohio. 3. We provide an example from a dark-eyed junco over a 58-day period. roostR estimated roost onset on 48 nights and departure on 56 mornings, with higher rolling median signal differences during the day than at night, consistent with a diurnal animal, and variable restlessness periods each night. We also used the package to estimate roost behavior of an American tree sparrow (Spizelloides arborea) over 43-nights. 4. roostR enables researchers to extract individual activity data from Motus datasets. Because all thresholds are user-adjustable, the pipeline is adaptable across species, tag specifications, and ecological contexts, enabling researchers to test hypotheses about how environmental factors influence diel activity patterns.

animal behavior and cognition↗
bioRxiv2026

Characterizing rhythmic wheel-turning behavioral patterns in cockroaches Rhyparobia maderae using machine learning

Organisms must adapt to environmental changes occurring across multiple time scales, with endogenous multiscale clocks coordinating physiology and behavior with recurring environmental rhythms, including the dominant 24-hour cycle and faster ultradian rhythms. The Madeira cockroach (Rhyparobia maderae) provides a suitable model for investigating such multiscale temporal organization. Here, locomotor activity was recorded in running-wheel experiments under constant darkness. While the endogenous circadian clock produces a clearly visible 24-hour rhythm, it remains unknown whether locomotor behavior also exhibits temporal patterns at additional time scales. These temporal patterns cannot be found by classical frequency analysis, as they are veiled by higher harmonics of the circadian rhythm which are in the same frequency range. Unsupervised machine learning methods such as K-Means clustering, self-organizing maps and Gaussian mixture are used in search for fast ultradian rhythms possibly linked to circadian cycles in locomotor activity. Prior to applying these methods, data metrics are defined which characterize bouts of activity (called activity impulses) compared to periods of reduced activity. A stochastic pattern was found in these activity metrics which characterizes the time distance between activity impulses. Across all approaches, a consistent ultradian rhythm of approximately one hour was identified in the timing of the activity maxima. This rhythm was mainly detected during the subjective night, suggesting circadian control, and appears to consist of two components with periods of approximately 40 minutes and 1.5 hours. The method proposed in this paper is applied to two cockroach groups with different levels of activity, and is generalizable to diverse datasets occurring in the form of a time series with a dominant rhythm.

animal behavior and cognition↗
bioRxiv2026

Social inequity aversion and fairness preference in polar bears

Decision-making is key to survival, with choices and behaviour typically shaped by evolutionary pressures to enhance fitness and minimize loss. Inequity aversion, the tendency to respond negatively to unequal reward distributions, is therefore unexpected, as acts of fairness may be costly to the individual in the short term. In social, cooperative species, however, fairness may enhance long-term benefits through stable social interactions. Inequity aversion is believed to promote cooperative social structures and has only been demonstrated in certain social species. Yet, solitary species have not been tested, and whether this behaviour depends on social cooperative structures is unknown. Examining solitary species could clarify whether inequity aversion reflects an adaptation to cooperation or a general cognitive capacity linked to social comparison and reward evaluation. We studied inequity aversion in polar bears (Ursus maritimus), a largely solitary species, using three complementary, non-invasive cognition tests on seven bears from two zoos in the Netherlands. (1) An impunity experiment assessing effort-based inequity, in which bears performed a standardized action to obtain food rewards. (2) A choice-based experiment testing active selection between equal and unequal reward distributions. (3) A no-task control experiment assessing responses to unequal reward distribution without effort. Under effort-based inequity, bears reduced task performance and increased task latency when a partner received a superior reward. Unequal reward distributions did not affect reward acceptance independent of effort. In the choice-based paradigm, bears preferentially selected equal reward distributions with a partner present. Although generalizability to wild populations is limited, these findings demonstrate behavioural aversion of social inequity in a non-cooperative species. Inequality aversion may therefore not be restricted to social, cooperative animals but instead reflect a broadly distributed cognitive mechanism that emerges under relevant social conditions. These findings challenge current theories and advance our understanding of the cognitive foundations of fairness-related behaviour in animals.

animal behavior and cognition↗