Search bioRxiv⌕ Search

Biology subjects

Shimojo, S.

Publications and source records attributed to Shimojo, S..

13 recordsLinked to original sources

Seeing Through Touch: Visual Reliability Shapes Tactile Guidance in 360° Virtual Reality

This study characterizes how people combine visual and tactile directional cues while acting in a fully immersive 360{degrees} virtual environment. Participants used a vibrotactile belt and VR headset to localize targets while we manipulated visual reliability and the spatial discrepancy between visual and tactile signals. Behaviorally, degraded visual input made visual responses slower, less precise, and more susceptible to tactile pull, whereas tactile-guided responses remained comparatively stable. We then asked whether these behavioral changes reflected a change in multisensory binding or a change in sensory uncertainty. A Bayesian Causal Inference (BCI) framework captured the structure of behavior under high visual reliability and continued to track individual differences under low visual reliability, even though its absolute goodness-of-fit decreased. Under extreme visual noise, Bayesian Information Criterion sometimes favored a simpler Maximum Likelihood Estimation (MLE) model, but MLE showed poor absolute fit and did not capture meaningful behavioral variability. This dissociation shows that statistical parsimony and explanatory validity can diverge when behavior becomes highly variable. BCI-derived parameters further indicated that degraded vision increased visual uncertainty, while the prior tendency to bind visual and tactile cues remained stable. Kinematic analyses added a complementary insight: early movement trajectories were strongly shaped by tactile signals, even when final localization was visually guided. Together, these findings suggest that visual-tactile integration in 360{degrees} environments depends on sensory reliability and task demands, with tactile cues providing fast body-centered guidance when visual information is limited.

neuroscience↗

Multitasking boosts muscular endurance task performance due to elevated arousal level unattainable by the endurance task alone

Multitasking is generally regarded as detrimental to performance. This deterioration effect is typically explained by the interference among tasks due to the limited capacity of information-processing resources, which in turn reduces the performance in each task. Contrary to this general view, we report evidence for a facilitation effect of multitasking on performance. This facilitation effect was observed in multitasking on a handgrip muscular endurance task and cognitive task, which are known to have little interference with each other. Specifically, we found that performance in the endurance task was facilitated with the difficulty of the concurrent cognitive task. This facilitation effect was mediated by additional pupil dilation due to the cognitive task. Increased effort with the difficulty of the cognitive task cannot explain the facilitated performance in the irrelevant endurance task. Instead, they suggest that the cognitive task elevated overall arousal to a level unattainable by the endurance task alone, which in turn facilitated performance in the irrelevant endurance task. To further test this arousal account, we manipulated participants motivation to the cognitive task by reward without changing its difficulty and found the same pattern of results. Thus, it is not effort or motivation specific to the cognitive task but rather overall arousal level that underlies the facilitation effect. These results unveiled a previously overlooked mechanism: a multitasking-induced arousal boost. Our findings suggest that multitasking can facilitate performance when the net effect of adding a concurrent task is governed less by the capacity limitation and more by the elevation of overall arousal.

neuroscience↗

Did you see the sound? A Bayesian Perspective on Crossmodal Perception in Low Vision

Multisensory integration is often assumed to increase when visual input is degraded, yet it re-mains unclear whether low vision enhances susceptibility to cross-modal illusions or whether such effects depend on local variations in visual reliability. We tested low vision and sighted control participants on the Double Flash Illusion across 24 visual-field locations while sepa-rately measuring flash-detection accuracy. Both groups showed the expected auditory-driven increase in perceived flash numerosity, but only sighted controls reliably experienced the clas-sic "double-flash" percept. Illusion strength did not vary with eccentricity; instead, it was strongly predicted by local flash detection accuracy, indicating that sound-induced percepts depend on the availability of a reliable visual signal. Bayesian Causal Inference modeling revealed substantially weaker and more variable fits for low vision observers, with poorer fits associated with reduced visual sensitivity. Although model parameters did not differ significantly between groups, the similarity in estimated visual noise likely reflects model limitations rather than true equivalence in sensory precision. Together, these findings show that low vision does not globally amplify audiovisual interactions; rather, auditory enhance-ment depends on local visual reliability, and degraded vision leads to weaker alignment with Bayesian-optimal predictions.

neuroscience↗

Filling-in of the Blindspot is Multisensory

We asked three questions about multisensory perception across the physiological blind spot: (1) Does audiovisual integration persist without bottom-up visual input? (2) Does the brain adjust its sensory uncertainties and priors accordingly? (3) Are the underlying causal-inference computations preserved? Participants judged flashes and beeps in an audiovisual illusion presented across the blind spot or a matched control location. Responses were fit with a Bayesian Causal Inference (BCI) model, estimating sensory noise, numerosity priors, and causal-inference priors under multiple decision strategies evaluated using BIC. Illusions were robust at both locations, indicating preserved integration. Model fits showed higher visual uncertainty and broader prior expectations at the blind spot, while auditory precision and the causal prior remained stable. Thus, the computational architecture of causal inference is maintained, but its parameters flexibly adapt to local sensory reliability. These findings demonstrate that perceptual inference remains intact even in regions without retinal input, achieved by adjusting internal uncertainty rather than altering core multisensory computations.

neuroscience↗

"Magnetic Sand" : Illusions of Interactivity

We found a series of new illusions, in which actions performed near a random white-noise display lead to the perception that the display is altered interactively with the observers actions. The perceptions resemble interactions with a box of magnetic sand, where the hand can leave traces, or attract and repulse grains in its vicinity. 1) the observer puts a finger very close to a dynamic noise display, slowly moving as though drawing a letter or a shape. A trace appears left in the fingers path, decaying within 500 ms or so. 2) When the observer moves their palm toward and away from the display, opening and closing their fingers as if grabbing and releasing grains of sand, the random dots appear as though they were magnetically attracted to or repelled by the fingers. 3) When an open hand close to the display is slowly moved back and forth laterally, the nearby dots appear to get attracted to or captured by the fingers and thus appear to move with them. 4) The same kind of action capture occurs even when the hand is not visible, moving behind the display. These illusions are robust across a wide range of parameters, including frame rate, luminance contrast, dot size (spatial frequency), and finger movement factors. Inter-subject variability is not correlated across illusion types, and the illusions also diverge in behavior across dynamic and static noise conditions. This indicates that multiple mechanisms are involved to different extents across illusions. Several known visual motion detectors and other low-level mechanisms may be involved in seeding the perceptual phenomena. However, a complete explanation would require mechanisms of action capture, whereby the internal model of the persons actions and their predicted consequences organizes visual attention and processing of the random stimulus components.

neuroscience↗

Method for Spatially Confined Stimulation by Retinal Scanning Displays: Are Blind Spots Really Blind?

Conventional displays, such as CRTs and LCDs, are commonly used to present and manipulate visual stimuli in many vision science studies. However, such displays pose difficulties when the goal is to constrain stimulation to specific retinal locations, so as to isolate their contribution to downstream effects. Scattered and refracted light can stimulate unintended areas, contaminating the outcomes. In this investigation, we evaluate a laser-based retinal scanning display for its ability to map and exclusively stimulate the retinal blind spot. This application stimulates melanopsin receptors inside the blind spot, separately from rod and cone photoreceptors, which lie outside the blind spot. This paper covers three experiments: 1. The initial exploratory observations; 2. the examination of pupillary responses, and; 3. the inference of implicit visual perception arising from the blind spot. We aimed to simultaneously validate our technical methods, while increasing our understanding of the role of melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs) in vision and implicit visual perception.

neuroscience↗

Practice makes imperfect: stronger implicit interference with practice in individuals at high risk of developing Alzheimer's disease

Early screening to determine patient risk of developing Alzheimers will allow better interventions and planning but necessitates accessible methods such as behavioral biomarkers. Previously, we showed that cognitively healthy older individuals whose cerebrospinal fluid amyloid / tau ratio indicates high risk of cognitive decline experienced implicit interference during a high-effort task, signaling early changes in attention. To further investigate attentions effect on implicit interference, we analyzed two experiments completed sequentially by the same high- and low-risk individuals. We hypothesized that if attention modulates interference, practice would affect the influence of implicit distractors. Indeed, while both groups experienced a strong practice effect, the association between practice and interference effects diverged between groups: stronger practice effects correlated with more implicit interference in high-risk participants, but less interference in low-risk individuals. Furthermore, low-risk individuals showed a positive correlation between implicit interference and EEG low-range alpha event-related desynchronization when switching from high-to low-load tasks. These results demonstrate how attention impacts implicit interference and highlight early differences in cognition between high- and low-risk individuals.

neuroscience↗

Preservation of Conditioned Behavior Based on UV Light Sensitivity in Dissected Tail Halves of Planarians- a Proof by DNN

Planarians are aquatic worms with powerful regenerative and memory retention abilities. This paper examines whether a dissected tail half of a Planarian (Dugesia Dorotocephala) can retain and exhibit a previously-conditioned response, possibly before the regeneration of the head and the ganglia. We conditioned intact Planarians in a Pavlovian procedure with an electric shock (ES) as the unconditioned stimulus and weak ultraviolet (UV) light as the conditioned stimulus. Then, we dissected their bodies into halves, keeping the dissected tail halves. Starting from the 2nd day after dissection, we presented the same UV light 3 times daily while video-recording the responses. The recorded responses were then classified by a DNN: a VGG16 model was pre-trained by ImageNet for extracting features from images and additionally trained with 211 responses to ES and 118 to UV light before conditioning/dissection to categorize planarians reactions into "UV-induced" or "ES-induced" reactions. The cross-validated accuracy in categorization was 83.6%. We then let the DNN analyze 99 recorded responses to UV from 20 individual conditioned tail halves. 96.8 % of their reactions were classified as "ES-induced" (against 22.0% wrongly classified as "ES-induced" for unconditioned samples under UV), indicating they have shown the "Conditioned Response" (p<3.06E-30). This provides evidence that planarians can conserve and reveal a learned response even without the head/ganglia, as it takes approximately 7 days for the head/ganglia to regenerate versus the given 2-3 days. Although similar findings have been reported repeatedly in the literature, this is the first positive evidence with automated procedures and DNN classification. The result implies the presence of a decentralized nervous structure outside of its head/ganglia that allows a tail half to retain memory and execute motion accordingly, despite their cephalization.

animal behavior and cognition↗

The Brain Knows enough to take into account Light and Shadow

Visual perception requires to infer object and light source color to maintain constancy. This study demonstrates the influences of environmental sunlight color trajectory (blue-white-yellow-red), and associated color of scattered light in shadows on color perception. In Adelsons checkerboard shadow illusion, squares of equal luminance appear lighter or darker depending on whether they are inside or outside a cast shadow1. In some color variations, illusion magnitude is attenuated by specific colors of the cast shadow. Particularly in the green monotone environment (green checkerboard under green ambient and diffusion light), illusion magnitude reduces down nearly to zero. In contrast, shading by structure is not affected by the color environment. Thus, the cast shadow and shading by structure have distinct effects on surface color constancy. This illusion attenuation may be related to the absence of green in the natural environmental light spectrum, including in cast shadows. The brain may utilize the implicit learned trajectory of natural light to resolve ambiguity in surface reflectance. Our results provide a new formula not only to understand, but also to generate new variations of other illusions such as #The Dress.

neuroscience↗

Team flow is a unique brain state associated with enhanced information integration and neural synchrony

Team flow occurs when a group of people reaches high task engagement while sharing a common goal as in sports teams and music bands. While team flow is a superior enjoyable experience to individuals experiencing flow or regular socialization, the neural basis for such superiority is still unclear. Here, we addressed this question utilizing a music rhythm task and electroencephalogram hyper-scanning. Experimental manipulations held the motor task constant while disrupted the hedonic musical correspondence to blocking flow or occluded the partners body and task feedback to block social interaction. The manipulations effectiveness was confirmed using psychometric ratings and an objective measure for the depth of flow experience through the inhibition of the auditory-evoked potential to a task-irrelevant stimulus. Spectral power analysis revealed higher beta/gamma power specific to team flow at the left temporal cortex. Causal interaction analysis revealed that the left temporal cortex receives information from areas encoding individual flow or socialization. The left temporal cortex was also significantly involved in integrated information at both the intra- and inter-brains levels. Moreover, team flow resulted in enhanced global inter-brain integrated information and neural synchrony. Thus, our report presents neural evidence that team flow results in a distinct brain state and suggests a neurocognitive mechanism by which the brain creates this unique experience. Data AvailabilityAll data and analysis codes used in the preparation of this article are available at https://osf.io/3b4hp.

neuroscience↗

Causally Linking Neural Dominance to Perceptual Dominance in a Multisensory Conflict

When different senses are in conflict, one sense may dominate the perception of other sense, but it is not known whether the sensory cortex associated with the dominant modality exerts directional influence, at the functional brain level, over the sensory cortex associated with the dominated modality; in short, the link between sensory dominance and neuronal dominance is not established. In a task involving audio-visual conflict, using magnetoencephalography recordings in humans, we first demonstrated that the neuronal dominance - visual cortex being functionally influenced by the auditory cortex - was associated with the sensory dominance - participants visual perception being qualitatively altered by sound. Further, we found that prestimulus auditory-to-visual connectivity could predict the perceptual outcome on a trial-by-trial basis. Subsequently, we performed an effective connectivity-guided neurofeedback electroencephalography experiment and showed that participants who were briefly trained to increase the neuronal dominance from auditory to visual cortex also showed higher sensory, i.e. auditory, dominance during the conflict task immediately after the training. The results shed new light into the interactive neuronal nature of multisensory integration and open up exciting opportunities by enhancing or suppressing targeted mental functions subserved by effective connectivity.

neuroscience↗

Transient Pupil Constriction Reflects and Affects Facial Attractiveness

Contrary to the long-held belief of a close linkage between pupil dilation and attractiveness, we found an early and transient pupil constriction response when participants viewed an attractive face (and the effect of luminance/contrast is controlled). While human participants were making an attractiveness judgment on faces, their pupil constricted more for the more attractive (as-to-be-rated) faces. Further experiments showed that the effect of pupil constriction to attractiveness judgment extended to intrinsically aesthetic visual objects such as natural scene images (as well as faces) but not to line-drawing geometric figures. When participants were asked to judge the roundness of faces, pupil constriction still correlated with their attractiveness but not the roundness rating score, indicating the automaticity of the pupil constriction to attractiveness. When pupillary responses were manipulated implicitly by relative background luminance changes (from the pre-stimulus screen), the facial attractiveness ratings were in accordance with the amount of pupil constriction, which could not be explained solely by simultaneous or sequential luminance contrast. The overall results suggest that pupil constriction not only reflects but, as a part of self-monitoring and attribution mechanisms, also possibly contributes facial attractiveness implicitly.

neuroscience↗

Transduction of the Geomagnetic Field as Evidenced from Alpha-band Activity in the Human Brain

Magnetoreception, the perception of the geomagnetic field, is a sensory modality well-established across all major groups of vertebrates and some invertebrates, but its presence in humans has been tested rarely, yielding inconclusive results. We report here a strong, specific human brain response to ecologically-relevant rotations of Earth-strength magnetic fields. Following geomagnetic stimulation, a drop in amplitude of EEG alpha oscillations (8-13 Hz) occurred in a repeatable manner. Termed alpha event-related desynchronization (alpha-ERD), such a response is associated with sensory and cognitive processing of external stimuli. Biophysical tests showed that the neural response was sensitive to the dynamic components and axial alignment of the field but also to the static components and polarity of the field. This pattern of results implicates ferromagnetism as the biophysical basis for the sensory transduction and provides a basis to start the behavioral exploration of human magnetoreception.

biophysics↗