Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2024.12.19.629427

Artificial Embodied Circuits Uncover Neural Architectures of Vertebrate Visuomotor Behaviors

Liu, X.·Loring, M. D.·Zunino, L.·Fouke, K. E.·Longchamp, F. A.·Bernardino, A.·Ijspeert, A. J.·Naumann, E. A.
View original source ↗Export metadata ↓

Abstract

All brains evolve within specific sensory and physical environments1. Traditionally, neuroscience has focused on studying neural circuits in isolation, yet holistic characterization of their function requires integrative brain-body testing2,3. To investigate the neural and biomechanical mechanisms of sensorimotor transformations, we constructed realistic neuromechanical simulations (simZFish) of the larval zebrafish optomotor response, a visual stabilization behavior4,5. By computationally reproducing the body, physical body-water interactions, visual environments, and experimentally derived neural architectures, we closely replicated the behavior of real zebrafish6. Through systematic manipulation of physiological and circuit features, impossible in biological experiments, we demonstrate how embodiment shapes neural circuit architecture and behavior. When challenged with novel visual stimuli, simZFish predicted neuronal response types, which we identified via calcium imaging in the brain of real zebrafish and used to update the simZFish neural network. In virtual rivers, simZFish performed rheotaxis by using current-induced optic flow as navigational cues, compensating for the simulated water flow. Finally, a physical robot (ZBot) validated the role of embodied sensorimotor circuits in maintaining position in a real river with complex fluid dynamics and visual environments. Together, by iterating between simulations, behavioral observations, neural imaging, and robotic testing, we demonstrate the power of an integrative approach to investigating sensorimotor processing. Research HighlightsO_LIDeveloped simZFish, an open-source neuromechanical simulation modeling the zebrafish optomotor response (OMR). C_LIO_LIDemonstrated that simZFish visuomotor neural circuits are sufficient to maintain position in virtual water currents without additional sensory modalities. C_LIO_LIInvestigated how variations in eye geometry influence neural circuit functionality and behavior. C_LIO_LIConducted optic flow analysis of simulated visual input to identify retinal connectivity requirements, uncovering the factors that shape pretectal neurons preference for the lower posterior visual field. C_LIO_LIsimZFish predicted new neural response types confirmed via real zebrafish calcium imaging. C_LIO_LIValidated simZFish circuits with a physical robot, ZBot, performing rheotaxis in a natural river with rich visual and complex flow dynamics compared to idealized lab and simulation experiments. C_LI O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=137 SRC="FIGDIR/small/629427v1_ufig1.gif" ALT="Figure 1"> View larger version (63K): org.highwire.dtl.DTLVardef@11f2acforg.highwire.dtl.DTLVardef@133b1f3org.highwire.dtl.DTLVardef@e808bcorg.highwire.dtl.DTLVardef@1959616_HPS_FORMAT_FIGEXP M_FIG C_FIG Graphical abstractCombining data-driven neuromechanical simulations and robotic testing, we established an integrative framework for investigating embodied neural circuit functions. Leveraging the behavioral, neurobiological, and theoretical foundations of the visually guided optomotor response in larval zebrafish (blue, left), we developed a virtual zebrafish, simZFish (red, middle), to replicate realistic hydrodynamic, anatomical, sensory, neural, and behavioral aspects, permitting the investigation of emergent properties driven by embodiment. Validating these findings using a physical, zebrafish-inspired robot, ZBot (grey, right), in naturalistic environments informs further experiments, hypotheses, and robotic design.

Explore related subjects

neurosciencePreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Liu, X., Loring, M. D., Zunino, L., Fouke, K. E., Longchamp, F. A., Bernardino, A., Ijspeert, A. J., Naumann, E. A.. 2024-12-20. Artificial Embodied Circuits Uncover Neural Architectures of Vertebrate Visuomotor Behaviors. https://doi.org/10.1101/2024.12.19.629427

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Connexin 40 deficiency alters the temporal profile of postictal oxygen dynamics following focal seizures.

Epilepsy is increasingly recognized as a disorder involving both neuronal and vascular dysfunction. While connexin signaling has been implicated in epileptogenesis, the contribution of vascular connexins to seizure associated cerebrovascular pathology remains poorly understood. Connexin40 (Cx40) is an endothelial gap junction protein that plays a crucial role in vascular communication and blood-flow regulation. Seizures induce dynamic changes in cerebral perfusion and oxygenation, including prolonged postictal hypoperfusion/hypoxia. To determine whether Cx40 influences postictal hypoxia following focal seizures, we examined seizure characteristics and postictal oxygen dynamics in Cx40 knockout (Cx40-/-) mice using an established focal hippocampal seizure model. Electrically kindled seizures were elicited in wild-type and Cx40-/- mice, and local hippocampal tissue oxygenation was continuously monitored before and after seizure induction. Seizure duration did not differ between genotypes, indicating comparable seizure severity. Interestingly, Cx40 deletion altered the temporal pattern of postictal oxygen recovery, producing greater early hypoxia and a delayed secondary rebound in pO2 despite similar peak oxygen levels and overall hypoxic burden. These findings demonstrate that loss of Cx40 selectively alters the temporal profile of postictal oxygen dynamics without affecting seizure duration. Taken together, the results suggest that endothelial gap junctional communication contributes to postictal vascular recovery and identify Cx40 as a potential modulator of seizure associated neurovascular dysfunction.

neuroscience↗
bioRxiv2026

Attention Across Scales: From Individual Variation to Social Hierarchies and Brain Networks in Semi-Free-Ranging Macaques

Attention is a fundamental brain function supporting perception, decision-making, and social behavior, and its dysfunction profoundly impairs daily life. It is both dynamic and stable, varying across observations and individuals, changing across the lifespan, and being shaped by social and environmental experience. Yet capturing this complexity remains a central challenge in neuroscience. Here, we integrated longitudinal behavioral assessments of semi-free-ranging macaques living in naturalistic social groups with resting-state fMRI. We quantified performance across days, ages, and social hierarchies and related it to intrinsic brain organization. Distinct attentional phenotypes emerged, including individuals with reduced attentional control. Performance followed an inverted-U lifespan trajectory, improving from childhood to adulthood before declining. Social status modulated attentional performance. Critically, nonlinear lifespan trajectories and associations with individual attentional differences were most clearly expressed in frontoparietal connectivity. Together, these findings reveal how sustained attention is organized across scales, providing a biological framework for its individual diversity, social modulation, and neural basis.

neuroscience↗
bioRxiv2026

Decoding natural scenes from patterned optogenetic responses in mouse visual cortex

A central challenge in developing visual cortical prostheses is to determine how visual stimuli should be transformed into effective patterns of cortical stimulation. Although advances in stimulation technologies, including optogenetics, provide increasingly precise control over cortical activity, it remains unclear whether artificially evoked activity can reproduce the information content of naturally evoked visual representations. Here we establish a quantitative framework for evaluating visual encoding strategies by decoding cortical responses evoked by natural vision and patterned optogenetic stimulation. We developed a novel dual-modal paradigm in awake mice to bridge the gap between endogenous photostimulation and artificial network driving. By co-expressing the high-performance calcium indicator GCaMP6s and the red-shifted, ultra-sensitive opsin rsChRmine-oScarlet in the primary visual cortex (V1), we successfully translated dynamic natural movie frames into patterned, spatiotemporal optogenetic stimulation. Quantitative comparisons of macro-scale dynamics demonstrated that this patterned optogenetic injection evokes cortical states highly comparable and representationally aligned with those driven by actual visual photostimulation. To systematically evaluate the fidelity of these responses, we developed STAR, a deep learning model featuring spatial and temporal attention mechanisms, and successfully reconstructed the frames of natural movies from V1 signals under both experimental modalities. Collectively, our results demonstrate that complex sensory information can be both naturally encoded and synthetically injected into V1 circuits with high decoding fidelity. This work provides an empirical and computational proof-of-concept for intelligent, closed-loop biomimetic encoders, establishing a robust framework for next-generation cortical visual neuroprostheses and bidirectional brain-machine interfaces.

neuroscience↗