Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2024.12.19.629427

Artificial Embodied Circuits Uncover Neural Architectures of Vertebrate Visuomotor Behaviors

Liu, X.·Loring, M. D.·Zunino, L.·Fouke, K. E.·Longchamp, F. A.·Bernardino, A.·Ijspeert, A. J.·Naumann, E. A.
View original source ↗Export metadata ↓

Abstract

All brains evolve within specific sensory and physical environments1. Traditionally, neuroscience has focused on studying neural circuits in isolation, yet holistic characterization of their function requires integrative brain-body testing2,3. To investigate the neural and biomechanical mechanisms of sensorimotor transformations, we constructed realistic neuromechanical simulations (simZFish) of the larval zebrafish optomotor response, a visual stabilization behavior4,5. By computationally reproducing the body, physical body-water interactions, visual environments, and experimentally derived neural architectures, we closely replicated the behavior of real zebrafish6. Through systematic manipulation of physiological and circuit features, impossible in biological experiments, we demonstrate how embodiment shapes neural circuit architecture and behavior. When challenged with novel visual stimuli, simZFish predicted neuronal response types, which we identified via calcium imaging in the brain of real zebrafish and used to update the simZFish neural network. In virtual rivers, simZFish performed rheotaxis by using current-induced optic flow as navigational cues, compensating for the simulated water flow. Finally, a physical robot (ZBot) validated the role of embodied sensorimotor circuits in maintaining position in a real river with complex fluid dynamics and visual environments. Together, by iterating between simulations, behavioral observations, neural imaging, and robotic testing, we demonstrate the power of an integrative approach to investigating sensorimotor processing. Research HighlightsO_LIDeveloped simZFish, an open-source neuromechanical simulation modeling the zebrafish optomotor response (OMR). C_LIO_LIDemonstrated that simZFish visuomotor neural circuits are sufficient to maintain position in virtual water currents without additional sensory modalities. C_LIO_LIInvestigated how variations in eye geometry influence neural circuit functionality and behavior. C_LIO_LIConducted optic flow analysis of simulated visual input to identify retinal connectivity requirements, uncovering the factors that shape pretectal neurons preference for the lower posterior visual field. C_LIO_LIsimZFish predicted new neural response types confirmed via real zebrafish calcium imaging. C_LIO_LIValidated simZFish circuits with a physical robot, ZBot, performing rheotaxis in a natural river with rich visual and complex flow dynamics compared to idealized lab and simulation experiments. C_LI O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=137 SRC="FIGDIR/small/629427v1_ufig1.gif" ALT="Figure 1"> View larger version (63K): org.highwire.dtl.DTLVardef@11f2acforg.highwire.dtl.DTLVardef@133b1f3org.highwire.dtl.DTLVardef@e808bcorg.highwire.dtl.DTLVardef@1959616_HPS_FORMAT_FIGEXP M_FIG C_FIG Graphical abstractCombining data-driven neuromechanical simulations and robotic testing, we established an integrative framework for investigating embodied neural circuit functions. Leveraging the behavioral, neurobiological, and theoretical foundations of the visually guided optomotor response in larval zebrafish (blue, left), we developed a virtual zebrafish, simZFish (red, middle), to replicate realistic hydrodynamic, anatomical, sensory, neural, and behavioral aspects, permitting the investigation of emergent properties driven by embodiment. Validating these findings using a physical, zebrafish-inspired robot, ZBot (grey, right), in naturalistic environments informs further experiments, hypotheses, and robotic design.

Explore related subjects

neurosciencePreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Liu, X., Loring, M. D., Zunino, L., Fouke, K. E., Longchamp, F. A., Bernardino, A., Ijspeert, A. J., Naumann, E. A.. 2024-12-20. Artificial Embodied Circuits Uncover Neural Architectures of Vertebrate Visuomotor Behaviors. https://doi.org/10.1101/2024.12.19.629427

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Same Movements, Different Skills: How Context Shapes Learning in Humans and Neural Networks

What determines whether experiences are integrated into shared representations or split? Motor skill learning offers a revealing test: when two tasks require an identical sequence of movements, both intuition and theory suggest that practice in one should generalize to the other. Yet we find that changing context can make identical movements different skills. In simple recurrent networks trained on the same sequence across contexts, splitting was greatest when strong contextual inputs coincided with a high initial weight scale; neither alone sufficed. Greater representational separation coincided with separate context-specific learning curves. Humans practicing the same finger sequence while alternating between two performance-irrelevant contexts likewise exhibited context-specific curves, rather than the single continuous trajectory observed when practicing in a single context. State-space modeling favored split learning states in humans and very weakly coupled states in the most context-dependent networks. These findings have broader implications for understanding how learning generalizes across contexts.

neuroscience↗
bioRxiv2026

Postpartum resource scarcity reshapes maternal care, offspring prioritization, and the steroid-sensitive medial preoptic area

Parental care requires balancing offspring needs with environmental constraints, yet how resource scarcity alters the organization of maternal responses remains poorly understood. Here, we examined maternal behavior, offspring prioritization, and steroid receptor-associated extracellular matrix organization in postpartum rats exposed to limited bedding and nesting (LBN) or control conditions with ample nesting materials. LBN increased pup-directed and reduced self-directed behaviors but also increased behavioral entropy, a measure of behavioral fragmentation, indicating less predictable caregiving sequences. LBN dams preferentially retrieved male pups first, whereas control dams preferentially retrieved females first. LBN also increased the proportion of pup-investigation time directed toward males compared with controls. In offspring on postnatal day 10, corticosterone was elevated in female but not male LBN pups, a pattern that paralleled the maternal male bias. To identify associated neurobiological changes, we assessed steroid receptors and extracellular matrix organization in the medial preoptic area (mPOA), a key region for maternal behavior. LBN increased numbers of estrogen receptor (ER)- and androgen receptor (AR)-immunoreactive cells, reduced perineuronal net (PNN) abundance, and decreased receptor-positive cell enwrapment. Because PNNs constrain structural plasticity, these findings suggest that the postpartum environment alters the organization of steroid receptor-associated extracellular matrix, potentially modulating experience-dependent plasticity in neurosteroid-sensitive circuits. In sum, LBN increases the levels of maternal engagement while reshaping its temporal organization and allocation, accompanied by selective remodeling of steroid-sensitive preoptic architecture. Therefore, maternal adaptation to adversity may be better understood as changes in caregiving allocation strategies rather than a simple gain or loss of maternal care.

neuroscience↗
bioRxiv2026

The Computational Grammar of Human Behaviour in a Biological Environment

Human behaviour unfolds as an extended stream of spontaneous actions shaped by environmental demands and the agent's goals. The organisation of these actions, situated between setting abstract goals and concrete movement execution, remains poorly characterised. Here, we introduce DynaClade, an unsupervised temporal action segmentation algorithm for human full-body motion capture data, and apply it to freely moving participants navigating ecologically realistic risky foraging environments in virtual reality. DynaClade identifies discrete actions whose kinematic characteristics and spatial distributions correspond to environmental affordances, supporting the validity of the approach. Among these actions, we discovered a hitherto undescribed movement pattern defined by increased body sway without locomotion. Action sequences were highly non-random and showed clear history dependence beyond first-order Markov structure, most of which was explained by a second-order prediction. This higher-order structure was well captured in a hidden Markov model, in which some of the observed actions were associated with more than one latent state. Each of these latent states corresponded to the same action in a distinct action context. These findings suggest that spontaneous human actions are predominantly selected based on the current action and context, rather than following pre-planned or habitually assembled sequences.

neuroscience↗