Search bioRxiv⌕ Search

Biology subjects

Lazzari, J.

Publications and source records attributed to Lazzari, J..

2 recordsLinked to original sources

Multitasking Recurrent Networks Utilize CompositionalStrategies for Control of Movement

The brain and body comprise a complex control system that can flexibly perform a diverse range of movements. Despite the high-dimensionality of the musculoskeletal system, both humans and other species are able to quickly adapt their existing repertoire of actions to novel settings. A strategy likely employed by the brain to accomplish such a feat is known as compositionality, or the ability to combine learned computational primitives to perform novel tasks. Previous works have demonstrated that recurrent neural networks (RNNs) are a useful tool to probe compositionality during diverse cognitive tasks. However, the attractor-based computations required for cognition are largely distinct from those required for the generation of movement, and it is unclear whether and how compositional structure extends to RNNs producing complex movements. To address this question, we train a multitasking RNN in feedback with a musculoskeletal arm model to perform ten distinct types of movements at various speeds and directions, using visual and proprioceptive feedback. The trained network expresses two complementary forms of composition: an algebraic organization that groups tasks by kinematic and rotational structure to enable the flexible creation of novel tasks, and a sequential strategy that stitches learned extension and retraction motifs to produce new compound movements. Across tasks, population activity occupied a shared, low-dimensional manifold, whereas activity across task epochs resides in orthogonal subspaces, indicating a principled separation of computations. Models that perform multitasking without the use of feedback or embodiment struggle to form compositional representations, suggesting these mechanisms constrain the network solution space during training. Finally, we demonstrate rapid transfer to held-out movements via simple input weight updates, as well as the generation of target trajectories from composite rule inputs, without altering recurrent dynamics, highlighting a biologically plausible route to within-manifold generalization. Our framework sheds light on how the brain might flexibly perform a diverse range of movements through the use of shared low-dimensional manifolds and compositional representations.

neuroscience↗

μSim: A goal-driven framework for elucidating the neural control of movement through musculoskeletal modeling

How does the motor cortex (MC) produce purposeful and generalizable movements with the complex musculoskeletal system in a dynamic environment? To elucidate the underlying neural dynamics, we use a goal-driven approach to model MC by considering its goal as a controller driving the musculoskeletal system through desired states to achieve movement. Specifically, we formulate a model of MC as a recurrent neural network (RNN) controller producing muscle commands while receiving sensory feedback from biologically accurate musculoskeletal models. Given this real-time simulated feedback implemented in advanced physics simulation engines, we use deep reinforcement learning to train the RNN to execute desired movements under specified neural and musculoskeletal constraints. For general use, we provide a modular computational framework that allows the flexible integration of user-defined musculoskeletal models, training algorithms, tasks and constraints. We also provide a combination of modules to analyze and quantify the dynamical alignment and similarity of the trained RNN with the recorded neural data on the population and single-unit level. Using these modules, we find that the activity of the trained RNN can accurately decode experimentally recorded neural population dynamics and single-unit MC activity, while generalizing well to testing conditions significantly different from training. Finally, we also provide perturbation modules to generate insights about neural dynamics for perturbed conditions different from training, and show that this framework unveils computational principles of how such neural dynamics enable flexible control of movement.

neuroscience↗