Search bioRxiv⌕ Search

Biology subjects

Rizzoglio, F.

Publications and source records attributed to Rizzoglio, F..

8 recordsLinked to original sources

High-density surface EMG grid enables non-invasive characterization of intrinsic hand muscles activity

Understanding the neuromuscular properties that allow dexterous manipulation of objects remains a major challenge in neurorehabilitation, largely due to the difficulty of characterizing intrinsic hand muscle activity. These muscles are small, densely packed, and anatomically complex, making selective recordings with intramuscular electromyography (EMG) technically demanding and impractical for comprehensive studies. In this work, we present a custom, high-density (HD) surface EMG grid designed to non-invasively capture activity from intrinsic hand muscles from both dorsal and palmar surfaces. We evaluated the quality and spatial selectivity of the recordings by directly comparing them with intramuscular EMG signals obtained from the dorsal and palmar interossei. Surface EMG signals corresponded closely to the intramuscular recordings, with high correlation values for all subjects and tasks. Double differential spatial filtering significantly improved selectivity, although some residual volume conduction remained. The dorsal grid primarily captured dorsal interossei activity, while the palmar grid was more sensitive to lumbrical activation. The palmar interossei recordings were spatially more varied, with the second palmar interosseous predominantly detected on the dorsal grid and the third and fourth on the palmar grid. Together, these results demonstrate that non-invasive HD surface EMG will allow more complete measurement of intrinsic muscle activity, to provide a better understanding of the complex relation between the intrinsic and extrinsic hand muscles during dexterous movements. This basic information will allow refinement of biomechanical hand models and prosthetic devices, and the development of biomimetic brain computer interfaces aimed at restoring natural hand function after neurological injury.

bioengineering↗

Muscle-driven hand simulations emphasize the critical role of the extensor mechanism

Biomechanical simulations of complex hand motions remain scarce, due to challenges that span computation and data acquisition. Using a computer vision-based motion capture approach, a 23-degree of freedom musculoskeletal model, and direct collocation optimization, we performed muscle-driven simulations to track hand kinematics from 7 participants performing American Sign Language gestures. While proximal joints were tracked accurately, interphalangeal joint tracking was significantly worse, with a consistent flexion bias. Modifications to finger extensor muscle paths that incorporated the dual-inserting nature of the extensors improved accuracy, suggesting better representation of extensor force distribution across distal joints may be necessary for accurate hand simulations.

bioengineering↗

Consistent EMG encoding during reach and grasp by neurons in motor cortex

Identifying what the activity of neurons in the primary motor cortex (M1) represents is essential for understanding motor computation. Yet the relation of M1 to muscles and movement remains unresolved, in part because the kinematic variables M1 appears to encode differ across the limb: hand velocity during reaching, but joint position during grasping. This discrepancy has been taken to imply fundamentally distinct control strategies for proximal and distal segments. Yet, here we show that a single, muscle-based control principle accounts well for both observations. We recorded neural activity, electromyographic (EMG) signals, and movement kinematics from macaque monkeys performing planar reaching, wrist movement, or free-form grasping tasks. Across behaviors, EMG-based encoding models explained M1 firing rates as accurately as the best-performing kinematic model: velocity for reaching, position for grasping, and either variable for wrist movements. Impulse response analysis revealed that these task-dependent kinematic relationships arise from the differences in mechanical impedance of each limb segment: the inertial and intersegmental coupling which dominate the dynamics of the proximal arm are far less important in the hand. These findings indicate that M1 output has a relatively simple, consistent relation to muscle activation and that the apparent divergence in kinematic encoding is a consequence of limb mechanics rather than distinct cortical strategies.

neuroscience↗

A Generalist Intracortical Motor Decoder

Mapping the relationship between neural activity and motor behavior is a central aim of sensori-motor neuroscience and neurotechnology. While most progress to this end has relied on restricting complexity, the advent of foundation models instead proposes integrating a breadth of data as an alternate avenue for broadly advancing downstream modeling. We quantify this premise for motor decoding from intracortical microelectrode data, pretraining an autoregressive Transformer on 2000 hours of neural population spiking activity paired with diverse motor covariates from over 30 monkeys and humans. The resulting model is broadly useful, benefiting decoding on 8 downstream decoding tasks and generalizing to a variety of neural distribution shifts. However, we also highlight that scaling autoregressive Transformers seems unlikely to resolve limitations stemming from sensor variability and output stereotypy in neural datasets. Code: https://github.com/joel99/ndt3

neuroscience↗

Few-shot Algorithms for Consistent Neural Decoding (FALCON) Benchmark

Intracortical brain-computer interfaces (iBCIs) can restore movement and communication abilities to individuals with paralysis by decoding their intended behavior from neural activity recorded with an implanted device. While this activity yields high-performance decoding over short timescales, neural data are often nonstationary, which can lead to decoder failure if not accounted for. To maintain performance, users must frequently recalibrate decoders, which requires the arduous collection of new neural and behavioral data. Aiming to reduce this burden, several approaches have been developed that either limit recalibration data requirements (few-shot approaches) or eliminate explicit recalibration entirely (zero-shot approaches). However, progress is limited by a lack of standardized datasets and comparison metrics, causing methods to be compared in an ad hoc manner. Here we introduce the FALCON benchmark suite (Few-shot Algorithms for COnsistent Neural decoding) to standardize evaluation of iBCI robustness. FALCON curates five datasets of neural and behavioral data that span movement and communication tasks to focus on behaviors of interest to modern-day iBCIs. Each dataset includes calibration data, optional few-shot recalibration data, and private evaluation data. We implement a flexible evaluation platform which only requires user-submitted code to return behavioral predictions on unseen data. We also seed the benchmark by applying baseline methods spanning several classes of possible approaches. FALCON aims to provide rigorous selection criteria for robust iBCI decoders, easing their translation to real-world devices. https://snel-repo.github.io/falcon/

neuroscience↗

Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface

ObjectiveCreating an intracortical brain-computer interface (iBCI) capable of seamless transitions between tasks and contexts would greatly enhance user experience. However, the nonlinearity in neural activity presents challenges to computing a global iBCI decoder. We aimed to develop a method that differs from a globally optimized decoder to address this issue. ApproachWe devised an unsupervised approach that relies on the structure of a low-dimensional neural manifold to implement a piecewise linear decoder. We created a distinctive dataset in which monkeys performed a diverse set of tasks, some trained, others innate, while we recorded neural signals from the motor cortex (M1) and electromyographs (EMGs) from upper limb muscles. We used both linear and nonlinear dimensionality reduction techniques to discover neural manifolds and applied unsupervised algorithms to identify clusters within those spaces. Finally, we fit a linear decoder of EMG for each cluster. A specific decoder was activated corresponding to the cluster each new neural data point belonged to. Main resultsWe found clusters in the neural manifolds corresponding with the different tasks or task sub-phases. The performance of piecewise decoding improved as the number of clusters increased and plateaued gradually. With only two clusters it already outperformed a global linear decoder, and unexpectedly, it outperformed even a global recurrent neural network (RNN) decoder with 10-12 clusters. SignificanceThis study introduced a computationally lightweight solution for creating iBCI decoders that can function effectively across a broad range of tasks. EMG decoding is particularly challenging, as muscle activity is used, under varying contexts, to control interaction forces and limb stiffness, as well as motion. The results suggest that a piecewise linear decoder can provide a good approximation to the nonlinearity between neural activity and motor outputs, a result of our increased understanding of the structure of neural manifolds in motor cortex.

neuroscience↗

Monkey-to-human transfer of brain computer interface decoders

Intracortical brain-computer interfaces (iBCIs) enable paralyzed persons to generate movement, but current methods require large amounts of both neural and movement-related data to be collected from the iBCI user for supervised decoder training. We hypothesized that the low-dimensional latent neural representations of motor behavior, known to be preserved across time, might also be preserved across individuals, and allow us to circumvent this problem. We trained a decoder to predict the electromyographic (EMG) activity for a "source" monkey from the latent signals of motor cortex. We then used Canonical Correlation Analysis to align the latent signals of a "target" monkey to those of the source. These decoders were as accurate across monkeys as they were across sessions for a given monkey. Remarkably, the same process with latent signals from a human participant with tetraplegia was within 90% of the with-monkey decoding across session accuracy. Our findings suggest that consistent representations of motor activity exist across animals and even species. Discovering this common representation is a crucial first step in designing iBCI decoders that perform well without large amounts of data and supervised subject-specific tuning.

neuroscience↗

Using adversarial networks to extend brain computer interface decoding accuracy over time

Existing intracortical brain computer interfaces (iBCIs) transform neural activity into control signals capable of restoring movement to persons with paralysis. However, the accuracy of the "decoder" at the heart of the iBCI typically degrades over time due to turnover of recorded neurons. To compensate, decoders can be recalibrated, but this requires the user to spend extra time and effort to provide the necessary data, then learn the new dynamics. As the recorded neurons change, one can think of the underlying movement intent signal being expressed in changing coordinates. If a mapping can be computed between the different coordinate systems, it may be possible to stabilize the original decoders mapping from brain to behavior without recalibration. We previously proposed a method based on Generalized Adversarial Networks (GANs), called "Adversarial Domain Adaptation Network" (ADAN), which aligns the distributions of latent signals within underlying low-dimensional neural manifolds. However, ADAN was tested on only a very limited dataset. Here we propose a method based on Cycle-Consistent Adversarial Networks (Cycle-GAN), which aligns the distributions of the full-dimensional neural recordings. We tested both Cycle-GAN and ADAN on data from multiple monkeys and behaviors and compared them to a linear method based on Procrustes Alignment of axes provided by Factor Analysis (PAF). Both GAN-based methods outperformed PAF. Cycle-GAN and ADAN (like PAF) are unsupervised and require little data, making them practical in real life. Overall, Cycle-GAN had the best performance and was easier to train and more robust than ADAN, making it ideal for stabilizing iBCI systems over time. Significance StatementThe inherent instabilities in the neural signals acquired by intracortical microelectrode arrays cause the performance of an intracortical brain computer interface (iBCI) decoder to drop over time, as the movement intent signal must essentially be recorded from neurons representing an ever-changing coordinate system. Here, we address this problem using Generative Adversarial Networks (GANs) to align these coordinates and compare their success to another, recently proposed linear method that uses Factor Analysis and Procrustes alignment. Our proposed methods are fully unsupervised, can be trained quickly, and require remarkably little new data. These methods should give iBCI users access to decoders with unchanging dynamics, and without the need for periodic supervised recalibration.

neuroscience↗