Search bioRxiv⌕ Search

Biology subjects

Kelberman, M. M.

Publications and source records attributed to Kelberman, M. M..

3 recordsLinked to original sources

Exploring the trade-off between deep-learning and explainable models for brain-machine interfaces

People with brain or spinal cord-related paralysis often need to rely on others for basic tasks, limiting their independence. A potential solution is brain-machine interfaces (BMIs), which could allow them to voluntarily control external devices (e.g., robotic arm) by decoding brain activity to movement commands. In the past decade, deep-learning decoders have achieved state-of-the-art results in most BMI applications, ranging from speech production to finger control. However, the black-box nature of deep-learning decoders could lead to unexpected behaviors, resulting in major safety concerns in real-world physical control scenarios. In these applications, explainable but lower-performing decoders, such as the Kalman filter (KF), remain the norm. In this study, we designed a BMI decoder based on KalmanNet, an extension of the KF that augments its operation with recurrent neural networks to compute the Kalman gain. This results in a varying "trust" that shifts between inputs and dynamics. We used this algorithm to predict finger movements from the brain activity of two monkeys. We compared KalmanNet results offline (pre-recorded data, n = 13 days) and online (real-time predictions, n = 5 days) with a simple KF and two recent deep-learning algorithms with state-of-the-art results: tcFNN and LSTM. KalmanNet achieved comparable or better results than other deep learning models in offline and online modes, relying on the dynamical model for stopping while depending more on neural inputs for initiating movements. We further validated this mechanism by implementing a heteroscedastic KF that used the same strategy, and it also approached state-of-the-art performance while remaining in the explainable domain of standard KFs. However, we also see two downsides to KalmanNet. KalmanNet shares the limited generalization ability of existing deep-learning decoders, and its usage of the KF as an inductive bias limits its performance in the presence of unseen noise distributions. Despite this trade-off, our analysis successfully integrates traditional controls and modern deep-learning approaches to motivate high-performing yet still explainable BMI designs.

neuroscience↗

Functional Electrical Stimulation and Brain-Machine Interfaces for Simultaneous Control of Wrist and Finger Flexion

Brain-machine interface (BMI) controlled functional electrical stimulation (FES) is a promising treatment to restore hand movements to people with cervical spinal cord injury. Recent intracortical BMIs have shown unprecedented successes in decoding user intentions, however the hand movements restored by FES have largely been limited to predetermined grasps. Restoring dexterous hand movements will require continuous control of many biomechanically linked degrees-of-freedom in the hand, such as wrist and finger flexion, that would form the basis of those movements. Here we investigate the ability to restore simultaneous wrist and finger flexion, which would enable grasping with a controlled hand posture and assist in manipulating objects once grasped. We demonstrate that intramuscular FES can enable monkeys with temporarily paralyzed hands to move their fingers and wrist across a functional range of motion, spanning an average 88.6 degrees at the metacarpophalangeal joint flexion and 71.3 degrees of wrist flexion, and intramuscular FES can control both joints simultaneously in a real-time task. Additionally, we demonstrate a monkey using an intracortical BMI to control the wrist and finger flexion in a virtual hand, both before and after the hand is temporarily paralyzed, even achieving success rates and acquisition times equivalent to able-bodied control with BMI control after temporary paralysis in two sessions. Together, this outlines a method using an artificial brain-to-body interface that could restore continuous wrist and finger movements after spinal cord injury. One Sentence SummaryWe show in non-human primates that intramuscular functional electrical stimulation can flex the wrist and fingers through a functional range of movement, can be controlled precisely, and that a brain-machine interface can determine command signals for intended finger and wrist flexion.

neuroscience↗

Artificial neural network for brain-machine interface consistently produces more naturalistic finger movements than linear methods

Brain-machine interfaces (BMI) aim to restore function to persons living with spinal cord injuries by decoding neural signals into behavior. Recently, nonlinear BMI decoders have outperformed previous state-of-the-art linear decoders, but few studies have investigated what specific improvements these nonlinear approaches provide. In this study, we compare how temporally convolved feedforward neural networks (tcFNNs) and linear approaches predict individuated finger movements in open and closed-loop settings. We show that nonlinear decoders generate more naturalistic movements, producing distributions of velocities 85.3% closer to true hand control than linear decoders. Addressing concerns that neural networks may come to inconsistent solutions, we find that regularization techniques improve the consistency of tcFNN convergence by 194.6%, along with improving average performance, and training speed. Finally, we show that tcFNN can leverage training data from multiple task variations to improve generalization. The results of this study show that nonlinear methods produce more naturalistic movements and show potential for generalizing over less constrained tasks. TeaserA neural network decoder produces consistent naturalistic movements and shows potential for real-world generalization through task variations.

neuroscience↗