Search bioRxiv⌕ Search

Biology subjects

Madugula, S.

Publications and source records attributed to Madugula, S..

7 recordsLinked to original sources

Neural decoding of speech using deep neural ensembles

Speech brain-computer interfaces (BCIs) can restore rapid communication to people with paralysis, but decoding errors still limit performance. In recent brain-to-text decoding competitions, deep ensemble methods, which combine predictions from multiple independently trained decoders, have delivered striking accuracy improvements and account for the largest gains over baseline approaches. However, these methods have not previously been tested in real-time, require substantial computational resources, and their performance under various clinically relevant constraints remains poorly understood. Here, we present the first closed-loop test of deep ensembles in a participant with bilateral intracortical microelectrode arrays, demonstrating a reduction in word error rate from 33.7% to 26.0% on a large-vocabulary task. Using additional data from three participants, we then assess how these gains depend on baseline error rate, training dataset size, and ensemble size, including the resource-accuracy tradeoffs most relevant for real-world deployment. Finally, we introduce a computationally efficient pseudoensembling approach based on test-time augmentation that improves decoding accuracy while requiring only a single base decoder, greatly reducing the computational burden of ensembling. Together, these results show that the benefits of deep ensembling can be realized in real time and under practical resource constraints, bringing speech BCIs closer to broader clinical adoption.

neuroscience↗

Direct-print three-dimensional electrodes for large-scale, high-density, and customizable neural interfaces

Silicon-based planar microelectronics is a powerful tool for scalably recording and modulating neural activity at high spatiotemporal resolution, but it remains challenging to target neural structures in three dimensions (3D). We present a method for directly fabricating 3D arrays of tissue-penetrating microelectrodes onto silicon microelectronics. Leveraging a high-resolution 3D printing technology based on 2-photon polymerization and scalable microfabrication processes, we fabricated arrays of 6,600 microelectrodes 10-130 {micro}m tall and at 35-m pitch onto a planar silicon-based microelectrode array. The process enables customizable electrode shape, height and positioning for precise targeting of neuron populations distributed in 3D. As a proof of concept, we addressed the challenge of specifically targeting retinal ganglion cell (RGC) somas when interfacing with the retina. The array was customized for insertion into the retina and recording from somas while avoiding the axon layer. We verified locations of the microelectrodes with confocal microscopy and recorded high-resolution spontaneous RGC activity at cellular resolution. This revealed strong somatic and dendritic components with little axon contribution, unlike recordings with planar microelectrode arrays. The technology could be a versatile solution for interfacing silicon microelectronics with neural structures and modulating neural activity at large scale with single-cell resolution.

neuroscience↗

Precise control of neural activity using temporally dithered and spatially multiplexed electrical stimulation

Neural implants have the potential to restore lost sensory function by electrically evoking the complex naturalistic activity patterns of neural populations. However, it can be difficult to predict and control evoked neural responses to simultaneous multi-electrode stimulation due to nonlinearity of the responses. We present a solution to this problem and demonstrate its utility in the context of a bi-directional retinal implant for restoring vision. A dynamically optimized stimulation approach encodes incoming visual stimuli into a rapid, greedily chosen, temporally dithered and spatially multiplexed sequence of simple stimulation patterns. Stimuli are selected to optimize the reconstruction of the visual stimulus from the evoked responses. Temporal dithering exploits the slow time scales of downstream neural processing, and spatial multiplexing exploits the independence of responses generated by distant electrodes. The approach was evaluated using an experimental laboratory prototype of a retinal implant: large-scale, high-resolution multi-electrode stimulation and recording of macaque and rat retinal ganglion cells ex vivo. The dynamically optimized stimulation approach substantially enhanced performance compared to existing approaches based on static mapping between visual stimulus intensity and current amplitude. The modular framework enabled parallel extensions to naturalistic viewing conditions, incorporation of perceptual similarity measures, and efficient implementation for an implantable device. A direct closed-loop test of the approach supported its potential use in vision restoration. Impact StatementA novel method of electrical stimulation to precisely control neural activity for sensory restoration exhibits improvements in visual stimulus reconstruction, enables efficient hardware design, and extends to naturalistic conditions.

neuroscience↗

Automatic Identification and Avoidance of Axon Bundle Activation for Epiretinal Prosthesis

Retinal prostheses must be able to activate cells in a selective way in order to restore high-fidelity vision. However, inadvertent activation of far-away retinal ganglion cells (RGCs) through electrical stimulation of axon bundles can produce irregular and poorly controlled percepts, limiting artificial vision. Therefore, the problem of axon bundle activation can be defined as the axonal stimulation of RGCs with unknown soma and receptive field locations, typically outside the electrode array. Here, a new algorithm is presented that utilizes electrical recordings to determine the stimulation current amplitudes above which bundle activation occurs. The method exploits several spatiotemporal characteristics of electrically-evoked spikes to overcome the challenge of detecting small axonal spikes in extracellular recordings. The algorithm was validated using large-scale ex vivo stimulation and recording experiments in macaque retina, by comparing algorithmically and manually identified bundle activation thresholds. The algorithm could be used in a closed-loop manner by a future epiretinal prosthesis to reduce poorly controlled visual percepts associated with bundle activation. The method may also be applicable to other types of retinal implants and to cortical implants. ContributionsPT developed the algorithm and analyzed the data, with input from SMi and EJC. NB and NS helped with the analysis. SMa and LG performed dissections and collected the data. PT and VFH performed manual identification. PH, AS and AML developed and supported recording hardware and software. PT, EJC and SMi wrote the manuscript. NS and SMa edited it. EJC and SMi supervised the project.

bioengineering↗

Focal Electrical Stimulation of Human Retinal Ganglion Cells

Vision restoration with retinal implants that electrically stimulate retinal ganglion cells (RGCs), which transmit visual information to the brain, is limited by indiscriminate activation of many cells and cell types. Recent work in isolated macaque retina has demonstrated that direct electrical stimulation of RGCs can be performed with single-cell, single-spike resolution. However, the fidelity of epiretinal stimulation has not been examined in the human retina. Here, electrical activation of the major RGC types was examined using large-scale, multi-electrode recording and stimulation in the human retina ex vivo and compared directly to results from macaque. Targeted activation with single-cell, single-spike resolution was often possible without activating overlying axon bundles, at low stimulation current levels similar to those in macaque. Distinct cell types could be identified and targeted based on their distinct electrical signatures. Simulation based on these measurements revealed that a novel, dynamic stimulation approach would produce a nearly optimal evoked visual signal. These results indicate that high-fidelity control of spiking in human RGCs is achievable with extracellular stimulation and that the macaque retina is an accurate model for vision restoration with epiretinal implants.

neuroscience↗

Large-scale intrinsic connectivity is consistent across varying task demands

Measuring whole-brain functional connectivity patterns based on task-free ( restingstate) spontaneous fluctuations in the functional MRI (fMRI) signal is a standard approach to probing habitual brain states, independent of task-specific context. This view is supported by spatial correspondence between task- and rest-derived connectivity networks. Yet, it remains unclear whether intrinsic connectivity observed in a resting-state acquisitions is persistent during task. Here, we sought to determine how changes in ongoing brain activation, elicited by task performance, impact the integrity of whole-brain functional connectivity patterns. We employed a steadystates paradigm, in which participants continuously executed a specific task (without baseline periods). Participants underwent separate task-based (visual, motor and visuomotor) or task-free (resting) steady-state scans, each performed over a 5-minute period. This unique design allowed us to apply a set of traditional resting-state analyses to various task-states. In addition, a classical fMRI block-design was employed to identify individualized brain activation patterns for each task, allowing to characterize how differing activation patterns across the steady-states impact whole-brain intrinsic connectivity patterns. By examining correlations across segregated brain regions (nodes) and the whole brain (using independent component analysis), we show that the whole-brain network architecture characteristic of the resting-state is robustly preserved across different steady-task states, despite striking inter-task changes in brain activation (signal amplitude). Subtler changes in functional connectivity were detected locally, within the active networks. Together, we show that intrinsic connectivity underlying the canonical resting-state networks is relatively stable even when participants are engaged in different tasks and is not limited to the resting-state.\n\nNew and Noteworthy\n\nDoes intrinsic functional connectivity (FC) reflect the canonical or transient state of the brain? We tested the consistency of the intrinsic connectivity networks across different task-conditions. We show that despite local changes in connectivity, at the whole-brain level there is little modulation in FC patterns, despite profound and large-scale activation changes. We therefore conclude that intrinsic FC largely reflects the a priori habitual state of the brain, independent of the specific cognitive context.

neuroscience↗

Learning a neural response metric for retinal prosthesis

Retinal prostheses for treating incurable blindness are designed to electrically stimulate surviving retinal neurons, causing them to send artificial visual signals to the brain. However, electrical stimulation generally cannot precisely reproduce typical patterns of neural activity in the retina. Therefore, an electrical stimulus must be selected so as to produce a neural response as close as possible to the desired response. This requires a technique for computing the distance between a desired response and an achievable response that is meaningful in terms of the visual signal being conveyed. We propose a method to learn a metric on neural responses directly from recorded light responses of a population of retinal ganglion cells (RGCs) in the primate retina. The learned metric produces a measure of similarity of RGC population responses that accurately reflects the similarity of visual inputs. Using data from electrical stimulation experiments, we demonstrate that the learned metric could produce improvements in the performance of a retinal prosthesis.

neuroscience↗