Search bioRxiv⌕ Search

Biology subjects

Chichilnisky, E. J.

Publications and source records attributed to Chichilnisky, E. J..

At least 19 recordsLinked to original sources

Retinal Resistivity Mapped by Electrical Resistance Tomography

Retinal resistivity is a key parameter for modeling both the electric field in tissue and the resulting neural response - a crucial step in designing retinal prostheses, especially since both depend on resistivity nonlinearly. Previous studies using penetrating microelectrodes reported vastly different values, varying by as much as two orders of magnitude, likely due to parasitic capacitance in microelectrodes, compression of tissue and its rupture by the inserted probe, allowing the conductive medium to seep in and alter the measurement. To measure retinal resistivity without compression or rupture, we applied electrical resistance tomography using a planar multielectrode array with a 30 m pitch. Voltage waveforms generated in response to current injected from one electrode were measured on other electrodes in the array, at distances ranging from 30 to 600 m. Data from wild-type and degenerated rat retinas were analyzed using two methods: a commercial inversion software, Res2DInv, and a custom machine learning-based decoder, with healthy retina approximated as a 4-layer structure and degenerated retina - as a 3-layer one.

biophysics↗

Electrical stimulation precisely reproduces naturalistic spiking activity in complete and intermixed neural populations in the primate retina

Neurostimulation technologies have the potential to restore complex brain functions by evoking naturalistic patterns of neural activity. However, faithfully mimicking the brains natural neural code in diverse neuron types remains an unsolved challenge. Here we exploit focal electrical stimulation and recording to reproduce natural visual signals at cellular resolution in two intermixed and oppositely-tuned neural populations in the isolated macaque retina. We calibrated and delivered electrical stimulation sequences to precisely mimic recorded visually-evoked responses to natural images in complete populations of ~50 ON and OFF parasol cells uniformly sampling ~4{degrees} x 4{degrees} of visual angle. Distinct and opposing visually-evoked response patterns in the two intermixed populations were closely replicated spike-by-spike in 5 retinal preparations using electrical stimulation, reproducing spike trains with 51 {+/-} 17% lower variability than repeated presentations of the same visual stimulus. Focal electrical stimulation also replicated traveling waves of neural activity in response to visual motion, and highly structured artificial response patterns. These findings demonstrate for the first time that neurostimulation can match or exceed biological signaling fidelity in large, complete and intermixed neural populations.

bioengineering↗

A Framework for Compressive On-chip Action Potential Recording

Scaling neural recording systems to thousands of channels creates extreme bandwidth demands, posing a challenge for resource-constrained, implantable devices. This work introduces an adaptive, multi-stage compression framework for high-bandwidth neural interfaces. The system combines a Wired-OR analog-to-digital compressive readout with a digital core that adaptively requantizes, selectively samples, and encodes the neural signals. Although prior work suggests that action potential recordings can be re-quantized to approximately the signal-to-noise (SNR) number of bits without significantly degrading decoding performance, our results show that the required resolution can often be reduced even further. By matching the number of quantization levels to the electrodes maximum SNR ({lceil}log2 SNR{rciel} number of bits), we retain waveform fidelity while eliminating unnecessary precision that primarily captures noise. Recorded spike samples are selected using a mutual information-based criterion to preserve both spatial and temporal discriminative waveform features. A static entropy coder completes the pipeline with low computation overhead compression optimized for neural signal statistics. Evaluated on 512-channel macaque retina ex vivo data, the system preserves 90% of spikes while achieving a 1098x total compression over baseline.

bioengineering↗

Cell-type specific repertoire of responses to natural scenes in primate retinal ganglion cells

At least 20 distinct retinal ganglion cells (RGC) types have been identified morphologically in the primate retina, but our understanding of the distinctive visual messages they send to various targets in the brain remains limited. Here, we use large-scale multi-electrode array recordings to examine how multiple functionally-distinct RGC types in the macaque retina respond to flashed natural images. Responses to white noise visual stimulation were used to functionally identify 936 RGCs of 12 types in three recordings. Each cell type was confirmed by the mosaic organization of receptive fields, and 7 cell types were cross-identified between recordings. The average kinetics of light response in each RGC type as well as the repertoire of distinct firing patterns that each type produces were examined across thousands of natural images. The kinetics of the average response across images were highly stereotyped among cells of each cell type and distinct for cells of different types. Moreover, the full repertoires of firing patterns produced by different cell types, assessed by their latency and duration, were generally quite distinct with only a few exceptions. Together these data provide an overview of the range of responses to natural images transmitted from the primate retina to the brain.

neuroscience↗

A scalable framework for current steering at single-neuron resolution

Electrical stimulation at cellular resolution to restore the function of neural circuits is limited by the density of available electrode arrays. Although current steering with multi-electrode stimulation can be used to target cells between electrodes, it has not been proven for systematically targeting individual cells. We develop a framework for cellular-resolution current steering, leveraging the biophysics of electrically-evoked spike generation, and test its efficacy in isolated macaque and human retina. Currents were passed through three electrodes simultaneously using large-scale high-density microelectrode arrays, directly evoking single spikes in retinal ganglion cells. The currents combined either linearly or nonlinearly to drive spiking, depending on the geometry of the electrodes relative to the cell. These findings were captured by a biophysical model and by a simpler parametric model in which spikes can initiate at several sites on the cell membrane, and were leveraged to efficiently identify multi-electrode stimulation patterns that optimized cellular selectivity.

bioengineering↗

Functional diversity in the output of the primate retina

The visual image transmitted by the retina to the brain has long been understood in terms of spatial filtering by the center-surround receptive fields of retinal ganglion cells (RGCs). Recently, this textbook view has been challenged by the stunning functional diversity and specificity observed in [~]40 distinct RGC types in the mouse retina. However, it is unclear whether the [~]20 morphologically and molecularly identified RGC types in primates exhibit similar functional diversity, or instead exhibit center-surround organization at different spatial scales. Here, we reveal striking and surprising functional diversity in macaque and human RGC types using large-scale multi-electrode recordings from isolated macaque and human retinas. In addition to the five well-known primate RGC types, 18-27 types were distinguished by their functional properties, likely revealing several previously unknown types. Surprisingly, many of these cell types exhibited striking non-classical receptive field structure, including irregular spatial and chromatic properties not previously reported in any species. Qualitatively similar results were observed in recordings from the human retina. The receptive fields of less-understood RGC types formed uniform mosaics covering visual space, confirming their classification, and the morphological counterparts of two types were established using single-cell recording. The striking receptive field diversity was paralleled by distinctive responses to natural movies and complexity of visual computation. These findings suggest that diverse RGC types, rather than merely filtering the scene at different spatial scales, instead play specialized roles in human vision.

neuroscience↗

Understanding responses to multi-electrode epiretinal stimulation using a biophysical model

ObjectiveNeural interfaces are designed to evoke specific patterns of electrical activity in populations of neurons by stimulating with many electrodes. However, currents passed simultaneously through multiple electrodes often combine nonlinearly to drive neural responses, making evoked responses difficult to predict and control. This response nonlinearity could arise from the interaction of many excitable sites in each cell, any of which can produce a spike. However, this multi-site activation hypothesis is difficult to verify experimentally. ApproachWe developed a biophysical model to study retinal ganglion cell (RGC) responses to multi-electrode stimulation and validated it using data collected from ex vivo preparations of the macaque retina using a microelectrode array (512 electrodes; 30{micro}m pitch; 10{micro}m diameter). ResultsFirst, the model was validated by using it to reproduce essential empirical findings from single-electrode recording and stimulation, including recorded spike voltage waveforms at multiple locations and sigmoidal responses to injected current. Then, stimulation with two electrodes was modeled to test how the positioning of the electrodes relative to the cell affected the degree of response nonlinearity. Currents passed through pairs of electrodes positioned near the cell body or far from the axon (>40 {micro}m) exhibited approximately linear summation in evoking spikes. Currents passed through pairs of electrodes close to the axon summed linearly when their locations along the axon were similar, and nonlinearly otherwise. Over a range of electrode placements, several distinct, localized spike initiation sites were observed, and the number of these sites covaried with the degree of response nonlinearity. Similar trends were observed for three-electrode stimuli. All of these trends in the simulation were consistent with experimental observations. Significance. These findings support the multi-site activation hypothesis for nonlinear activation of neurons, providing a biophysical interpretation of previous experimental results and potentially enabling more efficient use of multi-electrode stimuli in future neural implants.

bioengineering↗

Modeling responses of macaque and human retinal ganglion cells to natural images using a convolutional neural network

Linear-nonlinear (LN) cascade models provide a simple way to capture retinal ganglion cell (RGC) responses to artificial stimuli such as white noise, but their ability to model responses to natural images is limited. Recently, convolutional neural network (CNN) models have been shown to produce light response predictions that were substantially more accurate than those of a LN model. However, this modeling approach has not yet been applied to responses of macaque or human RGCs to natural images. Here, we train and test a CNN model on responses to natural images of the four numerically dominant RGC types in the macaque and human retina - ON parasol, OFF parasol, ON midget and OFF midget cells. Compared with the LN model, the CNN model provided substantially more accurate response predictions. Linear reconstructions of the visual stimulus were more accurate for CNN compared to LN model-generated responses, relative to reconstructions obtained from the recorded data. These findings demonstrate the effectiveness of a CNN model in capturing light responses of major RGC types in the macaque and human retinas in natural conditions.

neuroscience↗

Decomposition of retinal ganglion cell electrical images for cell type and functional inference

ObjectiveIdentifying neuronal cell types and their biophysical properties based on their extracellular electrical features is a major challenge for experimental neuroscience and for the development of high-resolution brain-machine interfaces. One example is identification of retinal ganglion cell (RGC) types and their visual response properties, which is fundamental for developing future electronic implants that can restore vision. ApproachThe electrical image (EI) of a RGC, or the mean spatio-temporal voltage footprint of its recorded spikes on a high-density electrode array, contains substantial information about its anatomical, morphological, and functional properties. However, the analysis of these properties is complex because of the high-dimensional nature of the EI. We present a novel optimization-based algorithm to decompose electrical image into a low-dimensional, biophysically-based representation: the temporally-shifted superposition of three learned basis waveforms corresponding to spike waveforms produced in the somatic, dendritic and axonal cellular compartments. ResultsThe decomposition was evaluated using large-scale multi-electrode recordings from the macaque retina. The decomposition accurately localized the somatic and dendritic compartments of the cell. The imputed dendritic fields of RGCs correctly predicted the location and shape of their visual receptive fields. The inferred waveform amplitudes and shapes accurately identified the four major primate RGC types (ON and OFF midget and parasol cells) substantially more accurately than previous approaches. SignificanceThese findings contribute to more accurate inference of RGC types and their original light responses based purely on their electrical features, with potential implications for vision restoration technology.

neuroscience↗

Fixational Eye Movements Enhance the Precision of Visual Information Transmitted by the Primate Retina

Fixational eye movements alter the number and timing of spikes transmitted from the retina to the brain, but whether these changes enhance or degrade the retinal signal is unclear. To quantify this, we developed a Bayesian method for reconstructing natural images from the recorded spikes of hundreds of retinal ganglion cells (RGCs) in the macaque retina (male), combining a likelihood model for RGC light responses with the natural image prior implicitly embedded in an artificial neural network optimized for denoising. The method matched or surpassed the performance of previous reconstruction algorithms, and provides an interpretable framework for characterizing the retinal signal. Reconstructions were improved with artificial stimulus jitter that emulated fixational eye movements, even when the eye movement trajectory was assumed to be unknown and had to be inferred from retinal spikes. Reconstructions were degraded by small artificial perturbations of spike times, revealing more precise temporal encoding than suggested by previous studies. Finally, reconstructions were substantially degraded when derived from a model that ignored cell-to-cell interactions, indicating the importance of stimulusevoked correlations. Thus, fixational eye movements enhance the precision of the retinal representation.

neuroscience↗

Direct-print three-dimensional electrodes for large-scale, high-density, and customizable neural interfaces

Silicon-based planar microelectronics is a powerful tool for scalably recording and modulating neural activity at high spatiotemporal resolution, but it remains challenging to target neural structures in three dimensions (3D). We present a method for directly fabricating 3D arrays of tissue-penetrating microelectrodes onto silicon microelectronics. Leveraging a high-resolution 3D printing technology based on 2-photon polymerization and scalable microfabrication processes, we fabricated arrays of 6,600 microelectrodes 10-130 {micro}m tall and at 35-m pitch onto a planar silicon-based microelectrode array. The process enables customizable electrode shape, height and positioning for precise targeting of neuron populations distributed in 3D. As a proof of concept, we addressed the challenge of specifically targeting retinal ganglion cell (RGC) somas when interfacing with the retina. The array was customized for insertion into the retina and recording from somas while avoiding the axon layer. We verified locations of the microelectrodes with confocal microscopy and recorded high-resolution spontaneous RGC activity at cellular resolution. This revealed strong somatic and dendritic components with little axon contribution, unlike recordings with planar microelectrode arrays. The technology could be a versatile solution for interfacing silicon microelectronics with neural structures and modulating neural activity at large scale with single-cell resolution.

neuroscience↗

Precise control of neural activity using temporally dithered and spatially multiplexed electrical stimulation

Neural implants have the potential to restore lost sensory function by electrically evoking the complex naturalistic activity patterns of neural populations. However, it can be difficult to predict and control evoked neural responses to simultaneous multi-electrode stimulation due to nonlinearity of the responses. We present a solution to this problem and demonstrate its utility in the context of a bi-directional retinal implant for restoring vision. A dynamically optimized stimulation approach encodes incoming visual stimuli into a rapid, greedily chosen, temporally dithered and spatially multiplexed sequence of simple stimulation patterns. Stimuli are selected to optimize the reconstruction of the visual stimulus from the evoked responses. Temporal dithering exploits the slow time scales of downstream neural processing, and spatial multiplexing exploits the independence of responses generated by distant electrodes. The approach was evaluated using an experimental laboratory prototype of a retinal implant: large-scale, high-resolution multi-electrode stimulation and recording of macaque and rat retinal ganglion cells ex vivo. The dynamically optimized stimulation approach substantially enhanced performance compared to existing approaches based on static mapping between visual stimulus intensity and current amplitude. The modular framework enabled parallel extensions to naturalistic viewing conditions, incorporation of perceptual similarity measures, and efficient implementation for an implantable device. A direct closed-loop test of the approach supported its potential use in vision restoration. Impact StatementA novel method of electrical stimulation to precisely control neural activity for sensory restoration exhibits improvements in visual stimulus reconstruction, enables efficient hardware design, and extends to naturalistic conditions.

neuroscience↗

Inferring light responses of primate retinal ganglion cells using intrinsic electrical signatures

Reproducing high-acuity vision with an epiretinal implant will likely require inferring the natural light responses of diverse RGC types in the implanted retina, without measuring them directly. Here we demonstrate an approach that exploits intrinsic electrical features of primate RGCs. First, ON-parasol and OFF-parasol RGCs were identified with 95% accuracy using electrical features. Then, the somatic electrical footprint, predicted cell type, and average linear-nonlinear-Poisson model parameters of each cell type were used to infer a light response model for each cell. Across five retinas, these models achieved an average correlation with measured firing rates of 0.49 for white noise visual stimuli and 0.50 for natural scenes stimuli, compared to 0.65 and 0.58 respectively for models fitted to recorded light responses, an upper bound. This finding, and linear decoding of images from predicted RGC activity, suggested that the inference approach may be useful for high-fidelity sight restoration.

neuroscience↗

High-fidelity restoration of visual signals by electrical stimulation in the central primate retina

Electrical stimulation of retinal ganglion cells (RGCs) with electronic implants provides rudimentary artificial vision to people blinded by retinal degeneration. However, current devices stimulate indiscriminately and therefore cannot reproduce the intricate neural code of the retina. Recent work has demonstrated more precise activation of RGCs using focal electrical stimulation with multi-electrode arrays in the peripheral macaque retina, but it is unclear how effective this can be in the central retina, which is required for high-resolution vision. This work probes the neural code and effectiveness of focal epiretinal stimulation in the central macaque retina, using large-scale electrical recording and stimulation ex vivo. The functional organization, light response properties, and electrical properties of the major RGC types in the central retina were mostly similar to the peripheral retina, with some notable differences in density, kinetics, linearity, spiking statistics and correlations. The major RGC types could be distinguished by their intrinsic electrical properties. Electrical stimulation targeting parasol cells revealed similar activation thresholds and reduced axon bundle activation in the central retina, but lower stimulation selectivity. Quantitative evaluation of the potential for image reconstruction from electrically-evoked parasol cell signals revealed higher overall expected image quality in the central retina. An exploration of inadvertent midget cell activation suggested that it could contribute high spatial frequency noise to the visual signal carried by parasol cells. These results support the possibility of reproducing high-acuity visual signals in the central retina with an epiretinal implant. Significance StatementArtificial restoration of vision with retinal implants is a major treatment for blindness. However, present-day implants do not provide high-resolution visual perception, in part because they do not reproduce the natural neural code of the retina. Here we demonstrate the level of visual signal reproduction that is possible with a future implant by examining how accurately responses to electrical stimulation of parasol retinal ganglion cells (RGCs) can convey visual signals. Although the precision of electrical stimulation in the central retina was diminished relative to the peripheral retina, the quality of expected visual signal reconstruction in parasol cells was greater. These findings suggest that visual signals could be restored with high fidelity in the central retina using a future retinal implant.

neuroscience↗

Maximum a posteriori natural scene reconstruction from retinal ganglion cells with deep denoiser priors

Visual information arriving at the retina is transmitted to the brain by signals in the optic nerve, and the brain must rely solely on these signals to make inferences about the visual world. Previous work has probed the content of these signals by directly reconstructing images from retinal activity using linear regression or nonlinear regression with neural networks. Maximum a posteriori (MAP) reconstruction using retinal encoding models and separately-trained natural image priors offers a more general and principled approach. We develop a novel method for approximate MAP reconstruction that combines a generalized linear model for retinal responses to light, including their dependence on spike history and spikes of neighboring cells, with the image prior implicitly embedded in a deep convolutional neural network trained for image denoising. We use this method to reconstruct natural images from ex vivo simultaneously-recorded spikes of hundreds of retinal ganglion cells uniformly sampling a region of the retina. The method produces reconstructions that match or exceed the state-of-the-art in perceptual similarity and exhibit additional fine detail, while using substantially fewer model parameters than previous approaches. The use of more rudimentary encoding models (a linear-nonlinear-Poisson cascade) or image priors (a 1/f spectral model) significantly reduces reconstruction performance, indicating the essential role of both components in achieving high-quality reconstructed images from the retinal signal.

neuroscience↗

Efficient Inference of Sensitivity to Electrical Stimulation from Intrinsic Electrical Properties of Primate Retinal Ganglion Cells

High-fidelity electronic implants can in principle restore the function of neural circuits by precisely activating neurons via extracellular stimulation. However, direct characterization of the individual electrical responses of a large population of target neurons, in order to precisely control their activity, is often difficult or impossible. A potential solution is to leverage biophysical principles to infer sensitivity to electrical stimulation from features of spontaneous electrical activity, which can be recorded relatively easily. Here, this approach is developed and its potential value for vision restoration is tested quantitatively using large-scale high-density stimulation and recording from primate retinal ganglion cells (RGCs) ex vivo. Electrodes recording larger spikes from a given cell exhibited lower stimulation thresholds, with distinct trends for somas and axons, across cell types, retinas, and eccentricities. Thresholds for somatic stimulation increased with distance from the axon initial segment. The dependence of spike probability on injected current was inversely related to threshold, and was substantially steeper for axonal than somatic compartments, which could be identified by recorded electrical signatures. Dendritic stimulation was largely ineffective for eliciting spikes. These findings were quantitatively reproduced with biophysical simulations, and confirmed in tests on human RGCs. The inference of stimulation sensitivity from recorded electrical features was tested in simulated visual reconstruction, and revealed that the approach could significantly improve the function of future high-fidelity retinal implants.

neuroscience↗

Spatially Patterned Bi-electrode Epiretinal Stimulation for Axon Avoidance at Cellular Resolution

ObjectiveEpiretinal prostheses are designed to restore vision to people blinded by photoreceptor degenerative diseases by stimulating surviving retinal ganglion cells (RGCs), which carry visual signals to the brain. However, inadvertent stimulation of RGCs at their axons can result in non-focal visual percepts, limiting the quality of artificial vision. Theoretical work has suggested that axon activation can be avoided with current stimulation designed to minimize the second spatial derivative of the induced extracellular voltage along the axon. However, this approach has not been verified experimentally at the resolution of single cells. Approach. In this work, a custom multi-electrode array (512 electrodes, 10 m diameter, 60 m pitch) was used to stimulate and record RGCs in macaque retina ex vivo at single-cell, single-spike resolution. RGC activation thresholds resulting from bi-electrode stimulation, which consisted of bipolar currents simultaneously delivered through two electrodes straddling an axon, were compared to activation thresholds from traditional single-electrode stimulation. ResultsOn average, across three retinal preparations, the bi-electrode stimulation strategy reduced somatic activation thresholds ([~]21%) while increasing axonal activation thresholds ([~]14%), thus favoring selective somatic activation. Furthermore, individual examples revealed rescued selective activation of somas that was not possible with any individual electrode. Significance. This work suggests that a bi-electrode epiretinal stimulation strategy can reduce inadvertent axonal activation at cellular resolution, for high-fidelity artificial vision. Novelty & SignificanceThe effectiveness of bi-electrode stimulation for enhancing the electrical activation of retinal neurons was tested using high-density multi-electrode recording and stimulation in isolated macaque retina. The results suggest that spatially patterned bi-electrode stimuli reduce unwanted axon activation and thus improve the selectivity of stimulation at cellular resolution. Similar patterns could be implemented in a future high-resolution prosthesis to permit a more faithful replication of normal retinal activity, at the resolution of single-cells and single-spikes, for the treatment of incurable blindness.

bioengineering↗

Individual variability of neural computations in the primate retina

Variation in the neural code contributes to making each individual unique. We probed neural code variation using [~]100 neural population recordings from major ganglion cell types in the macaque retina, combined with an interpretable computational representation of individual variability using machine learning. This representation captured individual variation and covariation in properties such as nonlinearity, temporal dynamics, and spatial receptive field size, while preserving invariances, such as asymmetries between ON and OFF cells. The covariation of response properties in different cell types was associated with the proximity of lamination of their synaptic inputs. Surprisingly, male retinas exhibited higher firing rates and faster temporal integration than female retinas. Exploiting data from previously recorded macaque retinas enabled efficient characterization of a new macaque retina, and of a human retina. Simulations indicated that combining a vast dataset of healthy macaque recordings with behavioral feedback could be used to identify the neural code and thus improve retinal implants for vision restoration.

neuroscience↗