Search bioRxiv⌕ Search

Biology subjects

Wu, E. G.

Publications and source records attributed to Wu, E. G..

8 recordsLinked to original sources

Modeling responses of macaque and human retinal ganglion cells to natural images using a convolutional neural network

Linear-nonlinear (LN) cascade models provide a simple way to capture retinal ganglion cell (RGC) responses to artificial stimuli such as white noise, but their ability to model responses to natural images is limited. Recently, convolutional neural network (CNN) models have been shown to produce light response predictions that were substantially more accurate than those of a LN model. However, this modeling approach has not yet been applied to responses of macaque or human RGCs to natural images. Here, we train and test a CNN model on responses to natural images of the four numerically dominant RGC types in the macaque and human retina - ON parasol, OFF parasol, ON midget and OFF midget cells. Compared with the LN model, the CNN model provided substantially more accurate response predictions. Linear reconstructions of the visual stimulus were more accurate for CNN compared to LN model-generated responses, relative to reconstructions obtained from the recorded data. These findings demonstrate the effectiveness of a CNN model in capturing light responses of major RGC types in the macaque and human retinas in natural conditions.

neuroscience↗

Decomposition of retinal ganglion cell electrical images for cell type and functional inference

ObjectiveIdentifying neuronal cell types and their biophysical properties based on their extracellular electrical features is a major challenge for experimental neuroscience and for the development of high-resolution brain-machine interfaces. One example is identification of retinal ganglion cell (RGC) types and their visual response properties, which is fundamental for developing future electronic implants that can restore vision. ApproachThe electrical image (EI) of a RGC, or the mean spatio-temporal voltage footprint of its recorded spikes on a high-density electrode array, contains substantial information about its anatomical, morphological, and functional properties. However, the analysis of these properties is complex because of the high-dimensional nature of the EI. We present a novel optimization-based algorithm to decompose electrical image into a low-dimensional, biophysically-based representation: the temporally-shifted superposition of three learned basis waveforms corresponding to spike waveforms produced in the somatic, dendritic and axonal cellular compartments. ResultsThe decomposition was evaluated using large-scale multi-electrode recordings from the macaque retina. The decomposition accurately localized the somatic and dendritic compartments of the cell. The imputed dendritic fields of RGCs correctly predicted the location and shape of their visual receptive fields. The inferred waveform amplitudes and shapes accurately identified the four major primate RGC types (ON and OFF midget and parasol cells) substantially more accurately than previous approaches. SignificanceThese findings contribute to more accurate inference of RGC types and their original light responses based purely on their electrical features, with potential implications for vision restoration technology.

neuroscience↗

Fixational Eye Movements Enhance the Precision of Visual Information Transmitted by the Primate Retina

Fixational eye movements alter the number and timing of spikes transmitted from the retina to the brain, but whether these changes enhance or degrade the retinal signal is unclear. To quantify this, we developed a Bayesian method for reconstructing natural images from the recorded spikes of hundreds of retinal ganglion cells (RGCs) in the macaque retina (male), combining a likelihood model for RGC light responses with the natural image prior implicitly embedded in an artificial neural network optimized for denoising. The method matched or surpassed the performance of previous reconstruction algorithms, and provides an interpretable framework for characterizing the retinal signal. Reconstructions were improved with artificial stimulus jitter that emulated fixational eye movements, even when the eye movement trajectory was assumed to be unknown and had to be inferred from retinal spikes. Reconstructions were degraded by small artificial perturbations of spike times, revealing more precise temporal encoding than suggested by previous studies. Finally, reconstructions were substantially degraded when derived from a model that ignored cell-to-cell interactions, indicating the importance of stimulusevoked correlations. Thus, fixational eye movements enhance the precision of the retinal representation.

neuroscience↗

Direct-print three-dimensional electrodes for large-scale, high-density, and customizable neural interfaces

Silicon-based planar microelectronics is a powerful tool for scalably recording and modulating neural activity at high spatiotemporal resolution, but it remains challenging to target neural structures in three dimensions (3D). We present a method for directly fabricating 3D arrays of tissue-penetrating microelectrodes onto silicon microelectronics. Leveraging a high-resolution 3D printing technology based on 2-photon polymerization and scalable microfabrication processes, we fabricated arrays of 6,600 microelectrodes 10-130 {micro}m tall and at 35-m pitch onto a planar silicon-based microelectrode array. The process enables customizable electrode shape, height and positioning for precise targeting of neuron populations distributed in 3D. As a proof of concept, we addressed the challenge of specifically targeting retinal ganglion cell (RGC) somas when interfacing with the retina. The array was customized for insertion into the retina and recording from somas while avoiding the axon layer. We verified locations of the microelectrodes with confocal microscopy and recorded high-resolution spontaneous RGC activity at cellular resolution. This revealed strong somatic and dendritic components with little axon contribution, unlike recordings with planar microelectrode arrays. The technology could be a versatile solution for interfacing silicon microelectronics with neural structures and modulating neural activity at large scale with single-cell resolution.

neuroscience↗

Inferring light responses of primate retinal ganglion cells using intrinsic electrical signatures

Reproducing high-acuity vision with an epiretinal implant will likely require inferring the natural light responses of diverse RGC types in the implanted retina, without measuring them directly. Here we demonstrate an approach that exploits intrinsic electrical features of primate RGCs. First, ON-parasol and OFF-parasol RGCs were identified with 95% accuracy using electrical features. Then, the somatic electrical footprint, predicted cell type, and average linear-nonlinear-Poisson model parameters of each cell type were used to infer a light response model for each cell. Across five retinas, these models achieved an average correlation with measured firing rates of 0.49 for white noise visual stimuli and 0.50 for natural scenes stimuli, compared to 0.65 and 0.58 respectively for models fitted to recorded light responses, an upper bound. This finding, and linear decoding of images from predicted RGC activity, suggested that the inference approach may be useful for high-fidelity sight restoration.

neuroscience↗

Maximum a posteriori natural scene reconstruction from retinal ganglion cells with deep denoiser priors

Visual information arriving at the retina is transmitted to the brain by signals in the optic nerve, and the brain must rely solely on these signals to make inferences about the visual world. Previous work has probed the content of these signals by directly reconstructing images from retinal activity using linear regression or nonlinear regression with neural networks. Maximum a posteriori (MAP) reconstruction using retinal encoding models and separately-trained natural image priors offers a more general and principled approach. We develop a novel method for approximate MAP reconstruction that combines a generalized linear model for retinal responses to light, including their dependence on spike history and spikes of neighboring cells, with the image prior implicitly embedded in a deep convolutional neural network trained for image denoising. We use this method to reconstruct natural images from ex vivo simultaneously-recorded spikes of hundreds of retinal ganglion cells uniformly sampling a region of the retina. The method produces reconstructions that match or exceed the state-of-the-art in perceptual similarity and exhibit additional fine detail, while using substantially fewer model parameters than previous approaches. The use of more rudimentary encoding models (a linear-nonlinear-Poisson cascade) or image priors (a 1/f spectral model) significantly reduces reconstruction performance, indicating the essential role of both components in achieving high-quality reconstructed images from the retinal signal.

neuroscience↗

Focal Electrical Stimulation of Human Retinal Ganglion Cells

Vision restoration with retinal implants that electrically stimulate retinal ganglion cells (RGCs), which transmit visual information to the brain, is limited by indiscriminate activation of many cells and cell types. Recent work in isolated macaque retina has demonstrated that direct electrical stimulation of RGCs can be performed with single-cell, single-spike resolution. However, the fidelity of epiretinal stimulation has not been examined in the human retina. Here, electrical activation of the major RGC types was examined using large-scale, multi-electrode recording and stimulation in the human retina ex vivo and compared directly to results from macaque. Targeted activation with single-cell, single-spike resolution was often possible without activating overlying axon bundles, at low stimulation current levels similar to those in macaque. Distinct cell types could be identified and targeted based on their distinct electrical signatures. Simulation based on these measurements revealed that a novel, dynamic stimulation approach would produce a nearly optimal evoked visual signal. These results indicate that high-fidelity control of spiking in human RGCs is achievable with extracellular stimulation and that the macaque retina is an accurate model for vision restoration with epiretinal implants.

neuroscience↗

Functional Organization of Midget and Parasol Ganglion Cells in the Human Retina

The functional organization of diverse retinal ganglion cell (RGC) types, which shapes the visual signal transmitted to the brain, has been examined in many species. The unique spatial, temporal, and chromatic properties of the numerically dominant RGC types in macaque monkey retina are presumed to most accurately model human vision. However, the functional similarity between RGCs in macaques and humans has only begun to be tested, and recent work suggests possible differences. Here, the properties of the numerically dominant human RGC types were examined using large-scale multi-electrode recordings with fine-grained visual stimulation in isolated retina, and compared to results from dozens of recordings from macaque retina using the same experimental methods and conditions. The properties of four major human RGC types -- ON-parasol, OFF-parasol, ON-midget, and OFF-midget -- closely paralleled those of the same macaque RGC types, including the spatial and temporal light sensitivity, precisely coordinated mosaic organization of receptive fields, ON-OFF asymmetries, spatial response nonlinearity, and sampling of photoreceptor inputs over space. Putative smooth monostratified cells and polyaxonal amacrine cells were also identified based on similarities to cell types previously identified in macaque retina. The results suggest that recently proposed differences between human and macaque RGCs probably reflect experimental differences, and that the macaque model provides an accurate picture of human RGC function.

neuroscience↗