Biology subjects

Tolias, A. S.

Publications and source records attributed to Tolias, A. S..

31 records · Page 2Linked to original sources

bioRxiv2019

Binary and analog variation of synapses between cortical pyramidal neurons

Learning from experience depends at least in part on changes in neuronal connections. We present the largest map of connectivity to date between cortical neurons of a defined type (L2/3 pyramidal cells), which was enabled by automated analysis of serial section electron microscopy images with improved handling of image defects. We used the map to identify constraints on the learning algorithms employed by the cortex. Previous cortical studies modeled a continuum of synapse sizes (Arellano et al. 2007) by a log-normal distribution (Loewenstein, Kuras, and Rumpel 2011; de Vivo et al. 2017; Santuy et al. 2018). A continuum is consistent with most neural network models of learning, in which synaptic strength is a continuously graded analog variable. Here we show that synapse size, when restricted to synapses between L2/3 pyramidal cells, is well-modeled by the sum of a binary variable and an analog variable drawn from a log-normal distribution. Two synapses sharing the same presynaptic and postsynaptic cells are known to be correlated in size (Sorra and Harris 1993; Koester and Johnston 2005; Bartol et al. 2015; Kasthuri et al. 2015; Dvorkin and Ziv 2016; Bloss et al. 2018; Motta et al. 2019). We show that the binary variables of the two synapses are highly correlated, while the analog variables are not. Binary variation could be the outcome of a Hebbian or other synaptic plasticity rule depending on activity signals that are relatively uniform across neuronal arbors, while analog variation may be dominated by other influences. We discuss the implications for the stability-plasticity dilemma.

neuroscience↗

bioRxiv2019

Learning Divisive Normalization in Primary Visual Cortex

Divisive normalization (DN) is a prominent computational building block in the brain that has been proposed as a canonical cortical operation. Numerous experimental studies have verified its importance for capturing nonlinear neural response properties to simple, artificial stimuli, and computational studies suggest that DN is also an important component for processing natural stimuli. However, we lack quantitative models of DN that are directly informed by measurements of spiking responses in the brain and applicable to arbitrary stimuli. Here, we propose a DN model that is applicable to arbitrary input images. We test its ability to predict how neurons in macaque primary visual cortex (V1) respond to natural images, with a focus on nonlinear response properties within the classical receptive field. Our model consists of one layer of subunits followed by learned orientation-specific DN. It outperforms linear-nonlinear and wavelet-based feature representations and makes a significant step towards the performance of state-of-the-art convolutional neural network (CNN) models. Unlike deep CNNs, our compact DN model offers a direct interpretation of the nature of normalization. By inspecting the learned normalization pool of our model, we gained insights into a long-standing question about the tuning properties of DN that update the current textbook description: we found that within the receptive field oriented features were normalized preferentially by features with similar orientation rather than non-specifically as currently assumed. Author summaryDivisive normalization (DN) is a computational building block throughout sensory processing in the brain. We currently lack an understanding of what role this normalization mechanism plays when processing complex stimuli like natural images. Here, we use modern machine learning methods to build a general DN model that is directly informed by data from primary visual cortex (V1). Contrary to high-predictive deep learning models, our DN-based models parameters offer a straightforward interpretation of the nature of normalization. Within the receptive field, we found that neurons responding strongly to a specific orientation are preferentially normalized by other neurons that are highly active for similar orientations, rather than being normalized by all neurons as it is currently assumed by textbook models.

neuroscience↗

bioRxiv2019

A global map of orientation tuning in mouse visual cortex

In primates and most carnivores, neurons in primary visual cortex are spatially organized by their functional properties. For example, neurons with similar orientation preferences are grouped together in iso-orientation domains that smoothly vary over the cortical sheet. In rodents, on the other hand, neurons with different orientation preferences are thought to be spatially intermingled, a feature which has been termed \"salt-and-pepper\" organization. The apparent absence of any systematic structure in orientation tuning has been considered a defining feature of the rodent visual system for more than a decade, with broad implications for brain development, visual processing, and comparative neurophysiology. Here, we revisited this question using new techniques for wide-field two-photon calcium imaging that enabled us to collect nearly complete population tuning preferences in layers 2-4 across a large fraction of the mouse visual hierarchy. Examining the orientation tuning of these hundreds of thousands of neurons, we found a global map spanning multiple visual cortical areas in which orientation bias was organized around a single pinwheel centered in V1. This pattern was consistent across animals and cortical depth. The existence of this global organization in rodents has implications for our understanding of visual processing and the principles governing the ontogeny and phylogeny of the visual cortex of mammals.

neuroscience↗

bioRxiv2019

Inference of Synaptic Connectivity and External Variability in Neural Microcircuits

A major goal in neuroscience is to estimate neural connectivity from large scale extracellular recordings of neural activity in vivo. This is challenging in part because any such activity is modulated by the unmeasured external synaptic input to the network, known as the common input problem. Many different measures of functional connectivity have been proposed in the literature, but their direct relationship to synaptic connectivity is often assumed or ignored. For in vivo data, measurements of this relationship would require a knowledge of ground truth connectivity, which is nearly always unavailable. Instead, many studies use in silico simulations as benchmarks for investigation, but such approaches necessarily rely upon a variety of simplifying assumptions about the simulated network and can depend on numerous simulation parameters. We combine neuronal network simulations, mathematical analysis, and calcium imaging data to address the question of when and how functional connectivity, synaptic connectivity, and latent external input variability can be untangled. We show numerically and analytically that, even though the precision matrix of recorded spiking activity does not uniquely determine synaptic connectivity, it is often closely related to synaptic connectivity in practice under various network models. This relation becomes more pronounced when the spatial structure of neuronal variability is considered jointly with precision.

neuroscience↗

bioRxiv2019

Cell type composition and circuit organization of neocortical radial clones

SummaryExcitatory neurons arising from a common progenitor establish radially-oriented clonal units in the neocortex which have been proposed to serve as elementary information processing modules. To characterize the cell types and circuit diagram within these clonal units, we performed single-cell RNA-sequencing and multi-cell patch clamp recordings of neurons derived from Nestin-positive progenitors. We found that radial clones do not appear to be fate-restricted, but instead individual clones are composed of a random sampling of the transcriptomic cell types present in a particular cortical area. The effect of lineage on synaptic connectivity depends on the type of connection tested: pairs of clonally related neurons were more likely to be connected vertically, across cortical layers, but not laterally within the same layer, compared to unrelated pairs. We propose that integration of vertical input from related neurons with lateral input from unrelated neurons may represent a developmentally programmed motif for assembling neocortical circuits.

neuroscience↗

bioRxiv2019

Follicle-stimulating hormone and luteinizing hormone increase Ca2+ in the granulosa cells of mouse ovarian follicles

Summary sentenceBoth FSH and LH increase Ca2+ in the granulosa cells of intact ovarian follicles from mice expressing genetically encoded sensors.\n\nABSTRACTIn mammalian ovarian follicles, follicle stimulating hormone (FSH) and luteinizing hormone (LH) signal primarily through the G-protein Gs to elevate cAMP, but both of these hormones can also elevate Ca2+ under some conditions. Here we investigate FSH- and LH-induced Ca2+ signaling in intact follicles of mice expressing genetically encoded Ca2+ sensors, Twitch-2B and GCaMP6s. At a physiological concentration (1 nM), FSH elevates Ca2+ within the granulosa cells of preantral and antral follicles. The Ca2+ rise begins several minutes after FSH application, peaks at ~10 minutes, remains above baseline for another ~10 minutes, and depends on extracellular Ca2+. However, suppression of the FSH-induced Ca2+ increase by reducing extracellular Ca2+ does not inhibit FSH-induced phosphorylation of MAP kinase, estradiol production, or the acquisition of LH responsiveness. Like FSH, LH also increases Ca2+, when applied to preovulatory follicles. At a physiological concentration (10 nM), LH elicits Ca2+ oscillations in a subset of cells in the outer mural granulosa layer. These oscillations continue for at least 6 hours and depend on the activity of Gq family G-proteins. Suppression of the oscillations by Gq inhibition does not inhibit meiotic resumption, but does slightly attenuate ovulation. In summary, both FSH and LH increase Ca2+ in the granulosa cells of intact follicles, but the functions of these Ca2+ rises are only starting to be identified.

cell biology↗

bioRxiv2018

Inception in visual cortex: in vivo-silico loops reveal most exciting images

Much of our knowledge about sensory processing in the brain is based on quasi-linear models and the stimuli that optimally drive them. However, sensory information processing is nonlinear, even in primary sensory areas, and optimizing sensory input is difficult due to the high-dimensional input space. We developed inception loops, a closed-loop experimental paradigm that combines in vivo recordings with in silico nonlinear response modeling to identify the Most Exciting Images (MEIs) for neurons in mouse V1. When presented back to the brain, MEIs indeed drove their target cells significantly better than the best stimuli identified by linear models. The MEIs exhibited complex spatial features that deviated from the textbook ideal of V1 as a bank of Gabor filters. Inception loops represent a widely applicable new approach to dissect the neural mechanisms of sensation.

neuroscience↗

bioRxiv2018

Neocortical layer 4 in adult mouse differs in major cell types and circuit organization between primary sensory areas

Layer 4 (L4) of mammalian neocortex plays a crucial role in cortical information processing, yet a complete census of its cell types and connectivity remains elusive. Using whole-cell recordings with morphological recovery, we identified one major excitatory and seven inhibitory types of neurons in L4 of adult mouse visual cortex (V1). Nearly all excitatory neurons were pyramidal and almost all Somatostatin-positive (SOM+) neurons were Martinotti cells. In contrast, in somatosensory cortex (S1), excitatory cells were mostly stellate and SOM+ cells were non-Martinotti. These morphologically distinct SOM+ interneurons correspond to different transcriptomic cell types and are differentially integrated into the local circuit with only S1 cells receiving local excitatory input. Our results challenge the classical view of a canonical microcircuit repeated through the neocortex. Instead we propose that cell-type specific circuit motifs, such as the Martinotti/pyramidal pair, are optionally used across the cortex as building blocks to assemble cortical circuits.

neuroscience↗

bioRxiv2018

Stimulus domain transfer in recurrent models for large scale cortical population prediction on video

To better understand the representations in visual cortex, we need to generate better predictions of neural activity in awake animals presented with their ecological input: natural video. Despite recent advances in models for static images, models for predicting responses to natural video are scarce and standard linear-nonlinear models perform poorly. We developed a new deep recurrent network architecture that predicts inferred spiking activity of thousands of mouse V1 neurons simulta-neously recorded with two-photon microscopy, while accounting for confounding factors such as the animals gaze position and brain state changes related to running state and pupil dilation. Powerful system identification models provide an opportunity to gain insight into cortical functions through in silico experiments that can subsequently be tested in the brain. However, in many cases this approach requires that the model is able to generalize to stimulus statistics that it was not trained on, such as band-limited noise and other parameterized stimuli. We investigated these domain transfer properties in our model and find that our model trained on natural images is able to correctly predict the orientation tuning of neurons in responses to artificial noise stimuli. Finally, we show that we can fully generalize from movies to noise and maintain high predictive performance on both stimulus domains by fine-tuning only the final layers weights on a network otherwise trained on natural movies. The converse, however, is not true.

neuroscience↗

bioRxiv2018

A neural basis of probabilistic computation in visual cortex

Bayesian models of behavior suggest that organisms represent uncertainty associated with sensory variables. However, the neural code of uncertainty remains elusive. A central hypothesis is that uncertainty is encoded in the population activity of cortical neurons in the form of likelihood functions. We studied the neural code of uncertainty by simultaneously recording population activity from the primate visual cortex during a visual categorization task in which trial-to-trial uncertainty about stimulus orientation was relevant for the decision. We decoded the likelihood function from the trial-to-trial population activity and found that it predicted decisions better than a point estimate of orientation. This remained true when we conditioned on the true orientation, suggesting that internal fluctuations in neural activity drive behaviorally meaningful variations in the likelihood function. Our results establish the role of population-encoded likelihood functions in mediating behavior, and provide a neural underpinning for Bayesian models of perception.

neuroscience↗

bioRxiv2017

Deep convolutional models improve predictions of macaque V1 responses to natural images

Despite great efforts over several decades, our best models of primary visual cortex (V1) still predict spiking activity quite poorly when probed with natural stimuli, highlighting our limited understanding of the nonlinear computations in V1. Recently, two approaches based on deep learning have been successfully applied to neural data: On the one hand, transfer learning from networks trained on object recognition worked remarkably well for predicting neural responses in higher areas of the primate ventral stream, but has not yet been used to model spiking activity in early stages such as V1. On the other hand, data-driven models have been used to predict neural responses in the early visual system (retina and V1) of mice, but not primates. Here, we test the ability of both approaches to predict spiking activity in response to natural images in V1 of awake monkeys. Even though V1 is rather at an early to intermediate stage of the visual system, we found that the transfer learning approach performed similarly well to the data-driven approach and both outperformed classical linear-nonlinear and wavelet-based feature representations that build on existing theories of V1. Notably, transfer learning using a pre-trained feature space required substantially less experimental time to achieve the same performance. In conclusion, multi-layer convolutional neural networks (CNNs) set the new state of the art for predicting neural responses to natural images in primate V1 and deep features learned for object recognition are better explanations for V1 computation than all previous filter bank theories. This finding strengthens the necessity of V1 models that are multiple nonlinearities away from the image domain and it supports the idea of explaining early visual cortex based on high-level functional goals.\n\nAuthor summaryPredicting the responses of sensory neurons to arbitrary natural stimuli is of major importance for understanding their function. Arguably the most studied cortical area is primary visual cortex (V1), where many models have been developed to explain its function. However, the most successful models built on neurophysiologists intuitions still fail to account for spiking responses to natural images. Here, we model spiking activity in primary visual cortex (V1) of monkeys using deep convolutional neural networks (CNNs), which have been successful in computer vision. We both trained CNNs directly to fit the data, and used CNNs trained to solve a high-level task (object categorization). With these approaches, we are able to outperform previous models and improve the state of the art in predicting the responses of early visual neurons to natural images. Our results have two important implications. First, since V1 is the result of several nonlinear stages, it should be modeled as such. Second, functional models of entire visual pathways, of which V1 is an early stage, do not only account for higher areas of such pathways, but also provide useful representations for V1 predictions.

neuroscience↗

bioRxiv2017

Attentional fluctuations induce shared variability in macaque primary visual cortex

Variability in neuronal responses to identical stimuli is frequently correlated across a population. Attention is thought to reduce these correlations by suppressing noisy inputs shared by the population. However, even with precise control of the visual stimulus, the subjects attentional state varies across trials. While these state fluctuations are bound to induce some degree of correlated variability, it is currently unknown how strong their effect is, as previous studies generally do not dissociate changes in attentional strength from changes in attentional state variability. We designed a novel paradigm that does so and find both a pronounced effect of attentional fluctuations on correlated variability at long timescales and attention-dependent reductions in correlations at short timescales. These effects predominate in layers 2/3, as expected from a feedback signal such as attention. Thus, significant portions of correlated variability can be attributed to fluctuations in internally generated signals, like attention, rather than noise.

neuroscience↗

bioRxiv2017

Community-based benchmarking improves spike inference from two-photon calcium imaging data

In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations1, 2. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators3. Different algorithms for estimating spike trains from noisy calcium measurements have been proposed in the past4-8, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

neuroscience↗