Search bioRxiv⌕ Search

Biology subjects

Clopath, C.

Publications and source records attributed to Clopath, C..

At least 37 records · Page 2Linked to original sources

Credit Assignment via Behavioral Timescale Synaptic Plasticity: Theoretical Frameworks

Behavioral Timescale Synaptic Plasticity (BTSP) is a form of synaptic plasticity in which dendritic Ca2+ plateau potentials in hippocampal pyramidal neurons drive rapid place field formation. Unlike traditional learning rules, BTSP learns correlations on the timescales of seconds and rapidly changes single-unit activity in only a few trials. To explore how BTSP-like learning can be integrated into network models, we propose a generalized BTSP rule (gBTSP), which we apply to unsupervised and supervised learning tasks, in both feedforward and recurrent networks. Unsupervised gBTSP mirrors classical frameworks of competitive learning, learning place field maps (in the feed-forward case), and attractive memory networks (in the recurrent case). For supervised learning, we show that plateau events can reduce task error, enabling gBTSP to solve tasks such as trajectory matching and delayed non-match-to-sample. However, we find that credit assignment via gBTSP becomes harder to achieve with increased network depth or CA3-like recurrence. This suggests that additional features may be needed to support BTSP-mediated few-shot learning of complex tasks in the hippocampus.

neuroscience↗

Neural signatures of motor memories emerge in neural network models

Animals can learn and seamlessly perform a great number of behaviors. However, it is unclear how neural activity can accommodate new behaviors without interfering with those an animal has already acquired. Recent studies in monkeys performing motor and brain-computer interface (BCI) learning tasks have identified neural signatures--so-called "memory traces" and "uniform shifts"--that appear in the neural activity of a familiar task after learning a new task. Here we asked when these signatures arise and how they are related to continual learning. By modeling a BCI learning paradigm, we show that both signatures emerge naturally as a consequence of learning, without requiring a specific mechanism. In general, memory traces and uniform shifts reflected savings by capturing how information from different tasks coexisted in the same neural activity patterns. Yet, although the properties of these two different signatures were both indicative of savings, they were uncorrelated with each other. When we added contextual inputs that separated the activity for the different tasks, these signatures decreased even when savings were maintained, demonstrating the challenges of defining a clear relationship between neural activity changes and continual learning.

neuroscience↗

SIMPL: Scalable and hassle-free optimization of neural representations from behaviour

Neural activity in the brain is known to encode low-dimensional, time-evolving, behaviour-related variables. A long-standing goal of neural data analysis has been to identify these variables and their mapping to neural activity. A productive and canonical approach has been to simply visualise neural "tuning curves" as a function of behaviour. In reality, significant discrepancies between behaviour and the true latent variables--such as an agent thinking of position Y whilst located at position X--distort and blur the tuning curves, decreasing their interpretability. To address this, latent variable models propose to learn the latent variable from data; these are typically expensive, hard to tune, or scale poorly, complicating their adoption. Here we propose SIMPL (Scalable Iterative Maximization of Population-coded Latents), an EM-style algorithm which iteratively optimises latent variables and tuning curves. SIMPL is fast, scalable and exploits behaviour as an initial condition to further improve convergence and identifiability. It can accurately recover latent variables in spatial and non-spatial tasks. When applied to a large hippocampal dataset SIMPL converges on smaller, more numerous, and more uniformly sized place fields than those based on behaviour, suggesting the brain may encode space with greater resolution than previously thought.

neuroscience↗

Overwriting an instinct: visual cortex instructs learning to suppress fear responses

Fast instinctive responses to environmental stimuli can be crucial for survival, but are not always optimal. Based on prior experience, animals can thus adapt their behavior and suppress instinctive reactions. However, the neural pathways mediating such ethologically relevant forms of learning remain unclear. We show that posterolateral higher visual areas (plHVAs) are crucial for learning to suppress escapes from innate visual threats through a top-down pathway involving the ventrolateral geniculate nucleus (vLGN). plHVAs are no longer necessary after learning: instead, the learnt behavior relies on plasticity within vLGN populations that exert inhibitory control over fear responses. vLGN neurons receiving input from plHVAs enhance their responses to visual threat stimuli during learning through endocannabinoid-mediated long-term suppression of their inhibitory inputs. We thus reveal the detailed circuit, cellular and synaptic mechanisms underlying experience-dependent suppression of fear responses through a novel corticofugal pathway.

neuroscience↗

Taming the chaos gently: a Predictive Alignment learning rule in recurrent neural networks

Recurrent neural circuits often face inherent complexities in learning and generating their desired outputs, especially when they initially exhibit chaotic spontaneous activity. While the celebrated FORCE learning rule can train chaotic recurrent networks to produce coherent patterns by suppressing chaos, it requires non-local plasticity rules and extremely quick plasticity, raising the question of how synapses adapt on local, biologically plausible timescales to handle potential chaotic dynamics. We propose a novel framework called "Predictive Alignment", which tames the chaotic recurrent dynamics to generate a variety of patterned activities via a biologically plausible plasticity rule. Unlike most recurrent learning rules, predictive alignment does not aim to directly minimize output error to train recurrent connections, but rather it tries to efficiently suppress chaos by aligning recurrent prediction with chaotic activity. We show that the proposed learning rule can perform supervised learning of multiple target signals, including complex low-dimensional attractors, delay matching tasks that require short-term temporal memory, and finally even dynamic movie clips with high-dimensional pixels. Our findings shed light on how predictions in recurrent circuits can support learning.

neuroscience↗

Movie reconstruction from mouse visual cortex activity

The ability to reconstruct images represented by the brain has the potential to give us an intuitive understanding of what the brain sees. Reconstruction of visual input from human fMRI data has garnered significant attention in recent years. Comparatively less focus has been directed towards vision reconstruction from single-cell recordings, despite its potential to provide a more direct measure of the information represented by the brain. Here, we achieve high-quality reconstructions of natural movies presented to mice, from the activity of neurons in their visual cortex for the first time. Using our method of video optimization via backpropagation through a state-of-the-art dynamic neural encoding model we reliably reconstruct 10-second movies at 30 Hz from two-photon calcium imaging data. We achieve a pixel-level correction of 0.57 between the ground truth movie and the reconstructions from single-trial neural responses. We find that critical for high-quality reconstructions are the number of neurons in the dataset and the use of model ensembling. This paves the way for movie reconstruction to be used as a tool to investigate a variety of visual processing phenomena.

neuroscience↗

Flexible integration of natural stimuli by auditory cortical neurons

Neurons have rich input-output functions for processing and combining their inputs. Although many experiments characterize these functions by directly activating synaptic inputs on dendrites in vitro, the integration of spatiotemporal inputs representing real-world stimuli is less well studied. Using ethologically relevant stimuli, we study neuronal integration in relation to Boolean AND and OR operations thought to be important for pattern recognition. We recorded single-unit responses in the mouse auditory cortex to pairs of ultrasonic mouse vocalization (USV) syllables. We observed a range of integration responses, spanning the sublinear to supralinear regimes, with many responses resembling the MAX-like function, an instantiation of the OR operation. Integration was more MAX-like for strongly activating features, and more AND-like for spectrally distinct inputs. Importantly, single neurons could implement more than one integration function, in contrast to artificial networks which typically fix activation functions across all units and inputs. To understand the mechanism underlying the flexibility and heterogeneity in neuronal integration, we modelled how dendritic properties could influence the integration of inputs with complex spectrotemporal structure. Our results link nonlinear integration in dendrites to single-neuron computations for pattern recognition. Significance statementSensory neurons compute over their inputs, combining them in ways to achieve selectivity and invariance for pattern recognition. Using real-world stimuli, we show that single cortical neurons are flexible, being capable of implementing more than one computation, unlike artificial neural-network units with fixed activation functions. We investigate this flexibility by modeling how synaptic activation patterns of real-world stimuli affect dendritic integration and the resultant neuronal computation. Our work bridges the gap between biophysical mechanisms and computation, linking neuronal input integration to pattern recognition.

neuroscience↗

Knowing what you don't know: Estimating the uncertainty of feedforward and feedback inputs with prediction-error circuits

At any moment, our brains receive a stream of sensory stimuli arising from the world we interact with. Simultaneously, neural circuits are shaped by feedback signals carrying predictions about the same inputs we experience. Those feedforward and feedback inputs often do not perfectly match. Thus, our brains have the challenging task of integrating these conflicting streams of information according to their reliabilities. However, how neural circuits keep track of both the stimulus and prediction uncertainty is not well understood. Here, we propose a network model whose core is a hierarchical prediction-error circuit. We show that our network can estimate the variance of the sensory stimuli and the uncertainty of the prediction using the activity of negative and positive prediction-error neurons. In line with previous hypotheses, we demonstrate that neural circuits rely strongly on feedback predictions if the perceived stimuli are noisy and the underlying generative process, that is, the environment is stable. Moreover, we show that predictions modulate neural activity at the onset of a new stimulus, even if this sensory information is reliable. In our network, the uncertainty estimation, and, hence, how much we rely on predictions, can be influenced by perturbing the intricate interplay of different inhibitory interneurons. We, therefore, investigate the contribution of those inhibitory interneurons to the weighting of feedforward and feedback inputs. Finally, we show that our network can be linked to biased perception and unravel how stimulus and prediction uncertainty contribute to the contraction bias.

neuroscience↗

A generative model of the hippocampal formation trained with theta driven local learning rules

Advances in generative models have recently revolutionised machine learning. Meanwhile, in neuroscience, generative models have long been thought fundamental to animal intelligence. Understanding the biological mechanisms that support these processes promises to shed light on the relationship between biological and artificial intelligence. In animals, the hippocampal formation is thought to learn and use a generative model to support its role in spatial and non-spatial memory. Here we introduce a biologically plausible model of the hippocampal formation tantamount to a Helmholtz machine that we apply to a temporal stream of inputs. A novel component of our model is that fast theta-band oscillations (5-10 Hz) gate the direction of information flow throughout the network, training it akin to a high-frequency wake-sleep algorithm. Our model accurately infers the latent state of high-dimensional sensory environments and generates realistic sensory predictions. Furthermore, it can learn to path integrate by developing a ring attractor connectivity structure matching previous theoretical proposals and flexibly transfer this structure between environments. Whereas many models trade-off biological plausibility with generality, our model captures a variety of hippocampal cognitive functions under one biologically plausible local learning rule.

neuroscience↗

Entorhinal cortex glutamatergic and GABAergic projections bidirectionally control discrimination and generalization of hippocampal representations

Discrimination and generalization are crucial brain-wide functions for memory and object recognition that utilize pattern separation and completion computations. Circuit mechanisms supporting these operations remain enigmatic. We show lateral entorhinal cortex glutamatergic (LECGLU) and GABAergic (LECGABA) projections are essential for object recognition memory. Silencing LECGLU during in vivo two-photon imaging increased the population of active CA3 pyramidal cells but decreased activity rates, suggesting a sparse coding function through local inhibition. Silencing LECGLU also decreased place cell remapping between different environments validating this circuit drives pattern separation and context discrimination. Optogenetic circuit mapping confirmed that LECGLU drives dominant feedforward inhibition to prevent CA3 somatic and dendritic spikes. However, conjunctively active LECGABA suppresses this local inhibition to disinhibit CA3 pyramidal neuron soma and selectively boost integrative output of LEC and CA3 recurrent network. LECGABA thus promotes pattern completion and context generalization. Indeed, without this disinhibitory input, CA3 place maps show decreased similarity between contexts. Our findings provide circuit mechanisms whereby long-range glutamatergic and GABAergic cortico-hippocampal inputs bidirectionally modulate pattern separation and completion, providing neuronal representations with a dynamic range for context discrimination and generalization.

neuroscience↗

Functional networks of inhibitory neurons orchestrate synchrony in the hippocampus

Inhibitory interneurons are pivotal components of cortical circuits. Beyond providing inhibition, they have been proposed to coordinate the firing of excitatory neurons within cell assemblies. While the roles of specific interneuron subtypes have been extensively studied, their influence on pyramidal cell synchrony in vivo remains elusive. Employing an all-optical approach, we simultaneously recorded hippocampal interneurons and pyramidal cells and probed the network influence of individual interneurons using optogenetics. We demonstrate that CA1 interneurons form a functionally interconnected network that promotes synchrony through disinhibition during awake immobility, while preserving endogenous cell assemblies. Our network model underscores the importance of both cell assemblies and dense, unspecific interneuron connectivity in explaining our experimental findings, suggesting that interneurons may operate not only via division of labor but also through concerted activity.

neuroscience↗

Learning with filopodia and spines

Filopodia are thin synaptic protrusions that have been long known to play an important role in early development. It has recently been found that they are more abundant in the adult cortex than previously thought, and more plastic than spines (button-shaped mature synapses). Inspired by these findings, we introduce a new model of synaptic plasticity that jointly describes learning of filopodia and spines. The model assumes that filopodia exhibit additive learning, which is highly competitive and volatile. At the same time, it proposes that if filopodia undergo sufficient potentiation they consolidate into spines, and start following multiplicative learning dynamics. This makes spines more stable and sensitive to the fine structure of input correlations. We show that our learning rule has a selectivity comparable to additive spike-timing-dependent plasticity (STDP) and represents input correlations as well as multiplicative STDP. We also show how it can protect previously formed memories and act as a synaptic consolidation mechanism. Overall, our results provide a mechanistic explanation of how filopodia and spines could cooperate to overcome the difficulties that these separate forms of learning (additive and multiplicative) each have. Author SummaryChanges in the strength of synaptic connections between neurons are the basis of learning in biological and artificial networks. In animals, these changes can only depend on locally available signals, and are usually modeled with learning rules. Based on recent discoveries on filopodia, a special type of synaptic structure, we propose a new learning rule called Filopodium-Spine spike-timing-dependent-plasticity. Our rule proposes that filopodia follow additive STDP and spines (mature synapses) multiplicative STDP. We show that our model overcomes classic difficulties that these learning rules have separately, like the absence of stability or specificity, and can also be seen as a first stage of synaptic consolidation.

neuroscience↗

Learning predictive signals within a local recurrent circuit

The predictive coding hypothesis proposes that top-down predictions are compared with incoming bottom-up sensory information, with prediction errors signaling the discrepancies between these inputs. While this hypothesis explains the presence of prediction errors, recent experimental studies suggest that prediction error signals can emerge within a local circuit, that is, from bottom-up sensory input alone. In this paper, we test whether local circuits alone can generate predictive signals by training a recurrent spiking network using local plasticity rules. Our network model replicates prediction errors resembling various experimental results, such as a biphasic pattern of prediction errors and context-specific representation of error signals. Our findings shed light on how synaptic plasticity can shape prediction errors and enables the acquisition and updating of an internal model of sensory input within a recurrent neural network.

neuroscience↗

De novo motor learning creates structure in neural activity space that shapes adaptation

Animals can quickly adapt learned movements in response to external perturbations. Motor adaptation is likely influenced by an animals existing movement repertoire, but the nature of this influence is unclear. Long-term learning causes lasting changes in neural connectivity which determine the activity patterns that can be produced. Here, we sought to understand how a neural populations activity repertoire, acquired through long-term learning, affects short-term adaptation by modeling motor cortical neural population dynamics during de novo learning and subsequent adaptation using recurrent neural networks. We trained these networks on different motor repertoires comprising varying numbers of movements. Networks with multiple movements had more constrained and robust dynamics, which were associated with more defined neural structure--organization created by the neural population activity patterns corresponding to each movement. This structure facilitated adaptation, but only when small changes in motor output were required, and when the structure of the network inputs, the neural activity space, and the perturbation were congruent. These results highlight trade-offs in skill acquisition and demonstrate how prior experience and external cues during learning can shape the geometrical properties of neural population activity as well as subsequent adaptation.

neuroscience↗

Embedding stochastic dynamics of the environment in spontaneous activity by prediction-based plasticity

The brain learns an internal model of the environment through sensory experiences, which is essential for high-level cognitive processes. Recent studies show that spontaneous activity reflects such learned internal model. Although computational studies have proposed that Hebbian plasticity can learn the switching dynamics of replayed activities, it is still challenging to learn dynamic spontaneous activity that obeys the statistical properties of sensory experience. Here, we propose a pair of biologically plausible plasticity rules for excitatory and inhibitory synapses in a recurrent spiking neural network model to embed stochastic dynamics in spontaneous activity. The proposed synaptic plasticity rule for excitatory synapses seeks to minimize the discrepancy between stimulus-evoked and internally predicted activity, while inhibitory plasticity maintains the excitatory-inhibitory balance. We show that the spontaneous reactivation of cell assemblies follows the transition statistics of the models evoked dynamics. We also demonstrate that simulations of our model can replicate recent experimental results of spontaneous activity in songbirds, suggesting that the proposed plasticity rule might underlie the mechanism by which animals learn internal models of the environment.

neuroscience↗

Latent Representations in Hippocampal Network Model Co-Evolve with Behavioral Exploration of Task Structure

Real-life behavioral tasks are often complex and depend on abstract combinations of sensory stimuli and internal logic. To successfully learn these tasks, animals must pair actions or decisions to the tasks complex structure. The hippocampus has been shown to contain fields which represent complex environmental and task variables, including place, lap, evidence accumulation, etc. Altogether, these representations have been hypothesized to form a "cognitive map" which encodes the complex real-world structure underlying behavior. However, it is still unclear how biophysical plasticity mechanisms at the single cell level can lead to the population-wide evolution of task-relevant maps. In this work we present a biophysically plausible model comprised of a recurrent hippocampal network and an action network, in which the latent representational structure co-evolves with behavior in a task-dependent manner. We demonstrate that the network develops latent structures that are needed for solving the task and does not integrate latent structures which do not support task learning. We show that, in agreement with experimental data, cue-dependent "splitters" can only be induced at the single cell level if the task requires a split representation to solve. Finally, our model makes specific predictions on how biases in behavior result from experimentally testable biases in the underlying latent representation.

neuroscience↗

Drift of neural ensembles driven by slow fluctuations of intrinsic excitability

Representational drift refers to the dynamic nature of neural representations in the brain despite the behavior being seemingly stable. Although drift has been observed in many different brain regions, the mechanisms underlying it are not known. Since intrinsic neural excitability is suggested to play a key role in regulating memory allocation, fluctuations of excitability could bias the reactivation of previously stored memory ensembles and therefore act as a motor for drift. Here, we propose a rate-based plastic recurrent neural network with slow fluctuations of intrinsic excitability. We first show that subsequent reactivations of a neural ensemble can lead to drift of this ensemble. The model predicts that drift is induced by co-activation of previously active neurons along with neurons with high excitability which leads to remodeling of the recurrent weights. Consistent with previous experimental works, the drifting ensemble is informative about its temporal history. Crucially, we show that the gradual nature of the drift is necessary for decoding temporal information from the activity of the ensemble. Finally, we show that the memory is preserved and can be decoded by an output neuron having plastic synapses with the main region.

neuroscience↗

Synaptic weights that correlate with presynaptic selectivity increase decoding performance

The activity of neurons in the visual cortex is often characterized by tuning curves, which are thought to be shaped by Hebbian plasticity during development and sensory experience. This leads to the prediction that neural circuits should be organized such that neurons with similar functional preference are connected with stronger weights. In support of this idea, previous experimental and theoretical work have provided evidence for a model of the visual cortex characterized by such functional subnetworks. A recent experimental study, however, have found that the postsynaptic preferred stimulus was defined by the total number of spines activated by a given stimulus and independent of their individual strength. While this result might seem to contradict previous literature, there are many factors that define how a given synaptic input influences postsynaptic selectivity. Here, we designed a computational model in which postsynaptic functional preference is defined by the number of inputs activated by a given stimulus. Using a plasticity rule where synaptic weights tend to correlate with presynaptic selectivity, and is independent of functional-similarity between pre- and postsynaptic activity, we find that this model can be used to decode presented stimuli in a manner that is comparable to maximum likelihood inference.

neuroscience↗