Search bioRxiv⌕ Search

Biology subjects

Roxin, A.

Publications and source records attributed to Roxin, A..

17 recordsLinked to original sources

Random network structure stabilizes neural manifolds

Neuronal activity patterns change continuously over days and weeks, a phenomenon known as representational drift. Despite this, the geometric structure of population representations, namely the pairwise similarities between stimulus-evoked activity patterns, remains remarkably stable. How can ongoing changes in activity be consistent with stable representational similarity? We show that this is a generic consequence of random connectivity: in networks with random connectivity, output similarity is a monotonically increasing function of input similarity, independent of the specific connectivity pattern. Drift, whether driven by random synaptic turnover or Hebbian plasticity, merely transitions the network between random instantiations, leaving similarity intact. This extends to recurrent architectures and to deep neural networks, where continued training beyond performance saturation produces activity drift while preserving representational similarity. Although connectivity in the brain is not random, networks trained on high-dimensional inputs acquire connectivity that behaves statistically like a random projection, making these results broadly applicable to biological neural circuits.

neuroscience↗

Locally balanced inhibition allows for robust learning of input-output associations in feedforward networks with Hebbian plasticity

In neural networks within the brain, the activity of a post-synaptic neuron is determined by the combined influence of many pre-synaptic neurons. This distributed processing enables mechanisms like Hebbian plasticity to associate sensory inputs with specific internal states, as seen in feedforward structures such as the CA1 region of the hippocampus. By modifying synaptic weights through Hebbian rules, sensory inputs can subsequently elicit outputs that consistently reflect their corresponding internal states. When input and output patterns are uncorrelated, this approach allows for the encoding of a large number of distinct associations, enabling efficient memory storage. Our study demonstrates a critical limitation when output patterns become weakly correlated with input patterns through the intrinsic feedforward networks connectivity. In these cases, the Hebbian rule preferentially strengthens synaptic weights shared across patterns, leading to a "freezing" of the networks structure. This results in highly correlated output patterns over time, effectively reducing the networks capacity to store diverse associations and limiting its flexibility in learning. To address this challenge, we find that including a mechanism of locally balanced inhibition, which has been shown to be a key feature of cortical circuits in-vivo, counteracts the undesired correlations between inputs and outputs. By dynamically regulating inhibitory input, locally balanced inhibition prevents the over-strengthening of shared weights, restoring the networks ability to maintain robust and flexible learning. This finding underscores the importance of inhibitory mechanisms in enabling efficient and adaptive information processing in neural circuits, offering insights into how biological networks maintain their remarkable capacity for associative learning.

neuroscience↗

Hebbian learning accounts for the effects of experience and novel exposure on representational drift in CA1 of hippocampus

Neuronal activity patterns slowly change over time even when sensory stimuli and animal behavior remain stable, a phenomenon known as representational drift. In area CA1 of the hippocampus, the amount of drift in the tuning of place cells on a familiar linear track is proportional to the time the animal spends exploring that track while the drift in cells mean rate depends on the absolute time elapsed between sessions. Recently it was shown that exploration of a novel, enriched environment between sessions on the familiar track actually decreases the drift in tuning on that track, i.e. it stabilizes place fields compared to a baseline condition without the novel learning. This finding challenges computational models of drift in which new learning leads to overwriting and hence one would expect more drift, not less. Here we show that such models are indeed compatible with the observed findings as long as spatially-tuned input populations to CA1 which are active on the track versus the enriched environment are largely non-overlapping. Furthermore, in order to reproduce the findings, we must assume that the total amount of learning between the baseline and novel-exposure conditions is the same. Namely, the synaptic resources available for encoding patterns, or episodes, is fixed over a given period of time, but can be preferentially allocated to episodes of particular salience, such as the exploration of novel environments.

neuroscience↗

Two-Phase Coding Strategy by CA1 Pyramidal Neurons: Linking Spatiotemporal Integration to Predictive Behavior

Space and time are fundamental components of memory, yet how the brain encodes these dimensions to guide behavior remains unclear. Using virtual-reality environments, we uncovered a two-phase neural code in hippocampus CA1 that represents time or distance through two functional pyramidal subpopulations, PyrUp and PyrDown. In Phase I, PyrUp activity synchronously increases to mark the initiation of encoding; In Phase II, their activity decays at heterogeneous, neuron-specific rates, creating a gradual divergence in across-population firing rates that scales with elapsed time. Conversely, PyrDown activity initially decreases before gradually rising. The crossover point, where rising PyrDown activity surpasses declining PyrUp activity, precedes predictive licking behavior. Combining optogenetics and computational modeling, we provided circuit-level evidence that PyrUp neurons primarily process locomotion-related inputs regulated by somatostatin-positive interneurons, whereas PyrDown neurons mainly receive reward-related inputs gated by parvalbumin-positive interneurons. These findings advance our understanding of how hippocampal circuits compute spatiotemporal information to inform behavior.

neuroscience↗

Representational drift as the consequence of ongoing memory storage

Memory systems with biologically constrained synapses have been the topic of intense theoretical study for over thirty years. Perhaps the most fundamental and far-reaching finding from this work is that the storage of new memories implies the partial erasure of already-stored ones. This overwriting leads to a decorrelation of sensory-driven activity patterns over time, even if the input patterns remain similar. Representational drift (RD) should therefore be an expected and inevitable consequence of ongoing memory storage. We tested this hypothesis by fitting a network model to data from long-term chronic calcium imaging experiments in mouse hippocampus. Synaptic turnover in the model inputs, consistent with the ongoing encoding of new activity patterns, accounted for the observed statistics of RD. This mechanism also provides a parsimonious explanation for the diverse effects of experience on drift found in experiment. Our results suggest that RD should be observed wherever neuronal circuits are involved in a process of ongoing learning or memory storage.

neuroscience↗

Rapid memory encoding in a recurrent network model with behavioral time scale synaptic plasticity

Episodic memories are formed after a single exposure to novel stimuli. The plasticity mechanisms underlying such fast learning still remain largely unknown. Recently, it was shown that cells in area CA1 of the hippocampus of mice could form or shift their place fields after a single traversal of a virtual linear track. In-vivo intracellular recordings in CA1 cells revealed that previously silent inputs from CA3 could be switched on when they occurred within a few seconds of a dendritic plateau potential (PP) in the post-synaptic cell, a phenomenon dubbed Behavioral Time-scale Plasticity (BTSP). A recently developed computational framework for BTSP in which the dynamics of synaptic traces related to the pre-synaptic activity and post-synaptic PP are explicitly modelled, can account for experimental findings. Here we show that this model of plasticity can be further simplified to simple map which describes changes to the synaptic weights after a single trial. The map can be solved analytically and provides a quantitative fit to experimental data from CA1. We use a temporally symmetric version of this map to study the storage of a large number of spatial memories in a recurrent network, such as CA3. Specifically, the simplicity of the map allows us to calculate the correlation of the synaptic weight matrix with any given past environment analytically. We show that the calculated memory trace can be used to predict the emergence and stability of bump attractors in a high dimensional neural network model endowed with BTSP. Author summaryA recently discovered form of in-vivo plasticity, called Behavioral Time-scale Plasticity (BTSP), leads to the generation of a place cell in CA1 from a previously silent cell after a single intracellular plateau potential (PP). We show that this one-shot learning process is well-described by a 1D map, which updates the synaptic weight matrix after the PP. We use the map to study the storage of spatial memories in a recurrent network, such as CA3. The map allows us to calculate the correlation of the weight matrix with all past explored environments analytically. When only a small fraction of cells are place cells in any given environment, we show that the full dynamics of a recurrent network endowed with BTSP is equivalent to its projection onto a series of weakly interacting manifolds, one for each environment. Interestingly, this weak interaction, which takes the form of quenched variability, actually enhances the memory capacity by stabilizing remote memories which otherwise would be unretrievable.

neuroscience↗

Network mechanisms underlying representational drift in area CA1 of hippocampus

Chronic imaging experiments in mice have revealed that the hippocampal code drifts over long time scales. Specifically, the subset of cells which are active on any given session in a familiar environment changes over the course of days and weeks. While some cells transition into or out of the code after a few sessions, others are stable over the entire experiment. Similar representational drift has also been observed in other cortical areas, raising the possibility of a common underlying mechanism, which, however, remains unknown. Here we show, through quantitative fitting of a network model to experimental data, that the statistics of representational drift in CA1 pyramidal cells are consistent with ongoing synaptic turnover in the main excitatory inputs to a neuronal circuit operating in the balanced regime. We find two distinct time-scales of drift: a fast shift in overall excitability with characteristic time-scale of two days, and a slower drift in spatially modulated input on the order of about one month. The observed heterogeneity in single-cell properties, including long-term stability, are explained by variability arising from random changes in the number of active inputs to cells from one session to the next. We furthermore show that these changes are, in turn, consistent with an ongoing process of learning via a Hebbian plasticity rule. We conclude that representational drift is the hallmark of a memory system which continually encodes new information.

neuroscience↗

Fluctuation-driven plasticity allows for flexible rewiring of neuronal assemblies

Synaptic connections in neuronal circuits are modulated by pre- and post-synaptic spiking activity. Heuristic models of this process of synaptic plasticity can provide excellent fits to results from in-vitro experiments in which pre- and post-synaptic spiking is varied in a controlled fashion. However, the plasticity rules inferred from fitting such data are inevitably unstable, in that given constant pre- and post-synaptic activity the synapse will either fully potentiate or depress. This instability can be held in check by adding additional mechanisms, such as homeostasis. Here we consider an alternative scenario in which the plasticity rule itself is stable. When this is the case, net potentiation or depression only occur when pre- and post-synaptic activity vary in time, e.g. when driven by time-varying inputs. We study how the features of such inputs shape the recurrent synaptic connections in models of neuronal circuits. In the case of oscillatory inputs, the resulting structure is strongly affected by the phase relationship between drive to different neurons. In large networks, distributed phases tend to lead to hierarchical clustering. Our results may be of relevance for understanding the effect of sensory-driven inputs, which are by nature time-varying, on synaptic plasticity, and hence on learning and memory.

neuroscience↗

Bump attractor dynamics underlying stimulus integration in perceptual estimation tasks

Perceptual decision and continuous stimulus estimation tasks involve making judgments based on accumulated sensory evidence. Network models of evidence integration usually rely on competition between neural populations each encoding a discrete categorical choice and do not maintain information that is necessary for a continuous perceptual judgement. Here, we show that a continuous attractor network can integrate a circular stimulus feature and track the stimulus average in the phase of its activity bump. We show analytically that the network can compute the running average of the stimulus almost optimally, and that the nonlinear internal dynamics affect the temporal weighting of sensory evidence. Whether the network shows early (primacy), uniform or late (recency) weighting depends on the relative strength of the stimuli compared to the bumps amplitude and initial state. The global excitatory drive, a single model parameter, modulates the specific relation between internal dynamics and sensory inputs. We show that this can account for the heterogeneity of temporal weighting profiles and reaction times observed in humans integrating a stream of oriented stimulus frames. Our findings point to continuous attractor dynamics as a plausible mechanism underlying stimulus integration in perceptual estimation tasks.

neuroscience↗

Flexible categorization in perceptual decision making

Perceptual decisions require the brain to make categorical choices based on accumulated sensory evidence. The underlying computations have been studied using either phenomenological drift diffusion models or neurobiological network models exhibiting winner-take-all attractor dynamics. Although both classes of models can account for a large body of experimental data, it remains unclear to what extent their dynamics are qualitatively equivalent. Here we show that, unlike the drift diffusion model, the attractor model can operate in different integration regimes: an increase in the stimulus fluctuations or the stimulus duration promotes transitions between decision-states leading to a crossover between weighting mostly early evidence (primacy regime) to weighting late evidence (recency regime). Between these two limiting cases, we found a novel regime, which we name flexible categorization, in which fluctuations are strong enough to reverse initial categorizations, but only if they are incorrect. This asymmetry in the reversing probability results in a non-monotonic psychometric curve, a novel and distinctive feature of the attractor model. Finally, we show psychophysical evidence for the crossover between integration regimes predicted by the attractor model and for the relevance of this new regime. Our findings point to correcting transitions as an important yet overlooked feature of perceptual decision making.

neuroscience↗

Drift-diffusion models for multiple-alternative forced-choice decision making

The canonical computational model for the cognitive process underlying two-alternative forced-choice decision making is the so-called drift-diffusion model (DDM). In this model, a decision variable keeps track of the integrated difference in sensory evidence for two competing alternatives. Here I extend the notion of a drift-diffusion process to multiple alternatives. The competition between n alternatives takes place in a linear subspace of n-1 dimensions; that is, there are n-1 decision variables, which are coupled through correlated noise sources. I derive the multiple-alternative DDM starting from a system of coupled, linear firing rate equations. If the original neuronal system is nonlinear, one can once again derive a model describing a lower dimensional diffusion process. The dynamics of the nonlinear DDM can be recast as the motion of a particle on a potential, the general form of which is given analytically for an arbitrary number of alternatives.

neuroscience↗

Firing rate distributions in spiking networks with heterogeneous connectivity

Meanfield theory for networks of spiking neurons based on the so-called diffusion approximation has been used to calculate certain measures of neuronal activity which can be compared with experimental data. This includes the distribution of firing rates across the network. However, the theory in its current form applies only to networks in which there is relatively little heterogeneity in the number of incoming and outgoing connections per neuron. Here we extend this theory to include networks with arbitrary degree distributions. Furthermore, the theory takes into account correlations in the in-degree and out-degree of neurons, which would arise e.g. in the case of networks with hub-like neurons. Finally, we show that networks with broad and postively correlated degrees can generate a large-amplitude sustained response to transient stimuli which does not occur in more homogeneous networks.

neuroscience↗

Network mechanisms underlying the role of oscillations in cognitive tasks

Oscillatory activity robustly correlates with task demands during many cognitive tasks. However, not only are the network mechanisms underlying the generation of these rhythms poorly understood, but it is also still unknown to what extent they may play a functional role, as opposed to being a mere epiphenomenon. Here we study the mechanisms underlying the influence of oscillatory drive on network dynamics related to cognitive processing in simple working memory (WM), and memory recall tasks. Specifically, we investigate how the frequency of oscillatory input interacts with the intrinsic dynamics in networks of recurrently coupled spiking neurons to cause changes of state: the neuronal correlates of the corresponding cognitive process. We find that slow oscillations, in the delta and theta band, are effective in activating network states associated with memory recall by virtue of the hysteresis in sweeping through a saddle-node bifurcation. On the other hand, faster oscillations, in the beta range, can serve to clear memory states by resonantly driving transient bouts of spike synchrony which destabilize the activity. We leverage a recently derived set of exact mean-field equations for networks of quadratic integrate-and-fire neurons to systematically study the bifurcation structure in the periodically forced spiking network. Interestingly, we find that the oscillatory signals which are most effective in allowing flexible switching between network states are not smooth, pure sinusoids, but rather burst-like, with a sharp onset. We show that such periodic bursts themselves readily arise spontaneously in networks of excitatory and inhibitory neurons, and that the burst frequency can be tuned via changes in tonic drive. Finally, we show that oscillations in the gamma range can actually stabilize WM states which otherwise would not persist.\n\nAuthor SummaryOscillations are ubiquitous in the brain and often correlate with distinct cognitive tasks. Nonetheless their role in shaping network dynamics, and hence in driving behavior during such tasks is poorly understood. Here we provide a comprehensive study of the effect of periodic drive on neuronal networks exhibiting multistability, which has been invoked as a possible circuit mechanism underlying the storage of memory states. We find that oscillatory drive in low frequency bands leads to robust switching between stored patterns in a Hopfield-like model, while oscillations in the beta band suppress sustained activity altogether. Furthermore, inputs in the gamma band can lead to the creation of working-memory states, which otherwise do not exist in the absence of oscillatory drive.

neuroscience↗

Mean-Field Equations For Neuronal Networks With Arbitrary Degree Distributions

The emergent dynamics in networks of recurrently coupled spiking neurons depends on the interplay between single-cell dynamics and network topology. Most theoretical studies on network dynamics have assumed simple topologies, such as connections which are made randomly and independently with a fixed probability (Erdos-Renyi network) (ER), or all-to-all connected networks. However, recent findings from slice experiments suggest that the actual patterns of connectivity between cortical neurons are more structured than in the ER random network. Here we explore how introducing additional higher-order statistical structure into the connectivity can affect the dynamics in neuronal networks. Specifically, we consider networks in which the number of pre-synaptic and post-synaptic contacts for each neuron, the degrees, are drawn from a joint degree distribution. We derive mean-field equations for a single population of homogeneous neurons and for a network of excitatory and inhibitory neurons, where the neurons can have arbitrary degree distributions. Through analysis of the mean-field equations and simulation of networks of integrate-and-fire neurons, we show that such networks have potentially much richer dynamics than an equivalent ER network. Finally, we relate the degree distributions to so-called cortical motifs.

neuroscience↗

On The Structure Of Cortical Micro-Circuits Inferred From Small Sample Sizes

The structure in cortical micro-circuits deviates from what would be expected in a purely random network, which has been seen as evidence of clustering. To address this issue we sought to reproduce the non-random features of cortical circuits by considering several distinct classes of network topology, including clustered networks, networks with distance-dependent connectivity and those with broad degree distributions. To our surprise we found that all these qualitatively distinct topologies could account equally well for all reported non-random features, despite being easily distinguishable from one another at the network level. This apparent paradox was a consequence of estimating network properties given only small sample sizes. In other words, networks which differ markedly in their global structure can look quite similar locally. This makes inferring network structure from small sample sizes, a necessity given the technical difficulty inherent in simultaneous intracellular recordings, problematic. We found that a network statistic called the sample degree correlation (SDC) overcomes this difficulty. The SDC depends only on parameters which can be reliably estimated given small sample sizes, and is an accurate fingerprint of every topological family. We applied the SDC criterion to data from rat visual and somatosensory cortex and discovered that the connectivity was not consistent with any of these main topological classes. However, we were able to fit the experimental data with a more general network class, of which all previous topologies were special cases. The resulting network topology could be interpreted as a combination of physical spatial dependence and non-spatial, hierarchical clustering.\n\nSignificance StatementThe connectivity of cortical micro-circuits exhibits features which are inconsistent with a simple random network. Here we show that several classes of network models can account for this non-random structure despite qualitative differences in their global properties. This apparent paradox is a consequence of the small numbers of simultaneously recorded neurons in experiment: when inferred via small sample sizes many networks may be indistinguishable, despite being globally distinct. We develop a connectivity measure which successfully classifies networks even when estimated locally, with a few neurons at a time. We show that data from rat cortex is consistent with a network in which the likelihood of a connection between neurons depends on spatial distance and on non-spatial, asymmetric clustering.

neuroscience↗

A Model Of Plasticity-Dependent Network Activity In Rodent Hippocampus During Exploration Of Novel Environments

Place cells of the rodent hippocampus fire action potentials when the animal traverses a particular spatial location in a given environment. Therefore, for any given trajectory one will observe a repeatable sequence of place cell activations as the animal explores. Interestingly, when the animal is quiescent or sleeping, one can observe similar sequences of activation, although at a highly compressed rate, known as \"replays\". It is hypothesized that this replay underlies the process of memory consolidation whereby memories are \"transferred\" from hippocampus to cortex. However, it remains unclear how the memory of a particular environment is actually encoded in the place cell activity and what the mechanism for replay is. Here we study how plasticity during spatial exploration shapes the patterns of synaptic connectivity in model networks of place cells. Specifically, we show how plasticity leads to the emergence of patterns of activity which represent the spatial environment learned. These states become spontaneously active when the animal is quiescent, reproducing the phenomenology of replays. Interestingly, replay emerges most rapidly when place cell activity is modulated by an ongoing oscillation. The optimal oscillation frequency can be calculated analytically, is directly related to the plasticity rule, and for experimentally determined values of the plasticity window in rodent slices gives values in the theta range. A major prediction of this model is that the pairwise correlation of place cells which encode for neighboring locations should increase during initial exploration, leading up to the critical transition. We find such an increase in a population of simultaneously recorded CA1 pyramidal cells from a rat exploring a novel track. Furthermore, in a rat in which hippocampal theta is reduced through inactivation of the medial septum we find no such increase. Our model is the first to show how theta-modulation can speed up learning by facilitating the emergence of environment-specific network-wide patterns of synaptic connectivity in hippocampal circuits.

neuroscience↗

UP-DOWN cortical dynamics reflect state transitions in a bistable balanced network

In the idling brain, neuronal circuits often exhibit transitions between periods of sustained firing (UP state) and quiescence (DOWN state). Although these dynamics occur across multiple areas and behavioral conditions, the underlying mechanisms remain unclear. Here we analyze spontaneous population activity from the somatosensory cortex of urethane-anesthetized rats. We find that UP and DOWN periods are variable (i.e. non-rhythmic) and that the population rate shows no significant decay during UP periods. We build a network model of excitatory (E) and inhibitory (I) neurons that exhibits a new bistability between a quiescent state and a balanced state of arbitrarily low rate. Fluctuating inputs trigger state transitions. Adaptation in E cells paradoxically causes a marginal decay of E-rate but a marked decay of I-rate, a signature of balanced bistability that we validate experimentally. Our findings provide evidence of a bistable balanced network that exhibits non-rhythmic state transitions when the brain rests.

neuroscience↗