Search bioRxiv⌕ Search

Biology subjects

Confavreux, B.

Publications and source records attributed to Confavreux, B..

6 recordsLinked to original sources

Learning to play with spikes: characterizing, predicting, and engineering unsupervised plasticity rules for spiking reservoir computing

Spiking reservoir computing, and reservoir computing more generally, is a powerful and efficient framework for neuromorphic and biological applications, in which a fixed random reservoir drives a trained readout. Its performance depends critically on the reservoir initialization, so that enriching the reservoir with adaptive, unsupervised plasticity rules offers a natural solution to this limitation. However, it is unclear which rules work, or why, and how to find the best-suited rules for specific tasks without exhaustive and expensive search. Here, we learn how to play the Atari game Pong in a plastic spiking reservoir network. We systematically characterize a large family of local plasticity rules that were meta-learned in prior work. We then show that their performance is predictable and structured: high-scoring rules are characterized by strong differentiation between neurons encoding the ball trajectory and the background, with stable weight dynamics, and consistent readout alignment across time. These mechanistic signatures are not task-specific and transfer to a delayed-match recognition task. Rule performance can be estimated from rule parameters alone. Finally, conditioning simulation-based inference (SBI) on high scores allows us to sample directly from promising regions of the rule space, to discover rules that exceed the performance of those found in the prior distribution and reveal stable, high-performing configurations. Together, these results offer competitive performance against classical reservoir computing while providing a transparent, interpretable account of what makes a plasticity rule useful for neuromorphic hardware and biological computing.

neuroscience↗

Ingrams for engrams: co-active inhibitory-inhibitory plasticity shapes inhibitory assemblies that stabilize and recall embedded engrams through disinhibition

Inhibitory neurons have been widely understood to play a supporting role in neural function and memory formation, but recent advances highlight that memories are encoded by both excitatory and inhibitory neurons (EI assemblies), carving out a bigger role for inhibition beyond mere stabilization. However, the computations enabled by such EI assemblies are still unclear, and the synaptic plasticity rules that could sustain and retrieve memories are unknown. Here, we construct a computational model for EI assembly recall and investigate the computational benefits of such mixed engrams over classical, excitatory-only engrams. Towards this end, we consider large recurrent spiking networks with symmetrical Hebbian synaptic plasticity at both inhibitory-to-inhibitory (I-to-I) and inhibitory-to-excitatory (I-to-E) synapses. The conjunction of these rules can robustly stabilize embedded EI assemblies in the asynchronous irregular regime. Assemblies can then be reactivated by two distinct mechanisms: direct stimulation of the engram or disinhibition through the inhgram. Both mechanisms of recall lead to reliable pattern completion and separation. Crucially, we show that networks that lack I-to-I plasticity show weak recall and cannot discriminate between overlapping engrams via disinhibitory activation. This suggests that inhibitory plasticity can facilitate recall of overlapping engrams, with inhibitory neurons controlling multiple excitatory engrams. Furthermore, we show that inhgrams can emerge from pre-existing E-I-E loops in the network's random connectivity. Our work proposes that inhibitory plasticity is a plausible mechanism for high-quality disinhibitory recall, allowing inhibitory neurons to selectively control multiple excitatory engrams through synapse-specific plasticity rules.

neuroscience↗

Memory by a thousand rules: Automated discovery of functional multi-type plasticity rules reveals variety and degeneracy at the heart of learning.

Synaptic plasticity is the basis of learning and memory, but the link between synaptic changes and neural function remains elusive. Here, we used automated search algorithms to obtain thousands of strikingly diverse quadruplets of excitatory(E)-to-E, E-to-inhibitory(I), IE, and II plasticity rules, cooperating to stabilize recurrent spiking networks. Despite the fact that quadruplets were selected for homeostasis, more than 90% of them performed well in simple and more difficult memory tasks such as novelty detection, contextual novelty and sequence replay. Co-activity was crucial, i.e., most rules failed in isolation. Our purely local, unsupervised plasticity rules could also help solve computer games such as pong. Our work showcases automated discovery augmenting human intuition to find en masse solutions for high dimensional problems.

neuroscience↗

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Synaptic plasticity is a key player in the brains life-long learning abilities. However, due to experimental limitations, the mechanistic link between synaptic plasticity rules and the network-level computations they enable remain opaque. Here we use evolutionary strategies (ES) to meta-learn local co-active plasticity rules in large recurrent spiking net-works, using parameterizations of increasing complexity. We discover rules that robustly stabilize network dynamics for all four synapse types acting in isolation (E-to-E, E-to-I, I-to-E and I-to-I). More complex functions such as familiarity detection can also be included in the search constraints. However, our meta-learning strategy begins to fail for co-active rules of increasing complexity, as it is challenging to devise loss functions that effectively constrain net-work dynamics to plausible solutions a priori. Moreover, in line with previous work, we can [fi]nd multiple degenerate solutions with identical network behaviour. As a local optimization strategy, ES provides one solution at a time and makes exploration of this degeneracy cumbersome. Regardless, we can glean the interdependecies of various plasticity parameters by considering the covariance matrix learned alongside the optimal rule with ES. Our work provides a proof of principle for the success of machine-learning-guided discovery of plasticity rules in large spiking networks, and points at the necessity of more elaborate search strategies going forward.

neuroscience↗

Indistinguishable network dynamics can emerge from unalike plasticity rules

Synaptic plasticity is thought to be critical for building and maintaining brain circuits. Models of plasticity, or plasticity rules, are typically designed by hand, and evaluated based on their ability to elicit similar neuron or circuit properties to ground truth. While this approach has provided crucial insights into plasticity mechanisms, it is limited in its scope by human intuition and cannot identify all plasticity mechanisms that are consistent with the empirical data of interest. In other words, focusing on individual hand-crafted rules ignores the potential degeneracy of plasticity mechanisms that explain the same empirical data, and may thus lead to inaccurate experimental predictions. Here, we use an unsupervised, adversarial approach to infer plasticity rules directly from neural activity recordings. We show that even in a simple, idealised network model, many mechanistically different plasticity rules are equally compatible with empirical data. Our results suggest the need for a shift in the study of plasticity rules, considering as many degenerate plasticity mechanisms consistent with data as possible, before formulating experimental predictions.

neuroscience↗

A meta-learning approach to (re)discover plasticity rules that carve a desired function into a neural network

The search for biologically faithful synaptic plasticity rules has resulted in a large body of models. They are usually inspired by - and fitted to - experimental data, but they rarely produce neural dynamics that serve complex functions. These failures suggest that current plasticity models are still under-constrained by existing data. Here, we present an alternative approach that uses meta-learning to discover plausible synaptic plasticity rules. Instead of experimental data, the rules are constrained by the functions they implement and the structure they are meant to produce. Briefly, we parameterize synaptic plasticity rules by a Volterra expansion and then use supervised learning methods (gradient descent or evolutionary strategies) to minimize a problem-dependent loss function that quantifies how effectively a candidate plasticity rule transforms an initially random network into one with the desired function. We first validate our approach by re-discovering previously described plasticity rules, starting at the single-neuron level and "Ojas rule", a simple Hebbian plasticity rule that captures the direction of most variability of inputs to a neuron (i.e., the first principal component). We expand the problem to the network level and ask the framework to find Ojas rule together with an anti-Hebbian rule such that an initially random two-layer firing-rate network will recover several principal components of the input space after learning. Next, we move to networks of integrate-and-fire neurons with plastic inhibitory afferents. We train for rules that achieve a target firing rate by countering tuned excitation. Our algorithm discovers a specific subset of the manifold of rules that can solve this task. Our work is a proof of principle of an automated and unbiased approach to unveil synaptic plasticity rules that obey biological constraints and can solve complex functions.

neuroscience↗