Search bioRxiv⌕ Search

Biology subjects

Buonomano, D. V.

Publications and source records attributed to Buonomano, D. V..

7 recordsLinked to original sources

STIMscope: centimeter-scale all-optical imaging and patterned optogenetic manipulation at single-cell resolution

Linking observation to intervention at cellular resolution makes it possible to move from measuring network activity to testing the contribution of defined neurons or ensembles within the same preparation. All-optical probing provides this capability by combining fluorescence-based readout with targeted optogenetic manipulation. Yet the platforms that deliver this capability remain complex, expensive, and difficult to maintain, requiring specialized expertise that has confined them to a small number of laboratories. They also typically provide fields of view too limited for studies of large, distributed neuronal populations. We address these constraints with the Spatiotemporal Illumination Microscope (STIMscope), a one-photon benchtop platform that integrates large-aperture tandem optics with a small-pixel back-illuminated CMOS sensor, a digital micromirror device for patterned illumination, and a GPU-based processing unit coordinated by a microcontroller for hardware-level synchronization. Ray-tracing simulations and point-spread-function measurements confirm cellular-scale resolution, with imaging lateral FWHM of 5.6 {micro}m at the field center and 5.8 {micro}m at the edge, and excitation lateral FWHM of 5.8 {micro}m at the center and 6.2 {micro}m at the edge, supporting fields of view as large as 14 mm x 11 mm in the demagnified configuration. The accompanying Closed-loop ready Real-time Imaging and Stimulation Pipeline (CRISPI) provides GPU-accelerated calibrated mask projection (26.3 ms latency), online ROI trace extraction, and modular ZeroMQ-based control, with a measured imaging-to-stimulation loop benchmark of 91.6 ms. We validate STIMscope in fixed mouse brain tissue, live iPSC-derived human neuronal cultures, and ex vivo organotypic slices of mouse auditory cortex. In organotypic slices, we show that both static and spatiotemporal stimulus identity can be decoded from population activity, revealing reservoir-like population dynamics, and that this decodability remains stable in the same neuronal population over hours. We further show that post-stimulus activity retains information about recent stimuli for several seconds, consistent with short-term memory dynamics. With a bill of materials under $5,000 USD and all mechanical designs, firmware, and software released open-source, STIMscope makes all-optical neuroscience experiments a routine capability accessible to laboratories without specialized optical engineering expertise.

bioengineering↗

Unified control of temporal and spatial scales of sensorimotor behavior through neuromodulation of short-term synaptic plasticity

Neuromodulators such as dopamine have been shown to modulate short-term synaptic plasticity (STP). Here we propose that the neuromodulation of STP provides a general mechanism to scale neural dynamics and motor outputs in time and space. We trained RNNs that incorporated STP to produce complex motor trajectories--handwritten digits--with different temporal (speed) and spatial (size) scales. The learned dynamics underwent temporal and spatial scaling when higher synaptic release probabilities corresponded to higher speed/size. Neuromodulation of STP enhanced temporal or spatial generalization compared to weight modulation alone. The model accounted for the data of two experimental studies involving flexible sensorimotor timing. Our results address a long-standing debate regarding the role of dopamine in timing and predict novel mechanisms by which dopamine may slow down neural dynamics and thus slow "clock" speed.

neuroscience↗

Multiplexing working memory and time: encoding retrospective and prospective information in neural trajectories

Working memory (WM) and timing are generally considered distinct cognitive functions, but similar neural signatures have been implicated in both. To explore the hypothesis that WM and timing may rely on shared neural mechanisms, we used psychophysical tasks that contained either task-irrelevant timing or WM components. In both cases the task-irrelevant component influenced performance. RNN simulations revealed that cue-specific neural sequences, which multiplexed WM and time, emerged as the dominant regime that captured the behavioral findings. Over the course of training RNN dynamics transitioned from low-dimensional ramps to high-dimensional neural sequences, and depending on task requirements, steady-state or ramping activity was also observed. Analysis of RNN structure revealed that neural sequences relied primarily on inhibitory connections, and could survive the deletion of all excitatory-to- excitatory connections. Our results suggest that in some instances WM is encoded in time-varying neural activity because of the importance of predicting when WM will be used.

neuroscience↗

Encoding time in neural dynamic regimes with distinct computational tradeoffs

Converging evidence suggests the brain encodes time in time-varying patterns of neural activity, including neural sequences, ramping activity, and complex dynamics. Temporal tasks that require producing the same time-dependent output patterns may have distinct computational requirements in regard to the need to exhibit temporal scaling or generalize to novel contexts. It is not known how neural circuits can both encode time and satisfy distinct computational and generalization requirements, it is also not known whether similar patterns of neural activity at the population level can emerge from distinctly different network configurations. To begin to answer these questions, we trained RNNs on two timing tasks based on behavioral studies. The tasks had different input structures but required producing identically timed output patterns. Using a novel framework we quantified whether RNNs encoded two intervals using either of three different timing strategies: scaling, absolute, or stimulus-specific dynamics. We found that similar neural dynamics for single intervals were associated with fundamentally different encoding strategies and network configurations. Critically, some regimes were better suited for generalization, categorical timing, or robustness to noise. Further analysis revealed different connection patterns underlying the different encoding strategies. Our results predict that apparently similar neural dynamic regimes at the population level can be produced through fundamentally different mechanisms--e.g., in regard to network connectivity and the role of excitatory and inhibitory neurons. We also predict that the task structure used in different experimental studies accounts for some of the experimentally observed variability in how networks encode time. Author summaryThe ability to tell time and anticipate when external events will occur are among the most fundamental computations the brain performs. Converging evidence suggests the brain encodes time through changing patterns of neural activity. Different temporal tasks, however, have distinct computational requirements, such as the need to flexibly scale temporal patterns or generalize to novel inputs. To understand how networks can encode time and satisfy different computational requirements we trained recurrent neural networks (RNNs) on two timing tasks that have previously been used in behavioral studies. Both tasks required producing identically timed output patterns. Using a novel framework to quantify how networks encode different intervals, we found that similar patterns of neural activity--neural sequences--were associated with fundamentally different underlying mechanisms, including the connectivity patterns of the RNNs. Critically, depending on the task the RNNs were trained on, they were better suited for generalization, categorical timing, or robustness to noise. Our results predict that similar patterns of neural activity can be produced by distinct RNN configurations, which in turn have fundamentally different computational tradeoffs. Our results also predict that differences in task structure account for some of the experimentally observed variability in how networks encode time.

neuroscience↗

Differential excitability of PV and SST neurons results in distinct functional roles in inhibition stabilization of Up-states

Up-states are the best-studied example of an emergent neural dynamic regime. Computational models based on a single class of inhibitory neurons indicate that Up-states reflect bistable dynamical systems in which positive feedback is stabilized by strong inhibition and predict a paradoxical effect in which increased drive to inhibitory neurons results in decreased inhibitory activity. To date, however, computational models have not incorporated empirically defined properties of PV and SST neurons. Here we first, experimentally characterized the frequencycurrent (F-I) curves of pyramidal, PV, and SST neurons and confirmed a sharp difference between the threshold and slopes of PV and SST neurons. The empirically defined F-I curves were incorporated into a three-population computational model that simulated the empirically-derived firing rates of pyramidal, PV, and SST neurons. Simulations revealed that the intrinsic properties were sufficient to predict that PV neurons are primarily responsible for generating the nontrivial fixed points representing Up-states. Simulations and analytical methods demonstrated that while the paradoxical effect is not obligatory in a model with two classes of inhibitory neurons, it is present in most regimes. Finally, experimental tests validated predictions of the model that the Pyr{leftrightarrow}PV inhibitory loop is stronger than the Pyr{leftrightarrow}SST loop. SIGNIFICANCE STATEMENTMany cortical computations, such as working memory, rely on the local recurrent excitatory connections that define cortical circuit motifs. Up-states are among the simplest and best studied examples of neural dynamic regimes that rely on recurrent excitatory excitation. However, this positive feedback must be held in check by inhibition. To address the relative contribution of PV and SST neurons we characterized the intrinsic input-output differences between these classes of inhibitory neurons, and using experimental and theoretical methods show that the higher threshold and gain of PV leads to a dominant role in network stabilization.

neuroscience↗

Musical expertise generalizes to superior temporal scaling in a Morse code tapping task

A key feature of the brains ability to tell time and generate complex temporal patterns is its capacity to produce similar temporal patterns at different speeds. For example, humans can tie a shoe, type, or play an instrument at different speeds or tempi--a phenomenon referred to as temporal scaling. While it is well established that training improves timing precision and accuracy, it is not known whether expertise improves temporal scaling. We quantified temporal scaling and timing precision in musicians and non-musicians as they learned to tap a Morse code sequence. We found that controls improved significantly over the course of days of training at the standard speed. In contrast, musicians exhibited a high level of temporal precision on the first day, which did not improve significantly with training. Although there was no significant difference in performance at the end of training at the standard speed, musicians were significantly better at temporal scaling--i.e., at reproducing the learned Morse code pattern at faster and slower speeds. Interestingly, both musicians and non-musicians exhibited a Weber-speed effect, where absolute temporal precision sharpened when producing patterns at the faster speed. These results are the first to establish that the ability to generate the same motor patterns at different speeds improves with extensive training and generalizes to non-musical domains.

neuroscience↗

Encoding Sensory and Motor Patterns as Time-Invariant Trajectories in Recurrent Neural Networks

Much of the information the brain processes and stores is temporal in nature--a spoken word or a handwritten signature, for example, is defined by how it unfolds in time. However, it remains unclear how neural circuits encode complex time-varying patterns. We show that by tuning the weights of a recurrent neural network (RNN), it can recognize and then transcribe spoken digits. The model elucidates how neural dynamics in cortical networks may resolve three fundamental challenges: first, encode multiple time-varying sensory and motor patterns as stable neural trajectories; second, generalize across relevant spatial features; third, identify the same stimuli played at different speeds--we show that this temporal invariance emerges because the recurrent dynamics generate neural trajectories with appropriately modulated angular velocities. Together our results generate testable predictions as to how recurrent networks may use different mechanisms to generalize across the relevant spatial and temporal features of complex time-varying stimuli.

neuroscience↗