Search bioRxiv⌕ Search

Biology subjects

Durstewitz, D.

Publications and source records attributed to Durstewitz, D..

9 recordsLinked to original sources

A piece-wise linear recurrent neural network identifies generalizable dynamics from neural activity during decision-making in rodents

Alterations in impulsivity characterize several neuropsychiatric disorders, however the neural processes that underlie an impulsive choice have not been identified. A recent body of literature suggests that there may be generalizable aspects of neural representations across animals. Whether this is also true for dynamic rather than just static (like geometrical) properties of neural representations, and specifically in the context of impulsive behaviors, is less clear. Therefore, the goal of this study is to characterize generalizable features of latent dynamics that disambiguate an impulsive from non-impulsive choice across many different data sets and animals. A deep learning-based latent factor model was constructed from neural recordings that were acquired in rat anterior cingulate cortex while performing a delay discounting task, which is commonly used to assess impulsivity. Prior work shows this brain region is critical for the performance of this task. We leveraged piecewise linear recurrent neural networks (PLRNNs) to perform a nonlinear latent factor analysis across animals and experimental sessions. Our PLRNN explained a substantially larger percent of variance in fewer dimensions than linear approaches. We cross-validated performance of the model on test data and following the disruption of recurrent connectivity or auto-regressive latent dynamics. These tests confirmed that our fitting procedure consistently embedded generalizable neuronal dynamics within the PLRNN. Further, we found that the latent dynamics exhibited strong rotational features and progressed faster for impulsive choices. In summary, our model captures properties of the latent dynamics that are consistent across multiple data sets and disambiguate impulsive choices.

neuroscience↗

A normative reference for large-scale human brain dynamics across the lifespan

Human brain function emerges from dynamic reconfigurations of large-scale neural networks. While population-level reference charts have transformed the study of static brain structure and connectivity, an equivalent normative framework for intrinsic brain dynamics has been lacking. This gap has limited our ability to characterize individual variability, development, ageing, and mental health conditions at scale. Here, we establish a population-level normative reference for large-scale human brain dynamics using resting-state fMRI data from more than 10,000 individuals spanning the lifespan and 91 scanning sites. We derive a compact set of recurring brain-state configurations that are reproducible across scanners and acquisition paradigms and that generalize to previously unseen cohorts. Anchoring these dynamic states to normative lifespan models enables the quantification of individual deviations relative to population reference distributions. We show that intrinsic brain dynamics undergo systematic reorganization across development and ageing, with pronounced changes before early adulthood and more gradual modulation thereafter. Applying this framework across multiple mental health conditions reveals disorder-specific and highly heterogeneous deviations in brain dynamics that are not captured by static neuroimaging measures. Robust transfer to independent cohorts and longitudinal analyses demonstrate that normative brain dynamics can be reliably assessed out of distribution. These results delineate a population-scale dynamic architecture of the human brain and extend normative brain mapping from static phenotypes to the temporal domain, providing a reference framework for studying brain function across the lifespan in health and disease.

neuroscience↗

Integration of rate and temporal codes by hippocampal cell-assemblies supports theta phase coding of episodic information

Spatial information is encoded by location-dependent hippocampal place cell firing rates and sub-second, rhythmic entrainment of spike times. These rate and temporal codes have primarily been characterized in low-dimensional environments under limited cognitive demands; but how is coding configured in complex environments when individual place cells signal several locations, individual locations contribute to multiple routes and functional demands vary? Quantifying rat CA1 population dynamics during a decision-making task, we show that the phase of individual place cells spikes relative to the local theta rhythm shifts to differentiate activity in different place fields. Theta phase coding also disambiguates repeated visits to the same location during different routes, particularly preceding spatial decisions. Using unsupervised detection of cell assemblies alongside theoretical simulation, we show that integrating rate and phase coding mechanisms dynamically recruits units to different assemblies, generating spiking sequences that disambiguate episodes of experience and multiplexing spatial information with cognitive context.

neuroscience↗

Species-conserved mechanisms of cognitive flexibility in complex environments

Rapid learning in complex and changing environments is a hallmark of intelligent behavior. Humans achieve this in part through abstract concepts applicable to multiple, related situations. It is unclear, however, whether some of the underlying computational mechanisms also exist in other species. We combined behavioral, computational and electrophysiological analyses of a multidimensional rule-learning paradigm in rats and humans. We report that both species infer task rules by sequentially testing different hypotheses, rather than learning the correct action for all possible combinations of task-related cues. Neural substrates of hypothetical rules were detected in prefrontal network activity of both species. This species-conserved mechanism reduces task dimensionality and explains key experimental observations: sudden behavioral transitions and facilitated learning after prior experience. Our findings open the black box of hypothesis testing in rodents and provide a foundation for the translational investigation of impaired cognitive flexibility.

neuroscience↗

Reconstructing Computational Dynamics from Neural Measurements with Recurrent Neural Networks

Mechanistic and computational models in neuroscience usually take the form of systems of differential or time-recursive equations. The spatio-temporal behavior of such systems is the subject of dynamical systems theory (DST). DST provides a powerful mathematical toolbox for describing and analyzing neurobiological processes at any level, from molecules to behavior, and has been a mainstay of computational neuroscience for decades. Recently, recurrent neural networks (RNNs) became a popular machine learning tool for studying the nonlinear dynamics underlying neural or behavioral observations. By training RNNs on the same behavioral tasks as employed for animal subjects and dissecting their inner workings, insights and hypotheses about the neuro-computational underpinnings of behavior could be generated. Alternatively, RNNs may be trained directly on the physiological and behavioral time series at hand. Ideally, the once trained RNN would then be able to generate data with the same temporal and geometrical properties as those observed. This is called dynamical systems reconstruction, a burgeoning field in machine learning and nonlinear dynamics. Through this more powerful approach the trained RNN becomes a surrogate for the experimentally probed system, as far as its dynamical and computational properties are concerned. The trained system can then be systematically analyzed, probed and simulated. Here we will review this highly exciting and rapidly expanding field, including recent trends in machine learning that may as yet be less well known in neuroscience. We will also discuss important validation tests, caveats, and requirements of RNN-based dynamical systems reconstruction. Concepts and applications will be illustrated with various examples from neuroscience.

neuroscience↗

Prefrontal cortical contributions to working memory loading, maintenance and recall are parsed by hippocampal-prefrontal oscillatory assembly dynamics

Working memory enables incorporation of recent experience into subsequent decision-making. This processing recruits both prefrontal cortex and hippocampus, where neurons encode task cues, rules and outcomes. However, precisely which information is carried when, and by which neurons, remains unclear. Using population decoding of activity in rat medial prefrontal cortex (mPFC) and dorsal hippocampal CA1, we confirm that mPFC populations lead in maintaining sample information across delays of an operant nonmatch to sample task, despite individual neurons firing only transiently. During sample encoding, distinct mPFC subpopulations joined distributed CA1-mPFC cell assemblies hallmarked by 4-5Hz rhythmic modulation; CA1-mPFC assemblies re-emerged during choice episodes, but were not 4-5Hz modulated. Delay-dependent errors arose when attenuated rhythmic assembly activity heralded collapse of sustained mPFC encoding; pharmacological disruption of CA1-mPFC assembly rhythmicity impaired task performance. Our results map component processes of memory-guided decisions onto heterogeneous CA1-mPFC subpopulations and the dynamics of physiologically distinct, distributed cell assemblies.

neuroscience↗

Coordinated prefrontal state transition leads extinction of reward-seeking behaviors

Extinction learning suppresses conditioned reward responses and is thus fundamental to adapt to changing environmental demands and to control excessive reward seeking. The medial prefrontal cortex (mPFC) monitors and controls conditioned reward responses. Using in vivo multiple single-unit recordings of mPFC we studied the relationship between single-unit and population dynamics during different phases of an operant conditioning task. To examine the fine temporal relation between neural activity and behavior, we developed a model-based statistical analysis that captured behavioral idiosyncrasies. We found that single-unit responses to conditioned stimuli changed throughout the course of a session even under stable experimental conditions and consistent behavior. However, when behavioral responses to task contingencies had to be updated during the extinction phase, unit-specific modulations became coordinated across the whole population, pushing the network into a new stable attractor state. These results show that extinction learning is not associated with suppressed mPFC responses to conditioned stimuli, but is driven by single-unit coordination into population-wide transitions of the animals internal state.

neuroscience↗

Phasic dopamine enhances the distinct decoding and perceived salience of stimuli

Subjects learn to assign value to stimuli that predict outcomes. Novelty, rewards or punishment evoke reinforcing phasic dopamine release from midbrain neurons to ventral striatum that mediates expected value and salience of stimuli in humans and animals. It is however not clear whether phasic dopamine release is sufficient to form distinct engrams that encode salient stimuli within these circuits. We addressed this question in awake mice. Evoked phasic dopamine induced plasticity selectively to the population encoding of coincidently presented stimuli and increased their distinctness from other stimuli. Phasic dopamine thereby enhanced the decoding of previously paired stimuli and increased their perceived salience. This dopamine-induced plasticity mimicked population coding dynamics of conditioned stimuli during reinforcement learning. These findings provide a network coding mechanism of how dopaminergic learning signals promote value assignment to stimulus representations.

neuroscience↗

Brain state stability during working memory is explained by network control theory, modulated by dopamine D1/D2 receptor function, and diminished in schizophrenia

Dynamical brain state transitions are critical for flexible working memory but the network mechanisms are incompletely understood. Here, we show that working memory entails brain-wide switching between activity states. The stability of states relates to dopamine D1 receptor gene expression while state transitions are influenced by D2 receptor expression and pharmacological modulation. Schizophrenia patients show altered network control properties, including a more diverse energy landscape and decreased stability of working memory representations.

neuroscience↗