Search bioRxiv⌕ Search

Biology subjects

Comrie, A. E.

Publications and source records attributed to Comrie, A. E..

7 recordsLinked to original sources

Mice navigate complex landscapes by learning a sparse vocabulary of paths

Effective navigation is critical for survival, but how animals contend with the scale, complexity, and self-similarity of natural landscapes is unknown. Here, we investigate spontaneous exploratory mouse behavior, both outdoors and in dark self-similar landscapes made from tens to hundreds of tiles of varying heights. Within 2 hours of exploration, mice detected small covert changes to the landscape and jumped across ledges to invisible landing spots, revealing detailed spatial knowledge. In this process, mice converged on a sparse set of memorized paths. These routes depended on prior experience and increased the compressibility of sensory information over time. Our results demonstrate that mice rapidly learn sparse internal representations of their surroundings and suggest that animals use structured behavioral sequences to reduce the complexity of natural navigation.

animal behavior and cognition↗

Meta-learning is expressed through altered prefrontal cortical dynamics

Learning where and when rewards like food and water are available is essential for survival1,2. In the simplest cases where resource availability is stable, animals can learn reward contingencies by integrating outcomes across repeated samples of each possible action. In more natural settings, however, reward availability is governed by structured higher-order rules such as depletion and repletion over time. To adapt flexibly to such changing environments, optimal choices require meta-learning wherein animals learn how to learn from external feedback, ultimately enabling them to infer the underlying reward structure from abstract, generalizable rules rather than relying solely on recent outcomes3,4. The existence of meta-learning in animal behavior is well established3-8, yet the neural circuits and computations that implement it remain poorly understood9-11. Here we investigated meta-learning using a spatial foraging task in which rats acquired a depletion-repletion rule that regulated reward availability, and carried out longitudinal, high-density recordings from the medial prefrontal cortex (mPFC). We show that meta-learning engages specific, systematic changes in mPFC neural dynamics that embed the learned rule and thereby alter how the network learns action values from reward outcomes. These dynamics are based on mixed coding of task structure and value in individual mPFC neurons. At the population level, this coding organizes into low-dimensional dynamical motifs that generalize across task conditions. As meta-learning progresses, these motifs are reshaped to instantiate both rule-guided inference of future states before outcome delivery and rule-based value updating during the outcome period. These results indicate that meta-learning sculpts pre-existing prefrontal dynamics to support the acquisition of new, generalizable reward-learning strategies.

neuroscience↗

Disruption of theta-timescale spiking impairs learning but spares hippocampal replay

The ability to rapidly learn and retrieve salient information about new environments is critical for survival. In mammals, the hippocampus plays a crucial role in that learning. Specialized features of hippocampal population coding, including network-level theta oscillatory activity, location-specific firing of principal cells, and reactivation of experience during immobility (replay), have been implicated in rapid storage and retrieval of spatial information. Disruptions of theta and replay jointly, or replay alone, are sufficient to impair learning; however, the specific contribution of theta-associated temporal structure during locomotion remains unknown. In this study, we manipulated hippocampal spiking activity in rats specifically during locomotion by optogenetically activating septal parvalbumin-expressing GABAergic neurons. We developed a closed-loop, theta phase-specific stimulation protocol that reliably reduced theta power shortly after stimulation onset. This manipulation preserved the place codes of individual cells but disrupted the fine temporal structure of endogenous spatio-temporal representations (i.e., theta sequences) at the pairwise and population level. Theta disruption during locomotion was also sufficient to cause pronounced deficits in learning the more cognitively challenging component of a spatial alternation task, even though disruption was applied on only [~]66% of trials. Notably, network effects accompanying theta disruption were restricted to locomotor periods; we did not observe changes in replay rate, length, or content during immobility. Together, these results demonstrate the importance of the precise temporal microstructure of locomotion-associated spatial representations in the hippocampus for learning.

neuroscience↗

Hippocampal representations of alternative possibilities are flexibly generated to meet cognitive demands

The cognitive ability to go beyond the present to consider alternative possibilities, including potential futures and counterfactual pasts, can support adaptive decision making. Complex and changing real-world environments, however, have many possible alternatives. Whether and how the brain can select among them to represent alternatives that meet current cognitive needs remains unknown. We therefore examined neural representations of alternative spatial locations in the rat hippocampus during navigation in a complex patch foraging environment with changing reward probabilities. We found representations of multiple alternatives along paths ahead and behind the animal, including in distant alternative patches. Critically, these representations were modulated in distinct patterns across successive trials: alternative paths were represented proportionate to their evolving relative value and predicted subsequent decisions, whereas distant alternatives were prevalent during value updating. These results demonstrate that the brain modulates the generation of alternative possibilities in patterns that meet changing cognitive needs for adaptive behavior.

neuroscience↗

Regional specialization manifests in the reliability of neural population codes

The brain has the remarkable ability to learn and guide the performance of complex tasks. Decades of lesion studies suggest that different brain regions perform specialized functions in support of complex behaviors1-3. Yet recent large-scale studies of neural activity reveal similar patterns of activity and encoding distributed widely throughout the brain4-6. How these distributed patterns of activity and encoding are compatible with regional specialization of brain function remains unclear. Two frontal brain regions, the dorsal medial prefrontal cortex (dmPFC) and orbitofrontal cortex (OFC), are a paradigm of this conundrum. In the setting complex behaviors, the dmPFC is necessary for choosing optimal actions2,7,8, whereas the OFC is necessary for waiting for3,9 and learning from2,7,9-12 the outcomes of those actions. Yet both dmPFC and OFC encode both choice- and outcome-related quantities13-20. Here we show that while ensembles of neurons in the dmPFC and OFC of rats encode similar elements of a cognitive task with similar patterns of activity, the two regions differ in when that coding is consistent across trials ("reliable"). In line with the known critical functions of each region, dmPFC activity is more reliable when animals are making choices and less reliable preceding outcomes, whereas OFC activity shows the opposite pattern. Our findings identify the dynamic reliability of neural population codes as a mechanism whereby different brain regions may support distinct cognitive functions despite exhibiting similar patterns of activity and encoding similar quantities.

neuroscience↗

Spyglass: a data analysis framework for reproducible and shareable neuroscience research

Scientific progress depends on reliable and reproducible results. Progress can be accelerated when data are shared and re-analyzed to address new questions. Current approaches to storing and analyzing neural data involve bespoke formats and software that make replication and reuse of data difficult. To address these challenges, we created Spyglass, an open-source data management and analysis framework written in Python. Spyglass provides reproducible pipelines for common neuroscience analyses and sharing of raw data, intermediate analyses, and final results within and across labs. Spyglass uses the Neurodata Without Borders (NWB) standard and includes pipelines for spectral filtering, spike sorting, pose tracking, and neural decoding. Spyglass can be extended to apply existing and newly developed pipelines to datasets from multiple sources. We demonstrate these features in the context of a cross-laboratory replication by applying advanced state space decoding algorithms to publicly available data. New users can try out Spyglass on a Jupyter Hub hosted by HHMI and 2i2c: https://spyglass.hhmi.2i2c.cloud/.

neuroscience↗

Dual credit assignment processes underliedopamine signals in a complex spatialenvironment.

Dopamine in the nucleus accumbens helps motivate behavior based on expectations of future reward ("values"). These values need to be updated by experience: after receiving reward, the choices that led to reward should be assigned greater value. There are multiple theoretical proposals for how this credit assignment could be achieved, but the specific algorithms that generate updated dopamine signals remain uncertain. We monitored accumbens dopamine as freely behaving rats foraged for rewards in a complex, changing environment. We observed brief pulses of dopamine both when rats received reward (scaling with prediction error), and when they encountered novel path opportunities. Furthermore, dopamine ramped up as rats ran towards reward ports, in proportion to the value at each location. By examining the evolution of these dopamine place-value signals, we found evidence for two distinct update processes: progressive propagation along taken paths, as in temporal-difference learning, and inference of value throughout the maze, using internal models. Our results demonstrate that within rich, naturalistic environments dopamine conveys place values that are updated via multiple, complementary learning algorithms.

neuroscience↗