Search bioRxiv⌕ Search

Biology subjects

Kilpatrick, Z. P.

Publications and source records attributed to Kilpatrick, Z. P..

17 recordsLinked to original sources

An Information Compass for Probabilistic Reasoning in the Brain

Probabilistic reasoning in the brain has been studied primarily using simple two-choice tasks that are experimentally and theoretically tractable but have unclear relevance to more complex problems. Here we generalize principles from these studies using information geometry, which treats probability distributions (``beliefs'') as points on statistical manifolds whose geometry captures relationships between those beliefs. We introduce an ``information compass,'' a context-dependent, one-dimensional axis along which an arbitrarily complex belief is reinforced or repudiated. Projecting high-dimensional belief updates onto this axis casts even complex decisions into familiar forms of deliberation and commitment used for simpler decisions. Our framework provides a unified account of how biological and artificial systems can use geometric forms of probabilistic reasoning to make decisions across a range of tasks and domains.

neuroscience↗

Social Discounting Enables Fast and Reliable Collective Escape

Solitary animals face a tradeoff when detecting threats: faster detection means accepting more false alarms. We show that groups can manage this tradeoff better by treating an undisturbed neighbor as evidence against a threat, becoming both faster and more accurate than lone individuals. Modeling each animal as a noisy evidence-accumulator that flees when its belief crosses a threshold, we find that a neighbor's flight signals danger while its stillness signals safety. A naive responder reacts only to flights and inflates false alarms as the group grows; a Bayesian responder weighs both, approximated by a single social discounting rate that interpolates between these limits. This yields closed-form expressions for group performance, including cascade branching ratios that stay strongly subcritical in safety and turn supercritical under threat, so the rate at which an animal discounts a threat while its neighbors stay still can be inferred from behavior alone, and it sets a ceiling on how many neighbors an animal can attend before discounting alone can no longer hold its false-alarm rate. Wild sulphur molly shoals under bird attack are best described by discounting rates well above what individually Bayesian updating supplies over any neighborhood they could plausibly attend, and the same model, at the inferred value, predicts a false-alarm rate that stays constant as shoals grow.

animal behavior and cognition↗

Resource depletion accelerates rate learning but not composition learning in patch foraging

Foraging is a universal animal behavior that has increasingly attracted the interest of both experimentalists and theorists. Most prior models assume an animal knows the distribution of resources in its environment, but this structure must be learned as the animal explores its environment. Foraging can thus be regarded as a hierarchical inference problem. We develop a normative Bayesian account of an agent learning a patchy environment while exploiting it, and show that resource depletion shapes the levels of that hierarchy differently. Within a patch, depletion accelerates rate learning, since successive encounters occur at falling rates whose spacing pins down the initial rate. Across patches, composition learning, inferring the fraction of patches that are high yield, is slow, set by the number of patches sampled rather than the time spent in each, and unaffected by depletion once the rates are known. Reward-maximizing and information-seeking strategies therefore diverge, a forager resolving the composition underharvesting rich patches because learning it requires departures, most sharply early in exposure. When a fixed set of patches replenishes between visits, the reward-maximizing policy collapses onto a stable orbit over the high-yield patches, and the replenishment rate sets whether the forager maps the whole environment or locks onto a rich subset. Which departure rule maximizes intake is itself set by how variable the patches are, switching from counting prey to timing the gaps between them once richness varies by more than about a quarter. Learning the environment thus buys significant intake over learning a rule from reward alone, as long as its assumptions about depletion leave room for the truth. Author summaryAnimals entering an unfamiliar landscape must both gather food and learn what kind of environment they face. We study this using a mathematical model of an animal moving among food patches and deciding when to keep feeding or leave. Feeding depletes a patch, usually viewed only as a cost. We show it is also informative. As food is removed items arrive more slowly, and that pattern reveals how rich the patch was to begin with, so an animal learns patch quality faster where supply runs down than where it does not. The benefit does not extend to every feature. Learning what fraction of patches are rich depends on how many patches are visited rather than how long the animal stays in each, so depletion neither helps nor harms it, and an animal seeking that information should leave even rich patches early to sample more locations. Finally, the best rule for when to leave depends on how much patches differ. Where patches are alike an animal should count what it has eaten, and where they differ it should time the gap since its last find, because a long gap then signals a poor patch rather than an emptied one.

animal behavior and cognition↗

Human decision-makers terminate evidence accumulation using flexible decision rules

Decisions based on evidence accumulated over time require rules governing when to end the accumulation process and commit to a choice. These rules control inherent trade-offs between decision speed and accuracy, which require careful balance to maximize quantities that depend on both like reward rate. We previously showed that, to maximize reward rate, normative decision rules adapt to changing task conditions (Barendregt et al., 2022). Here we used a novel task to examine whether and how people use adaptive rules for individual decisions under a variety of conditions, including changes in decision outcomes across trials and changes in evidence quality both across and within trials. We found that the participants tended to use rules that adjusted, at least partially, to predictable changes in task conditions to improve reward rate, consistent with a rationally bounded implementation of normative principles. These findings help inform our understanding of the extent and limits of flexible decision formation in the brain.

neuroscience↗

Untangling dopamine and glutamate in the ventral tegmental area

Ventral tegmental area (VTA) dopamine neurons are of great interest for their central roles in motivation, learning, and psychiatric disorders. While hypotheses of VTA dopamine neuron function posit a homogenous role in behavior (e.g., prediction error), they do not account for molecular heterogeneity. We find that glutamate-dopamine, nonglutamate-dopamine, and glutamate-only neurons are dissociable in their signaling of reward and aversion-related stimuli, prediction error, and electrical properties. In addition, glutamate-dopamine and nonglutamate-dopamine neurons differ in dopamine release dynamics. Aversion-related recordings of all dopamine neurons (not considering glutamate co-transmission) showed a mixed response that obscured dopamine subpopulation function. Within glutamate-dopamine neurons, glutamate and dopamine release had dissociable contributions toward reward and aversion-based learning and performance. Based on our results, we propose a new hypothesis on VTA dopamine neuron function: that dopamine neuron signaling patterns and their roles in motivated behavior depend on whether or not they co-transmit dopamine with glutamate.

neuroscience↗

Robustly encoding certainty in a metastable neural circuit model

Localized persistent neural activity has been shown to serve delayed estimation of continuous variables. Common experiments require that subjects store and report the feature value (e.g., orientation) of a particular cue (e.g., oriented bar on a screen) after a delay. Visualizing recorded activity of neurons according to their feature tuning reveals activity bumps whose centers wander stochastically, degrading the estimate over time. Bump position therefore represents the remembered estimate. Recent work suggests that bump amplitude may represent estimate certainty reflecting a probabilistic population code for a Bayesian posterior. Idealized models of this type are fragile due to the fine tuning common to constructed continuum attractors in dynamical systems. Here we propose an alternative metastable model for robustly supporting multiple bump amplitudes by extending neural circuit models to include quantized nonlinearities. Asymptotic projections of circuit activity produce low-dimensional evolution equations for the amplitude and position of bump solutions in response to external stimuli and noise perturbations. Analysis of reduced equations accurately characterizes phase variance and the dynamics of amplitude transitions between stable discrete values. More salient cues generate bumps of higher amplitude which wander less, consistent with the experimental finding that greater certainty correlates with more accurate memories.

neuroscience↗

Learning efficient representations of heterogeneity in attractors for working memory

Experience shapes our expectations and helps us learn the structure of the environment. Inference models render such learning as a gradual refinement of the observers estimate of the environmental prior. For instance, when retaining an estimate of an objects features in working memory, learned priors may bias the estimate in the direction of common feature values. Humans display such biases when retaining color estimates on short time intervals. We propose that these systematic biases emerge from modulation of synaptic connectivity in a neural circuit based on the experienced stimulus history, shaping the persistent and collective neural activity that encodes the stimulus estimate. Resulting neural activity attractors are aligned to common stimulus values. Using recently published human response data from a delayed-estimation task in which stimuli (colors) were drawn from a heterogeneous distribution that did not necessarily correspond with reported population biases, we confirm that most subjects response distributions are better described by experience-dependent learning models than by models with no learned biases. This work suggests that systematic limitations in working memory reflect efficient representations of inferred environmental structure, providing new insights into how humans integrate environmental knowledge into their cognitive strategies.

neuroscience↗

Normative Decision Rules in Changing Environments

Models based on normative principles have played a major role in our understanding of how the brain forms decisions. However, these models have typically been derived for simple, stable environments, and their relevance to decisions under more naturalistic, dynamic conditions is unclear. We previously derived a normative decision model in which evidence accumulation is adapted to environmental dynamics (Glaze et al., 2015), but the evolution of commitment rules (e.g., thresholds on the accumulated evidence) under such dynamic conditions is not fully understood. Here we derive a normative model for decisions based on changing evidence or reward. In these cases, performance (reward rate) is maximized using adaptive decision thresholds that best account for diverse environmental changes, in contrast to predictions of many previous decision models. These adaptive thresholds exhibit several distinct temporal motifs that depend on the specific, predicted and experienced changes in task conditions. These adaptive decision strategies perform robustly even when implemented imperfectly (noisily) and can account for observed response times on a task with time-varying evidence better than commonly used constant-threshold or urgency-gating models. These results further link normative and neural decision-making while expanding our view of both as dynamic, adaptive processes that update and use expectations to govern both deliberation and commitment.

neuroscience↗

Stochastic dynamics of social patch foraging decisions

Animals typically forage in groups. Social foraging can help animals avoid predation and decrease their uncertainty about the richness of food resources. Despite this, theoretical mechanistic models of patch foraging have overwhelmingly focused on the behavior of single foragers. In this study, we develop a mechanistic model that accounts for the behavior of individuals foraging together and departing food patches following an evidence accumulation process. Each individuals belief about patch quality is represented by a stochastically accumulating variable which is coupled to others belief to represent the transfer of information. We consider a cohesive group, and model information sharing by considering both intermittent pulsatile coupling (only communicate decision to leave) and continuous diffusive coupling (communicate throughout the evidence accumulation process). We find that foraging efficiency under pulsatile coupling has a stronger dependence on the coupling strength parameter compared to diffusive. Despite employing minimal information transfer, pulsatile coupling can still provide similar or higher foraging efficiency compared to diffusive coupling. Conversely, since diffusive coupling is more robust to parameter choices, it performs better when individuals have heterogeneous departure criteria and social information weighting. Efficiency is measured by a reward rate function that balances the amount of energy accumulated against the time spent in a patch, computed by solving an ordered first passage time problem for the patch departures of each individual. Using synthetic data we show that we can distinguish between the two modes of communication and identify the model parameters. Our model establishes a social patch foraging framework to parse and identify deliberative decision strategies, to distinguish different forms of social communication, and to allow model fitting to real world animal behavior data.

animal behavior and cognition↗

An emergent temporal basis set robustly supports cerebellar time-series learning

Learning plays a key role in the function of many neural circuits. The cerebellum is considered a learning machine essential for time interval estimation underlying motor coordination and other behaviors. Theoretical work has proposed that the cerebellums input recipient structure, the granule cell layer (GCL), performs pattern separation of inputs that facilitates learning in Purkinje cells (P-cells). However, the relationship between input reformatting and learning outcomes has remained debated, with roles emphasized for pattern separation features from sparsification to decorrelation. We took a novel approach by training a minimalist model of the cerebellar cortex to learn complex time-series data from naturalistic inputs, in contrast to traditional classification tasks. The model robustly produced temporal basis sets from naturalistic inputs, and the resultant GCL output supported learning of temporally complex target functions. Learning favored surprisingly dense granule cell activity, yet the key statistical features in GCL population activity that drove learning differed from those seen previously for classification tasks. Moreover, different cerebellar tasks were supported by diverse pattern separation features that matched the demands of the tasks. These findings advance testable hypotheses for mechanisms of temporal basis set formation and predict that population statistics of granule cell activity may differ across cerebellar regions to support distinct behaviors.

neuroscience↗

Uncertainty drives deviations in normative foraging decision strategies

Nearly all animals forage, as it is essential to acquire energy for survival through efficient search and resource harvesting. Patch exploitation is a canonical foraging behavior, but a systematic treatment of how animals cope with uncertainty is lacking. To address these shortcomings, we develop a normative theory of patch foraging decisions, proposing mechanisms by which foraging behaviors emerge in the face of uncertainty. Our model foragers statistically and sequentially infer patch resource yields using Bayesian updating based on their resource encounter history. A decision to leave a patch is triggered when the certainty of the patch type or the estimated yield of the patch fall below a threshold. The timescale over which uncertainty in resource availability persists strongly impacts behavioral variables like patch residence times and decision rules determining patch departures. When patch depletion is slow, as in habitat selection, departures are characterized by a reduction of uncertainty, suggesting the forager resides in a low-yielding patch. Uncertainty leads patch-exploiting foragers to overharvest (underharvest) patches with initially low (high) resource yields in comparison to predictions of the marginal value theorem. These results extend optimal foraging theory and motivate a variety of behavioral experiments investigating patch foraging behavior.

animal behavior and cognition↗

Normative decision asymmetries with symmetric priors but asymmetric evidence

Solutions to challenging inference problems are often subject to a fundamental trade-off between bias (being systematically wrong) that is minimized with complex inference strategies and variance (being oversensitive to uncertain observations) that is minimized with simple inference strategies. However, this trade-off is based on the assumption that the strategies being considered are optimal for their given complexity and thus has unclear relevance to the frequently suboptimal inference strategies used by humans. We examined inference problems involving rare, asymmetrically available evidence, which a large population of human subjects solved using a diverse set of strategies that were suboptimal relative to the Bayesian ideal observer. These suboptimal strategies reflected an inversion of the classic bias-variance trade-off: subjects who used more complex, but imperfect, Bayesian-like strategies tended to have lower variance but high bias because of incorrect tuning to latent task features, whereas subjects who used simpler heuristic strategies tended to have higher variance because they operated more directly on the observed samples but displayed weaker, near-normative bias. Our results yield new insights into the principles that govern individual differences in behavior that depends on rare-event inference, and, more generally, about the information-processing trade-offs that are sensitive to not just the complexity, but also the optimality of the inference process.

neuroscience↗

Normative theory of patch foraging decisions

Foraging is a fundamental behavior as animals search for food is crucial for their survival. Patch leaving is a canonical foraging behavior, but classic theoretical conceptions of patch leaving decisions lack some key naturalistic details. Optimal foraging theory provides general rules for when an animal should leave a patch, but does not provide mechanistic insights about how those rules change with the structure of the environment. Such a mechanistic framework would aid in designing quantitative experiments to unravel behavioral and neural underpinnings of foraging. To address these shortcomings, we develop a normative theory of patch foraging decisions. Using a Bayesian approach, we treat patch leaving behavior as a statistical inference problem. We derive the animals optimal decision strategies in both non-depleting and depleting environments. A majority of these cases can be analyzed explicitly using methods from stochastic processes. Our behavioral predictions are expressed in terms of the optimal patch residence time and the decision rule by which an animal departs a patch. We also extend our theory to a hierarchical model in which the forager learns the environmental food resource distribution. The quantitative framework we develop will therefore help experimenters move from analyzing trial based behavior to continuous behavior without the loss of quantitative rigor. Our theoretical framework both extends optimal foraging theory and motivates a variety of behavioral and neuroscientific experiments investigating patch foraging behavior.

animal behavior and cognition↗

A hierarchical model of perceptual multistability involving interocular grouping

Ambiguous visual images can generate dynamic and stochastic switches in perceptual interpretation known as perceptual rivalry. Such dynamics have primarily been studied in the context of rivalry between two percepts, but there is growing interest in the neural mechanisms that drive rivalry between more than two percepts. In recent experiments, we showed that split images presented to each eye lead to subjects perceiving four stochastically alternating percepts (Jacot-Guillarmod et al., 2017): two single eye images and two interocularly grouped images. Here we propose a hierarchical neural network model that exhibits dynamics consistent with our experimental observations. The model consists of two levels, with the first representing monocular activity, and the second representing activity in higher visual areas. The model produces stochastically switching solutions, whose dependence on task parameters is consistent with four generalized Levelt Propositions. Our neuromechanistic model also allowed us to probe the roles of inter-actions between populations at the network levels. Stochastic switching at the lower level representing alternations between single eye percepts dominated, consistent with experiments.

neuroscience↗

Social inhibition maintains adaptivity and consensus of foraging honeybee swarms in dynamic environments

To effectively forage in natural environments, organisms must adapt to changes in the quality and yield of food sources across multiple timescales. Individuals foraging in groups act based on both their private observations and the opinions of their neighbors. How do these information sources interact in changing environments? We address this problem in the context of honeybee swarms, showing inhibitory social interactions help maintain adaptivity and consensus needed for effective foraging. Individual and social interactions of a mathematical swarm model shape the nutrition yield of a group foraging from feeders with temporally switching food quality. Social interactions improve foraging from a single feeder if temporal switching is fast or feeder quality is low. When the swarm chooses from multiple feeders, the most effective form of social interaction is direct switching, whereby bees flip the opinion of nestmates foraging at lower yielding feeders. Model linearization shows that effective social interactions increase the fraction of the swarm at the correct feeder (consensus) and the rate at which bees reach that feeder (adaptivity). Our mathematical framework allows us to compare a suite of social inhibition mechanisms, suggesting experimental protocols for revealing effective swarm foraging strategies in dynamic environments.

ecology↗

Performance of normative and approximate evidence accumulation on the dynamic clicks task

The aim of a number of psychophysics tasks is to uncover how mammals make decisions in a world that is in flux. Here we examine the characteristics of ideal and near-ideal observers in a task of this type. We ask when and how performance depends on task parameters and design, and, in turn, what observer performance tells us about their decision-making process. In the dynamic clicks task subjects hear two streams (left and right) of Poisson clicks with different rates. Subjects are rewarded when they correctly identify the side with the higher rate, as this side switches unpredictably. We show that a reduced set of task parameters defines regions in parameter space in which optimal, but not near-optimal observers, maintain constant response accuracy. We also show that for a range of task parameters an approximate normative model must be finely tuned to reach near-optimal performance, illustrating a potential way to distinguish between normative models and their approximations. In addition, we show that using the negative log-likelihood and the 0/1-loss functions to fit these types of models is not equivalent: the 0/1-loss leads to a bias in parameter recovery that increases with sensory noise. These findings suggest ways to tease apart models that are hard to distinguish when tuned exactly, and point to general pitfalls in experimental design, model fitting, and interpretation of the resulting data.

neuroscience↗

Synaptic mechanisms of interference in working memory

Information from preceding trials of cognitive tasks can bias performance in the current trial, a phenomenon referred to as interference. Subjects performing visual working memory tasks exhibit interference in their trial-to-trial response correlations: the recalled target location in the current trial is biased in the direction of the target presented on the previous trial. We present modeling work that (a) develops a probabilistic inference model of this history-dependent bias, and (b) links our probabilistic model to computations of a recurrent network wherein short-term facilitation accounts for the dynamics of the observed bias. Network connectivity is reshaped dynamically during each trial, providing a mechanism for generating predictions from prior trial observations. Applying timescale separation methods, we can obtain a low-dimensional description of the trial-to-trial bias based on the history of target locations. The model has response statistics whose mean is centered at the true target location across many trials, typical of such visual working memory tasks. Furthermore, we demonstrate task protocols for which the plastic model performs better than a model with static connectivity: repetitively presented targets are better retained in working memory than targets drawn from uncorrelated sequences.

neuroscience↗