Search bioRxiv⌕ Search

Biology subjects

Drugowitsch, J.

Publications and source records attributed to Drugowitsch, J..

At least 19 recordsLinked to original sources

Flexible compression of sensory evidence makes human decisions more resilient to noisy neural computations

Categorizing ambiguous stimuli requires accumulating sensory evidence over time through noisy neural computations. Theories disagree on whether this evidence is accumulated in its native sensory space or in an abstract and compressed category space that retains only decision-relevant information. Here we designed a visual categorization task in which revealing decision categories before or after a stimulus sequence determines which space can be used to accumulate evidence, without changing the optimal decision. Humans were more accurate, and their inferences less noisy, when they could accumulate evidence in category space. Concurrent magnetoencephalographic (MEG) recordings revealed flexible and accuracy-predictive representations of evidence compressed onto decision categories in these conditions. Recurrent neural networks (RNNs) trained on the same task developed the same strategy, which made their decisions more resilient to noisy computations. Together, these findings suggest that the human brain mitigates the cost of noisy inferences by focusing limited computational resources on decision-relevant information.

neuroscience↗

A unifying theory of receptive field heterogeneity predicts hippocampal spatial tuning

Neural populations exhibit receptive fields that vary in their sizes and shapes. Despite the prevalence of such tuning heterogeneity, we lack a unified theory of its computational benefits. Here, we present a framework that unifies and extends previous theories, finding that receptive field heterogeneity generally increases the information encoded in population activity. The information gain depends on heterogeneity in receptive field size, shape, and on the dimensionality of the encoded quantity. For populations encoding two-dimensional quantities, such as place cells encoding allocentric spatial position, our theory predicts that both size and shape receptive field heterogeneity are necessary to induce information gain, whereas size heterogeneity alone is insufficient. We thus turned to CA1 hippocampal activity to test our theoretical predictions--in particular, to measure shape heterogeneity, which has previously received little attention. To overcome limitations of traditional methods for estimating place cell tuning, we developed a fully probabilistic approach for measuring size and shape heterogeneity, in which tuning estimates were strategically weighted by explicitly measured uncertainty arising from biased or incomplete traversals of the environment. Our method furnished evidence that hippocampal receptive fields indeed exhibit strong degrees of size and shape heterogeneity, abiding by the normative predictions of our theory. Overall, our work makes novel predictions about the relative benefits of receptive field heterogeneities beyond our application to place cells, and provides a principled technique for testing them.

neuroscience↗

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards -- an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons -- D1 and D2 MSNs -- contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

neuroscience↗

Competitive integration of time and reward explains value-sensitive foraging decisions and frontal cortex ramping dynamics

Patch foraging presents a ubiquitous decision-making process in which animals decide when to abandon a resource patch of diminishing value to pursue an alternative. We developed a virtual foraging task in which mouse behavior varied systematically with patch value. Mouse behavior could be explained by a model integrating time and rewards antagonistically, scaled by a latent patience state. The model accounted for deviations from predictions of optimal foraging theory. Neural recordings throughout frontal areas revealed encoding of decision variables from the integrator model, most robustly in frontal cortex. Regression modeling followed by unsupervised clustering identified a subset of ramping neurons. These neurons firing rates ramped up gradually (up to tens of seconds), were inhibited by rewards, and were better described as a continuous ramp than a discrete stepping process. Together, these results identify integration via frontal cortex ramping dynamics as a candidate mechanism for solving patch foraging problems.

neuroscience↗

Nerve injury disrupts temporal processing in the spinal cord dorsal horn through alterations in PV+ interneurons

How mechanical allodynia following nerve injury is encoded in patterns of neural activity in the spinal cord dorsal horn (DH) is not known. We addressed this using the spared nerve injury model of neuropathic pain and in vivo electrophysiological recordings. Surprisingly, despite dramatic behavioral over-reactivity to mechanical stimuli following nerve injury, an overall increase in sensitivity or reactivity of DH neurons was not observed. We did, however, observe a marked decrease in correlated neural firing patterns, including the synchrony of mechanical stimulus-evoked firing, across the DH. Alterations in DH temporal firing patterns were recapitulated by silencing DH parvalbumin+ (PV+) inhibitory interneurons, previously implicated in mechanical allodynia, as were allodynic pain-like behaviors in mice. These findings reveal decorrelated DH network activity, driven by alterations in PV+ interneurons, as a prominent feature of neuropathic pain, and suggest that restoration of proper temporal activity is a potential treatment for chronic neuropathic pain.

neuroscience↗

Causal inference during closed-loop navigation: parsing of self- and object-motion

A key computation in building adaptive internal models of the external world is to ascribe sensory signals to their likely cause(s), a process of Bayesian Causal Inference (CI). CI is well studied within the framework of two-alternative forced-choice tasks, but less well understood within the cadre of naturalistic action-perception loops. Here, we examine the process of disambiguating retinal motion caused by self- and/or object-motion during closed-loop navigation. First, we derive a normative account specifying how observers ought to intercept hidden and moving targets given their belief over (i) whether retinal motion was caused by the target moving, and (ii) if so, with what velocity. Next, in line with the modeling results, we show that humans report targets as stationary and steer toward their initial rather than final position more often when they are themselves moving, suggesting a misattribution of object-motion to the self. Further, we predict that observers should misattribute retinal motion more often: (i) during passive rather than active self-motion (given the lack of an efference copy informing self-motion estimates in the former), and (ii) when targets are presented eccentrically rather than centrally (given that lateral self-motion flow vectors are larger at eccentric locations during forward self-motion). Results confirm both of these predictions. Lastly, analysis of eye-movements show that, while initial saccades toward targets are largely accurate regardless of the self-motion condition, subsequent gaze pursuit was modulated by target velocity during object-only motion, but not during concurrent object- and self-motion. These results demonstrate CI within action-perception loops, and suggest a protracted temporal unfolding of the computations characterizing CI.

neuroscience↗

Efficient metacognitive control of imprecise statistical inference

Statistical inference is the optimal process for forming and maintaining accurate beliefs about uncertain environments. However, human inference comes with costs due to its associated biases and limited precision. Indeed, biased or imprecise inference can trigger variable beliefs and unwarranted changes in behavior. Here, by studying decisions in a sequential categorization task based on noisy visual stimuli, we obtained converging evidence that humans reduce the variability of their beliefs by updating them only when the reliability of incoming sensory information is judged as sufficiently strong. Instead of integrating the evidence provided by all stimuli, participants actively discarded as much as a third of stimuli. This conditional belief updating strategy shows good test-retest reliability, correlates with perceptual confidence, and explains human behavior better than previously described strategies. This seemingly suboptimal strategy not only reduces the costs of imprecise computations, but counter-intuitively increases the accuracy of resulting decisions.

animal behavior and cognition↗

A Bayesian perspective on the ring attractor for heading-direction tracking in the Drosophila central complex

Working memories are thought to be held in attractor networks in the brain. These attractors should keep track of the uncertainty associated with each memory, so as to weigh it properly against conflicting new evidence. However, conventional attractors do not represent uncertainty. Here we show how uncertainty could be incorporated into an attractor, specifically a ring attractor that encodes head direction. First, we introduce the first rigorous normative framework (the circular Kalman filter) for benchmarking the performance of a ring attractor under conditions of uncertainty. Next we show that the recurrent connections within a conventional ring attractor can be re-tuned to match this benchmark. This allows the amplitude of network activity to grow in response to confirmatory evidence, while shrinking in response to poor-quality or strongly conflicting evidence. This "Bayesian ring attractor" performs near-optimal angular path integration and evidence accumulation. Indeed, we show that a Bayesian ring attractor is consistently more accurate than a conventional ring attractor. Moreover, near-optimal performance can be achieved without exact tuning of the network connections. Finally, we use large-scale connectome data to show that the network can achieve near-optimal performance even after we incorporate biological constraints. Our work demonstrates how attractors can implement a dynamic Bayesian inference algorithm in a biologically plausible manner, and it makes testable predictions with direct relevance to the head direction system, as well as any neural system that tracks direction, orientation, or periodic rhythms. Significance StatementData from human subjects as well as animals shows that working memories are associated with a sense of uncertainty. Indeed, a sense of uncertainty is what allows an observer to properly weigh new evidence against their current memory. However, we do not understand how the brain tracks uncertainty. Here we describe a simple and biologically plausible network model that can track the uncertainty associated with a working memory. The representation of uncertainty in this model improves the accuracy of its working memory, as compared to conventional models, because it assigns the proper weight to new conflicting evidence. Our model provides a new interpretation for observed fluctuations in brain activity, and it makes testable new predictions.

neuroscience↗

Structure in motion: visual motion perception as online hierarchical inference

Identifying the structure of motion relations in the environment is critical for navigation, tracking, prediction, and pursuit. Yet, little is known about the mental and neural computations that allow the visual system to infer this structure online from a volatile stream of visual information. We propose online hierarchical Bayesian inference as a principled solution for how the brain might solve this complex perceptual task. We derive an online Expectation-Maximization algorithm that explains human percepts qualitatively and quantitatively for a diverse set of stimuli, covering classical psychophysics experiments, ambiguous motion scenes, and illusory motion displays. We thereby identify normative explanations for the origin of human motion structure perception and make testable predictions for new psychophysics experiments. The proposed online hierarchical inference model furthermore affords a neural network implementation which shares properties with motion-sensitive cortical areas and motivates a novel class of experiments to reveal the neural representations of latent structure.

neuroscience↗

A large majority of awake hippocampal sharp-wave ripples feature spatial trajectories with momentum

During periods of rest, hippocampal place cells feature bursts of activity called sharp-wave ripples (SWRs). Heuristic approaches to their analysis have revealed that a small fraction of SWRs appear to "simulate" trajectories through the environment--called awake hippocampal replay--while the functional role of a majority of these SWRs remains unclear. Applying a novel probabilistic approach to characterize the spatio-temporal dynamics embedded in SWRs, we instead show that almost all SWRs of foraging rodents simulate such trajectories through the environment. Furthermore, these trajectories feature momentum, that is, inertia in their velocities, that mirrors the animals natural movement. This stands in contrast to replay events during sleep which seem to follow Brownian motion without such momentum. Lastly, interpreting the replay trajectories in the context of navigational planning revealed that similar past analyses were biased by the heuristic SWR sub-selection. Overall, our approach provides a more complete characterization of the spatio-temporal dynamics within SWRs, highlights qualitative differences between sleep and awake replay, and ought to support future, more detailed, and less biased analysis of the role of awake replay in navigational planning.

neuroscience↗

Specific cognitive signatures of information seeking in controllable environments

In uncertain environments, seeking information about alternative choice options is essential for adaptive learning and decision-making. However, information seeking is usually confounded with changes-of-mind about the reliability of the preferred option. Here, we exploited the fact that information seeking requires control over which option to sample to isolate its behavioral and neurophysiological signatures. We found that changes-of-mind occurring with control require more evidence against the current option, are associated with reduced confidence, but are nevertheless more likely to be confirmed on the next decision. Multimodal neurophysiological recordings showed that these changes-of-mind are preceded by stronger activation of the dorsal attention network in magnetoencephalography (MEG), and followed by increased pupil-linked arousal during the presentation of decision outcomes. Together, these findings indicate that information seeking increases the saliency of evidence perceived as the direct consequence of ones own actions. HighlightsO_LIExploration-exploitation dilemmas confound information seeking with changes-of-mind. C_LIO_LIUnlike changes-of-mind, information seeking requires control over information sampling. C_LIO_LIInformation seeking is associated with reduced confidence and active hypothesis testing. C_LIO_LIStronger neurophysiological correlates of attention and arousal during information seeking. C_LI

neuroscience↗

Human visual motion perception shows hallmarks of Bayesian structural inference

Motion relations in visual scenes carry an abundance of behaviorally relevant information, but little is known about the computations underlying the identification of visual motion structure by humans. We addressed this gap in two psychophysics experiments and found that participants identified hierarchically organized motion relations in close correspondence with Bayesian structural inference. We demonstrate that, for our tasks, a choice model based on the Bayesian ideal observer can accurately match many facets of human structural inference, including task performance, perceptual error patterns, single-trial responses, participant-specific differences, and subjective decision confidence, particularly when motion scenes are ambiguous. Our work can guide future neuroscience experiments to reveal the neural mechanisms underlying higher-level visual motion perception.

neuroscience↗

Optimal policy for attention-modulated decisionsexplains human fixation behavior

Traditional accumulation-to-bound decision-making models assume that all choice options are processed simultaneously with equal attention. In real life decisions, however, humans tend to alternate their visual fixation between individual items in order to efficiently gather relevant information [46, 23, 21, 12, 15]. These fixations also causally affect ones choices, biasing them toward the longer-fixated item [38, 2, 25]. We derive a normative decision-making model in which fixating a choice item boosts information about that item. In contrast to previous models [25, 39], we assume that attention enhances the reliability of information rather than its magnitude, consistent with neurophysiological findings [3, 13, 29, 45]. Furthermore, our model actively controls fixation changes to optimize information gathering. We show that the optimal model reproduces fixation patterns and fixation-related choice biases seen in human decision-makers, and provides a Bayesian computational rationale for the fixation bias. This insight led to additional behavioral predictions that we confirmed in human behavioral data. Finally, we explore the consequences of changing the relative allocation of cognitive resources to the attended versus the unattended item, and show that decision performance is benefited by a more balanced spread of cognitive resources.

neuroscience↗

The breadth-depth dilemma in a finite capacity model of decision-making

Decision-makers are often faced with limited information about the outcomes of their choices. Current formalizations of uncertain choice, such as the explore-exploit dilemma, do not apply well to decisions in which search capacity can be allocated to each option in variable amounts. Such choices confront decision-makers with the need to tradeoff between breadth - allocating a small amount of capacity to each of many options - and depth - focusing capacity on a few options. We formalize the breadth-depth dilemma through a finite sample capacity model. We find that, if capacity is smaller than 4-7 samples, it is optimal to draw one sample per alternative, favoring breadth. However, for larger capacities, a sharp transition is observed, and it becomes best to deeply sample a very small fraction of alternatives, that decreases with the square root of capacity. Thus, ignoring most options, even when capacity is large enough to shallowly sample all of them, reflects a signature of optimal behavior. Our results also provide a rich casuistic for metareasoning in multi-alternative decisions with bounded capacity.

neuroscience↗

Scaling of information in large neural populations reveals signatures of information-limiting correlations

How is information distributed across large neuronal populations within a given brain area? One possibility is that information is distributed roughly evenly across neurons, so that total information scales linearly with the number of recorded neurons. Alternatively, the neural code might be highly redundant, meaning that total information saturates. Here we investigated how information about the direction of a moving visual stimulus is distributed across hundreds of simultaneously recorded neurons in mouse primary visual cortex (V1). We found that information scales sublinearly, due to the presence of correlated noise in these populations. Using recent theoretical advances, we compartmentalized noise correlations into information-limiting and nonlimiting components, and then extrapolated to predict how information grows when neural populations are even larger. We predict that tens of thousands of neurons are required to encode 95% of the information about visual stimulus direction, a number much smaller than the number of neurons in V1. Overall, these findings suggest that the brain uses a widely distributed, but nonetheless redundant code that supports recovering most information from smaller subpopulations.

neuroscience↗

Interacting with volatile environments stabilizes hidden-state inference and its brain signatures

Making accurate decisions in uncertain environments requires identifying the generative cause of sensory cues, but also the expected outcomes of possible actions. Although both cognitive processes can be formalized as Bayesian inference, they are commonly studied using different experimental frameworks, making their formal comparison difficult. Here, by framing a reversal learning task either as cue-based or outcome-based inference, we found that humans perceive the same volatile environment as more stable when inferring its hidden state by interaction with uncertain outcomes than by observation of equally uncertain cues. Multivariate patterns of magnetoencephalo-graphic (MEG) activity reflected this behavioral difference in the neural interaction between inferred beliefs and incoming evidence, an effect originating from associative regions in the temporal lobe. Together, these findings indicate that the degree of control over the sampling of volatile environments shapes human learning and decision-making under uncertainty.

neuroscience↗

Hierarchical structure is employed by humans during visual motion perception

In the real world, complex dynamic scenes often arise from the composition of simpler parts. The visual system exploits this structure by hierarchically decomposing dynamic scenes: when we see a person walking on a train or an animal running in a herd, we recognize the individuals movement as nested within a reference frame that is itself moving. Despite its ubiquity, surprisingly little is understood about the computations underlying hierarchical motion perception. To address this gap, we developed a novel class of stimuli that grant tight control over statistical relations among object velocities in dynamic scenes. We first demonstrate that structured motion stimuli benefit human multiple object tracking performance. Computational analysis revealed that the performance gain is best explained by human participants making use of motion relations during tracking. A second experiment, using a motion prediction task, reinforced this conclusion and provided fine-grained information about how the visual system flexibly exploits motion structure.

neuroscience↗

Optimal policy for multi-alternative decisions

Every-day decisions frequently require choosing among multiple alternatives. Yet, the optimal policy for such decisions is unknown. Here we derive the normative policy for general multi-alternative decisions. This strategy requires evidence accumulation to nonlinear, time-dependent bounds, that trigger choices. A geometric symmetry in those boundaries allows the optimal strategy to be implemented by a simple neural circuit involving a normalization with fixed decision bounds and an urgency signal. The model captures several key features of the response of decision-making neurons as well as the increase in reaction time as a function of the number of alternatives, known as Hicks law. In addition, we show that, in the presence of divisive normalization and internal variability, our model can account for several so called irrational behaviors such as the similarity effect as well as the violation of both the independent irrelevant alternative principle and the regularity principle.

neuroscience↗