Search bioRxiv⌕ Search

Biology subjects

Goris, R. L. T.

Publications and source records attributed to Goris, R. L. T..

8 recordsLinked to original sources

The human language processing system straightens natural speech

Large language models trained on next-word prediction have impressive linguistic capabilities. This suggests that the goal of temporal prediction is essential to language processing, but how this goal impacts the structure of speech representations in the human brain remains unknown. Here, we test the hypothesis that prediction is facilitated by the temporal straightening of representational trajectories along the speech processing hierarchy. We developed a methodology for measuring the curvature of these trajectories using fMRI. Our method exploits a previously unknown connection between the timescale of single-unit responses and the curvature of population trajectories. We examined brain responses of subjects listening to natural speech. Response trajectories were most curved in lower-level auditory areas and progressively straightened along the cortical hierarchy. We presented the same speech stimuli and perturbed versions thereof to wavLM--a speech representation model that is well aligned with human brain responses--and found that hierarchical straightening effects are strongest for stimuli whose statistical structure resembles natural speech. Together, our results establish a direct connection between the goal of temporal prediction, the geometry of neural speech representations, and the cortical hierarchy of representational timescales.

neuroscience↗

Reassessing Choice Probability: What 59 Macaque Studies Tell Us About Decision-Related Activity in Visual Cortex

Choice probability (CP) quantifies the trial-by-trial covariation between a sensory neurons response and perceptual reports. Despite extensive interest in CP as a window into how perception is linked to the activity of sensory neurons, the usefulness of CP remains debated. On one hand, reported CP magnitudes vary widely across seemingly equivalent studies, questioning its utility as a metric. On the other hand, the absence of clear patterns in CP variability has made it difficult to use it to adjudicate between competing models of visual perception. Here, we performed a meta-analysis of 150 CP estimates from 59 macaque neurophysiology studies to identify factors that systematically influence CP. We confirmed the positive relationship between CP and neuronal sensitivity both across and within individual studies. When controlled for sensitivity, we found remarkable consistency in CP across varying tasks and brain regions with two notable exceptions. First, CPs were higher in tasks involving bistable percepts, reinforcing the link between CP magnitude and subjective perception. Second, CPs were smaller in area V1, supporting prior suggestions about V1s special role in visual processing. We further found a significant effect of stimulus duration on CP, providing evidence against strictly feedforward models and favoring models with substantial feedback and recurrent processing. Finally, we offer recommendations for future studies to enhance the cross-study comparability and theoretical utility of choice signals as the field transitions to large-scale population recordings. More broadly, our findings demonstrate the benefits of meta-studies that expose patterns across many different tasks and animals - yielding insights that complement large-scale population recordings.

neuroscience↗

Bayesian inference by visuomotor neurons in prefrontal cortex

Perceptual judgements of the environment emerge from the concerted activity of neural populations in decision-making areas downstream of sensory cortex [1, 2, 3]. When the sensory input is ambiguous, perceptual judgements can be biased by prior expectations shaped by environmental regularities [4, 5, 6, 7, 8, 9, 10, 11]. These effects are examples of Bayesian inference, a reasoning method in which prior knowledge is leveraged to optimize uncertain decisions [12, 13]. However, it is not known how decision-making circuits combine sensory signals and prior expectations to form a perceptual decision. Here, we study neural population activity in the prefrontal cortex of macaque monkeys trained to report perceptual judgments of ambiguous visual stimuli under two different stimulus distributions. We analyze the component of the neural population response that represents the formation of the perceptual decision (the decision variable, DV), and find that its dynamical evolution reflects the integration of sensory signals and prior expectations. Prior expectations impact the DVs trajectory both before and during stimulus presentation such that DV trajectories with a smaller dynamic range result in more biased and less sensitive perceptual decisions. These results reveal a mechanism by which prefrontal circuits can execute Bayesian inference.

neuroscience↗

Sensory population activity reveals confidence computations in the primate visual system

Perception is fallible1-3. Humans know this4-6, and so do some non-human animals like macaque monkeys7-14. When monkeys report more confidence in a perceptual decision, that decision is more likely to be correct. It is not known how neural circuits in the primate brain assess the quality of perceptual decisions. Here, we test two hypotheses. First, that decision confidence is related to the structure of population activity in sensory cortex. And second, that this relation differs from the one between sensory activity and decision content. We trained macaque monkeys to judge the orientation of ambiguous stimuli and additionally report their confidence in these judgments. We recorded population activity in the primary visual cortex and used decoders to expose the relationship between this activity and the choice-confidence reports. Our analysis validated both hypotheses and suggests that perceptual decisions arise from a neural computation downstream of visual cortex that estimates the most likely interpretation of a sensory response, while decision confidence instead reflects a computation that evaluates whether this sensory response will produce a reliable decision. Our work establishes a direct link between neural population activity in sensory cortex and the metacognitive ability to introspect about the quality of perceptual decisions.

neuroscience↗

Neuronal and behavioral responses to naturalistic texture images in macaque monkeys

The visual world is richly adorned with texture, which can serve to delineate important elements of natural scenes. In anesthetized macaque monkeys, selectivity for the statistical features of natural texture is weak in V1, but substantial in V2, suggesting that neuronal activity in V2 might directly support texture perception. To test this, we investigated the relation between single cell activity in macaque V1 and V2 and simultaneously measured behavioral judgments of texture. We generated stimuli along a continuum between naturalistic texture and phase-randomized noise and trained two macaque monkeys to judge whether a sample texture more closely resembled one or the other extreme. Analysis of responses revealed that individual V1 and V2 neurons carried much less information about texture naturalness than behavioral reports. However, the sensitivity of V2 neurons, especially those preferring naturalistic textures, was significantly closer to that of behavior compared with V1. The firing of both V1 and V2 neurons predicted perceptual choices in response to repeated presentations of the same ambiguous stimulus in one monkey, despite low individual neural sensitivity. However, neither population predicted choice in the second monkey. We conclude that neural responses supporting texture perception likely continue to develop downstream of V2. Further, combined with neural data recorded while the same two monkeys performed an orientation discrimination task, our results demonstrate that choice-correlated neural activity in early sensory cortex is unstable across observers and tasks, untethered from neuronal sensitivity, and thus unlikely to reflect a critical aspect of the formation of perceptual decisions. Significance statementAs visual signals propagate along the cortical hierarchy, they encode increasingly complex aspects of the sensory environment and likely have a more direct relationship with perceptual experience. We replicate and extend previous results from anesthetized monkeys differentiating the selectivity of neurons along the first step in cortical vision from area V1 to V2. However, our results further complicate efforts to establish neural signatures that reveal the relationship between perception and the neuronal activity of sensory populations. We find that choice-correlated activity in V1 and V2 is unstable across different observers and tasks, and also untethered from neuronal sensitivity and other features of nonsensory response modulation.

neuroscience↗

How does V1 population activity inform perceptual certainty?

Neural population activity in sensory cortex informs our perceptual interpretation of the environment. Oftentimes, this population activity will support multiple alternative interpretations. The larger the set of plausible alternatives, the more uncertain the selected perceptual interpretation. We test the hypothesis that the reliability of perceptual interpretations can be revealed through simple transformations of sensory population activity. We recorded V1 population activity in fixating macaques while presenting oriented stimuli under different levels of nuisance variability and signal strength. We developed a decoding procedure to infer from V1 activity the most likely stimulus orientation as well as the certainty of this estimate. Our analysis shows that response magnitude, response dispersion, and variability in response gain all offer useful proxies for orientation certainty. Of these three metrics, the last one has the strongest association with the decoders uncertainty estimates. These results clarify that the nature of neural population activity in sensory cortex provides downstream circuits with multiple options to assess the reliability of perceptual interpretations.

neuroscience↗

Perceptual decisions exhibit hallmarks of dynamic Bayesian inference

To interpret the sensory environment, the brain combines ambiguous sensory measurements with context-specific prior experience. But environmental contexts can change abruptly and unpredictably, resulting in uncertainty about the current context. Here we address two questions: how should context-specific prior knowledge optimally guide the interpretation of sensory stimuli in changing environments, and do human decision-making strategies resemble this optimum? We probe these questions with a task in which subjects report the orientation of ambiguous visual stimuli that were drawn from three dynamically switching distributions, representing different environmental contexts. We derive predictions for an ideal Bayesian observer that leverages the statistical structure of the task to maximize decision accuracy and show that its decisions are biased by task context. The magnitude of this decision bias is not a fixed property of the sensory measurement but depends on the observers belief about the current context. The model therefore predicts that decision bias will grow with the reliability of the context cue, the stability of the environment, and with the number of trials since the last context switch. Analysis of human choice data validates all three predictions, providing evidence that the brain continuously updates probabilistic representations of the environment to best interpret an uncertain, ever-changing world. SIGNIFICANCEThe brain relies on prior knowledge to make perceptual inferences when sensory information is ambiguous. However, when the environmental context changes, the appropriate prior knowledge often changes with it. Here, we develop a Bayesian observer model to investigate how to make optimal perceptual inferences when sensory information and environmental context are both uncertain. The behavioral signature of this strategy is a context-appropriate decision bias whose strength grows with the reliability of the context cue, the stability of the environment, and with the number of decisions since the most recent change in context. We identified exactly this pattern in the behavior of human subjects performing a dynamic orientation discrimination task. Together, our results suggest that the brain continuously updates probabilistic representations of the environment to make perceptual decisions in the face of uncertainty over both sensory and contextual information.

neuroscience↗

Compound stimuli reveal the structure of visual motion selectivity in macaque MT neurons

Motion selectivity in primary visual cortex (V1) is approximately separable in orientation, spatial frequency, and temporal frequency (\"frequency-separable\"). Models for area MT neurons posit that their selectivity arises by combining direction-selective V1 afferents whose tuning is organized around a tilted plane in the frequency domain, specifying a particular direction and speed (\"velocity-separable\"). This construction explains \"pattern direction selective\" MT neurons, which are velocity-selective but relatively invariant to spatial structure, including spatial frequency, texture and shape. Surprisingly, when tested with single drifting gratings, most MT neurons responses are fit equally well by models with either form of separability. However, responses to plaids (sums of two moving gratings) tend to be better described as velocity-separable, especially for pattern neurons. We conclude that direction selectivity in MT is primarily computed by summing V1 afferents, but pattern-invariant velocity tuning for complex stimuli may arise from local, recurrent interactions.\n\nSignificance StatementHow do sensory systems build representations of complex features from simpler ones? Visual motion representation in cortex is a well-studied example: the direction and speed of moving objects, regardless of shape or texture, is computed from the local motion of oriented edges. Here we quantify tuning properties based on single-unit recordings in primate area MT, then fit a novel, generalized model of motion computation. The model reveals two core properties of MT neurons -- speed tuning and invariance to local edge orientation -- result from a single organizing principle: each MT neuron combines afferents that represent edge motions consistent with a common velocity, much as V1 simple cells combine thalamic inputs consistent with a common orientation.

neuroscience↗