Biology subjects

Bays, P. M.

Publications and source records attributed to Bays, P. M..

6 recordsLinked to original sources

bioRxiv2025

Intrinsic rewards guide visual resource allocation via reinforcement learning

Humans and other animals prioritise visual processing of stimuli that signal rewards. While prior research has focused on tangible incentives (e.g., money or food), the effects of intrinsic incentives - such as perceived competence - are less well understood. Across a series of visual estimation experiments, we manipulated observers subjective sense of confidence in their judgements using either deceptive trial-by-trial feedback or real discrepancies in stimulus reliability. We found that observers prioritised encoding of stimuli associated with lower uncertainty or error, benefiting performance for stimuli already estimated accurately, while further impairing performance for those estimated poorly. These reward-driven biases, while potentially adaptive, impaired overall accuracy in the present tasks by causing resource allocation to deviate from the error-minimizing strategy. To account for these findings, we supplemented a normalization model of neural resource allocation with a simple reinforcement learning rule. Intrinsic and external rewards cumulatively shaped the values assigned to different stimuli by the model, and the resulting discrepancies biased resource allocation and thereby estimation error, quantitatively matching the data. These findings reveal how intrinsic reward signals can shape resource allocation in ways that are both adaptive and counterproductive, offering a computational basis for the motivational biases underlying cognitive performance.

neuroscience↗

bioRxiv2023

A dynamic neural resource model bridges sensory and working memory

Probing memory of a complex visual image within a few hundred milliseconds after its disappearance reveals significantly greater fidelity of recall than if the probe is delayed by as little as a second. Classically interpreted, the former taps into a detailed but rapidly decaying visual sensory or "iconic" memory (IM), while the latter relies on capacity-limited but comparatively stable visual working memory (VWM). While iconic decay and VWM capacity have been extensively studied independently, currently no single framework quantitatively accounts for the dynamics of memory fidelity over these timescales. Here we extend a stationary neural population model of VWM with a temporal dimension, incorporating rapid sensory-driven accumulation of activity encoding each visual feature in memory, and a slower accumulation of internal error that causes memorized features to randomly drift over time. Instead of facilitating read-out from an independent sensory store, an early cue benefits recall by lifting the effective limit on VWM signal strength imposed when multiple items compete for representation, allowing memory for the cued item to be supplemented with information from the decaying sensory trace. Empirical measurements of human recall dynamics validate these predictions while excluding alternative model architectures. A key conclusion is that differences in capacity classically thought to distinguish IM and VWM are in fact contingent upon a single resource-limited WM store.

neuroscience↗

bioRxiv2021

Transsaccadic integration operates independently in different feature dimensions

Our knowledge about objects in our environment reflects an integration of current visual input with information from preceding gaze fixations. Such a mechanism may reduce uncertainty, but requires the visual system to determine which information obtained in different fixations should be combined or kept separate. To investigate the basis of this decision, we conducted three experiments. Participants viewed a stimulus in their peripheral vision, then made a saccade that shifted the object into the opposite hemifield. During the saccade, the object underwent changes of varying magnitude in two feature dimensions (Experiment 1: color and location, Experiments 2 and 3: color and orientation). Participants reported whether they detected any change and estimated one of the post-saccadic features. Integration of pre-saccadic with post-saccadic input was observed as a bias in estimates towards the pre-saccadic feature value. In all experiments, pre-saccadic bias weakened as the magnitude of the transsaccadic change in the estimated feature increased. Changes in the other feature, despite having a similar probability of detection, had no effect on integration. Results were quantitatively captured by an observer model where the decision whether to integrate information from sequential fixations is made independently for each feature and coupled to awareness of a feature change.

neuroscience↗

bioRxiv2019

Theory of neural coding predicts an upper bound on estimates of memory variability

Observers reproducing elementary visual features from memory after a short delay produce errors consistent with the encoding-decoding properties of neural populations. While inspired by electrophysiological observations of sensory neurons in cortex, the population coding account of these errors is based on a mathematical idealization of neural response functions that abstracts away most of the heterogeneity and complexity of real neuronal populations. Here we examine a more physiologically grounded model based on the tuning of a large set of neurons recorded in macaque V1, and show that key predictions of the idealized model are preserved. Both models predict long-tailed distributions of error when memory resources are taxed, as observed empirically in behavioral experiments and commonly approximated with a mixture of normal and uniform error components. Specifically, for an idealized homogeneous neural population, the width of the fitted normal distribution cannot exceed the average tuning width of the component neurons, and this also holds to a good approximation for more biologically realistic populations. Examining eight published studies of orientation recall, we find a consistent pattern of results suggestive of a median tuning width of approximately 20 degrees, which compares well with neurophysiological observations. The finding that estimates of variability obtained by the normal-plus-uniform mixture method are bounded from above leads us to reevaluate previous studies that interpreted a saturation in width of the normal component as evidence for fundamental limits on the precision of perception, working memory and long-term memory.

neuroscience↗

bioRxiv2019

Correspondence between population coding andpsychophysical scaling models of working memory

A mathematical idealization of the way neural populations encode sensory information has been found to provide a parsimonious account of errors made by human observers on perceptual and short-term memory tasks. This includes the effects of set size and flexible prioritization of items within a set (Bays, 2014), the frequency and identity of \"swap\" or misbinding errors (Schneegans & Bays, 2017), subjective judgments of confidence (Bays, 2016; van den Berg et al., 2017), and biases and variation in precision due to serial dependent and stimulus-specific effects (Bliss et al., 2017; Taylor & Bays, 2018). A superficially quite different account of short-term recall has recently been proposed in work by Schurgin et al. (2018), who argue that taking into account the differences between physical and perceptual distance in a feature space reduces recall to a classical signal detection problem. Here I document a remarkable similarity between the two models, demonstrating a favourable convergence of neural- and cognitive-level accounts of working memory.

neuroscience↗

bioRxiv2017

Visual working memory is independent of the cortical spacing between memoranda

The sensory recruitment hypothesis states that visual short term memory is maintained in the same visual cortical areas that initially encode a stimulus features. Although it is well established that the distance between features in visual cortex determines their visibility, a limitation known as crowding, it is unknown whether short term memory is similarly constrained by the cortical spacing of memory items. Here we investigated whether the cortical spacing between sequentially presented memoranda affects the fidelity of memory in humans (of both sexes). In a first experiment, we varied cortical spacing by taking advantage of the log-scaling of visual cortex with eccentricity, sequentially presenting memoranda in peripheral vision along either the radial or tangential visual axis with respect to the fovea. In a second experiment, we sequentially presented memoranda either within or beyond the critical spacing of visual crowding, a distance within which visual features cannot be perceptually distinguished due to their nearby cortical representations. In both experiments and across multiple measures, we found strong evidence that the ability to maintain visual features in memory is unaffected by cortical spacing. These results indicate that the neural architecture underpinning working memory has properties inconsistent with the known behaviour of sensory neurons in visual cortex. Instead, the dissociation between perceptual and memory representations supports a role of higher cortical areas, such as posterior parietal or prefrontal regions, or may involve an as yet unspecified mechanism in visual cortex in which stimulus features are bound to their temporal order.\n\nSignificance StatementAlthough much is known about the resolution with which we can remember visual objects, the cortical representation of items held in short term memory remains contentious. A popular hypothesis suggests that memory of visual features is maintained via the recruitment of the same neural architecture in sensory cortex that encodes stimuli. We investigated this claim by manipulating the spacing in visual cortex between sequentially presented memoranda such that some items shared cortical representations more than others, while preventing perceptual interference between stimuli. We found clear evidence that short term memory is independent of the intra-cortical spacing of memoranda, revealing a dissociation between perceptual and memory representations. Our data indicate that working memory relies on different neural mechanisms from sensory perception.

neuroscience↗