Search bioRxiv⌕ Search

Biology subjects

Bavard, S.

Publications and source records attributed to Bavard, S..

4 recordsLinked to original sources

Humans integrate gaze and decision cues for inferring preferences in social interactions

Social decision-making depends on inferring others hidden preferences from observable behavior. Yet it remains unclear how humans combine choices with process cues such as response times and gaze when learning about others in real-time interaction. Here we combine a novel multi-attribute bargaining task with eye-tracking and show that multiple decision-process cues support preference inference. Across 75 buyer-seller dyads, buyers acceptance rates tracked offer utility, rejection speed reflected decision confidence, and first fixations preferentially targeted the highest-weighted attribute. Sellers adapted subsequent offers using choices, response times, and, when available, gaze cues. A hierarchical inference and choice model suggested that sellers balanced expected utility with expected information gain and updated their beliefs in a Bayesian manner. Although gaze access did not improve overall performance, it changed how sellers used attentional information. These findings shed light on how humans infer others hidden preferences from decision dynamics in real-time social interaction.

neuroscience↗

The functional form of value normalization in human reinforcement learning

Reinforcement learning research in humans and other species indicates that rewards are represented in a context-dependent manner. More specifically, reward representations seem to be normalized as a function of the value of the alternative options. The dominant view postulates that value context-dependence is achieved via a divisive normalization rule, inspired by perceptual decision-making research. However, behavioral and neural evidence points to another plausible mechanism: range normalization. Critically, previous experimental designs were ill-suited to disentangle the divisive and the range normalization accounts, which generate similar behavioral predictions in many circumstances. To address this question, we designed a new learning task where we manipulated, across learning contexts, the number of options and the value ranges. Behavioral and computational analyses falsify the divisive normalization account and rather provide support for the range normalization rule. Together, these results shed new light on the computational mechanisms underlying context-dependence in learning and decision-making.

animal behavior and cognition↗

The construction and deconstruction of sub-optimal preferences through range-adapting reinforcement learning

Converging evidence suggests that economic values are rescaled as a function of the range of the available options. Critically, although locally adaptive, range adaptation has been shown to lead to suboptimal choices. This is particularly striking in reinforcement learning (RL) situations when options are extrapolated from their original context. Range adaptation can be seen as the result of an adaptive coding process aiming at increasing the signal-to-noise ratio. However, this hypothesis leads to a counter-intuitive prediction: decreasing outcome uncertainty should increase range adaptation and, consequently, extrapolation errors. Here, we tested the paradoxical relation between range adaptation and performance in a large sample of subjects performing variants of a RL task, where we manipulated task difficulty. Results confirmed that range adaptation induces systematic extrapolation errors and is stronger when decreasing outcome uncertainty. Finally, we propose a range-adapting model and show that it is able to parsimoniously capture all the observed results.

animal behavior and cognition↗

Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences

In economics and in perceptual decision-making contextual effects are well documented, where decision weights are adjusted as a function of the distribution of stimuli. Yet, in reinforcement learning literature whether and how contextual information pertaining to decision states is integrated in learning algorithms has received comparably little attention. Here, in an attempt to fill this gap, we investigated reinforcement learning behavior and its computational substrates in a task where we orthogonally manipulated both outcome valence and magnitude, resulting in systematic variations in state-values. Over two experiments, model comparison indicated that subjects behavior is best accounted for by an algorithm which includes both reference point-dependence and range-adaptation - two crucial features of state-dependent valuation. In addition, we found state-dependent outcome valuation to progressively emerge over time, to be favored by increasing outcome information and to be correlated with explicit understanding of the task structure. Finally, our data clearly show that, while being locally adaptive (for instance in negative valence and small magnitude contexts), state-dependent valuation comes at the cost of seemingly irrational choices, when options are extrapolated out from their original contexts.

animal behavior and cognition↗