Search bioRxiv⌕ Search

Biology subjects

Elteto, N.

Publications and source records attributed to Elteto, N..

6 recordsLinked to original sources

AI-Discovered Cognitive Models Reveal Novel Insights into Human and Animal Learning

Scientific models are widely used across the natural sciences as an interface between scientific theories and empirical data [1]. Such models play a key role, for example, in the study of human and animal learning, where they express algorithmic hypotheses and relate them to psychology and neuroscience data [2, 3]. These models are traditionally handcrafted by expert researchers based on existing theory or new insights. Such handcrafted models, however, are now known to fall short of capturing the full richness of behavior, even in their narrow domains [4-7]. An alternative data-driven approach has emerged, seeking to discover new insights by fitting and interpreting flexible models [8-11]. However, these tools require substantial human effort to derive insight from data, and it has been unclear how to discover new ideas from data efficiently. Here, we present DataDIVER, a general approach for automatically discovering computational models from data, and demonstrate that these models surface novel mechanistic insights into human and animal learning. Our approach delivers models that take the form of short computer programs, which are optimized both to fit data well and to be simple. These programs explicitly connect with existing theoretical frameworks and are readily understandable by human scientists. They can also be used to make novel predictions, some of which we show are borne out in re-analysis of existing data. General-purpose tools for surfacing new ideas from data, especially in combination with the large datasets that are increasingly available in many fields, stand to dramatically accelerate scientific discovery.

animal behavior and cognition↗

Discovering Symbolic Cognitive Models from Human and Animal Behavior

Symbolic models play a key role in cognitive science, expressing computationally precise hypotheses about how the brain implements a cognitive process. Identifying an appropriate model typically requires a great deal of effort and ingenuity on the part of a human scientist. Here, we adapt FunSearch Romera-Paredes et al. (2024), a recently developed tool that uses Large Language Models (LLMs) in an evolutionary algorithm, to automatically discover symbolic cognitive models that accurately capture human and animal behavior. We consider datasets from three species performing a classic reward-learning task that has been the focus of substantial modeling effort, and find that the discovered programs outperform state-of-the-art cognitive models for each. The discovered programs can readily be interpreted as hypotheses about human and animal cognition, instantiating interpretable symbolic learning and decision-making algorithms. Broadly, these results demonstrate the viability of using LLM-powered program synthesis to propose novel scientific hypotheses regarding mechanisms of human and animal cognition.

animal behavior and cognition↗

Tracking human skill learning with a hierarchical Bayesian sequence model

Humans can implicitly learn complex perceptuo-motor skills over the course of large numbers of trials. This likely depends on our becoming better able to take advantage of ever richer and temporally deeper predictive relationships in the environment. Here, we offer a novel characterization of this process, fitting a non-parametric, hierarchical Bayesian sequence model to the reaction times of human participants responses over ten sessions, each comprising thousands of trials, in a serial reaction time task involving higher-order dependencies. The model, adapted from the domain of language, forgetfully updates trial-by-trial, and seamlessly combines predictive information from shorter and longer windows onto past events, weighing the windows proportionally to their predictive power. As the model defines a prior over window depths, we were able to determine the extent to which the internal predictions of individual participant depended on how many previous elements. Already in the first session, the model showed that participants had begun to rely on two previous elements (i.e., trigrams), thereby successfully adapting to the most prominent higher-order structure in the task. The extent to which local statistical fluctuations influenced participants responses waned over subsequent sessions, as subjects forgot the trigrams less and evidenced skilled performance. By the eighth session, a subset of participants shifted their prior further to consider a context deeper than two previous elements. Finally, participants showed resistance to interference and slow forgetting of the old sequence when it was changed in the final sessions. Model parameters for individual subjects covaried appropriately with independent measures of working memory. In sum, the model offers the first principled account of the adaptive complexity and nuanced dynamics of humans internal sequence representations during long-term implicit skill learning. Author summaryA central function of the brain is to predict. One challenge of prediction is that both external events and our own actions can depend on a variably deep temporal context of previous events or actions. For instance, in a short motor routine, like opening a door, our actions only depend on a few previous ones (e.g., push the handle if the key was turned). In longer routines such as coffee making, our actions require a deeper context (e.g., place the moka pot on the hob if coffee is ground, the pot is filled and closed, and the hob is on). We adopted a model from the natural language processing literature that matches humans ability to learn variable-length relationships in sequences. This model explained the gradual emergence of more complex sequence knowledge and individual differences in an experiment where humans practiced a perceptual-motor sequence over 10 weekly sessions.

animal behavior and cognition↗

Initial experience has lasting effect on repeated risky decisions

Both primarily and recently encountered information have been shown to influence experience-based risky decision making. The primacy effect predicts that initial experience will influence later choices even if outcome probabilities change and reward is ultimately more or less sparse than primarily experienced. However, it has not been investigated whether extended initial experience would induce a more profound primacy effect upon risky choices than brief experience. Therefore, the present study tested in two experiments whether young adults adjusted their risk-taking behavior in the Balloon Analogue Risk task after an unsignaled and unexpected change point. The change point separated early "good luck" or "bad luck" trials from subsequent ones. While mostly positive (more reward) or mostly negative (no reward) events characterized the early trials, subsequent trials were unbiased. In Experiment 1, the change point occurred after one-sixth or one-third of the trials (brief vs. extended experience) without intermittence, whereas in Experiment 2, it occurred between separate task phases. In Experiment 1, if negative events characterized the early trials, after the change point, risk-taking behavior increased as compared with the early trials. Conversely, if positive events characterized the early trials, risk-taking behavior decreased after the change point. Although the adjustment of risk-taking behavior occurred due to integrating recent experiences, the impact of initial experience was simultaneously observed. The length of initial experience did not reliably influence the adjustment of behavior. In Experiment 2, participants became more prone to take risks as the task progressed, indicating that the impact of initial experience could be overcome. Altogether, we suggest that initial beliefs about outcome probabilities can be updated by recent experiences to adapt to the continuously changing decision environment.

neuroscience↗

Deconstructing Procedural Memory: Different Learning Trajectories and Consolidation of Sequence and Statistical Learning

Procedural learning is a fundamental cognitive function that facilitates efficient processing of and automatic responses to complex environmental stimuli. Here, we examined training-dependent and off-line changes of two sub-processes of procedural learning: namely, sequence learning and statistical learning. Whereas sequence learning requires the acquisition of order-based relationships between the elements of a sequence, statistical learning is based on the acquisition of probabilistic associations between elements. Seventy-eight healthy young adults (58 females and 20 males) completed the modified version of the Alternating Serial Reaction Time task that was designed to measure Sequence and Statistical Learning simultaneously. After training, participants were randomly assigned to one of three conditions: active wakefulness, quiet rest, or daytime sleep. We examined off-line changes in Sequence and Statistical Learning as well as further improvements after extended practice. Performance in Sequence Learning increased during training, while Statistical Learning plateaued relatively rapidly. After the off-line period, both the acquired sequence and statistical knowledge was preserved, irrespective of the vigilance state (awake, quiet rest or sleep). Sequence Learning further improved during extended practice, while Statistical Learning did not. Moreover, within the sleep group, cortical oscillations and sleep spindle parameters showed differential associations with Sequence and Statistical Learning. Our findings can contribute to a deeper understanding of the dynamic changes of multiple parallel learning and consolidation processes that occur during procedural memory formation.

neuroscience↗

Do adolescents take more risks? Not when facing a novel uncertain situation

In real-life decision-making, sub-optimal risk-taking seems characteristic of adolescents. Such behavior increases the chance of serious negative, and at times, irreversible outcomes for this population (e.g., road traffic accidents, addictions). We are still lacking conclusive evidence, however, for an inverted U-shaped developmental trajectory for risk-taking. This raises the question whether adolescents are really more risk-prone or when facing a novel risky situation, they behave just as children and adults do. To answer this question, we used the Balloon Analogue Risk Task (BART) to assess the risky decision making of 188 individuals ranging in age from 7 to 30. The BART provided useful data for characterizing multiple aspects of risk-taking. Surprisingly, we found that adolescents were not more inclined to take risks than children or young adults. Participants in all age groups were able to adapt their learning processes to the probabilistic environment and improve their performance during the sequential risky choice. There were no age-related differences in risk-taking at any stage of the task. Likewise, neither negative feedback reactivity nor overall task performance distinguished adolescents from the younger and older age groups. Our findings prompt 1) methodological considerations about the validity of the BART and 2) theoretical debate whether the amount of experience on its own may account for age-related changes in real-life risk-taking, since risk-taking in a novel and uncertain situation was invariant across developmental stages.

neuroscience↗