Search bioRxiv⌕ Search

Biology subjects

Basanisi, R.

Publications and source records attributed to Basanisi, R..

5 recordsLinked to original sources

Sensorimotor encoding of epistemic value during goal-directed causal learning

Understanding the neural and computational mechanisms underlying goal-directed causal learning is a central challenge in both cognitive neuroscience and artificial intelligence. This cognitive function depends on balancing reward maximization with information seeking. Although substantial progress has been made in characterizing the neural basis of reward-driven learning, it remains unclear whether and how intrinsic informational value is represented in the brain and propagated through cortico-cortical interactions. Here, we dissociate information-seeking from reward maximisation during goal-directed causal learning using a novel behavioural paradigm in which participants estimate action-outcome contingencies without extrinsic incentives. Bayesian computational modelling reveals that while random exploration dominates behaviour, expected information gain (EIG) explains a significant proportion of exploratory choices in a subset of sessions. Using magnetoencephalography combined with information-theoretic analyses of high-gamma activity, we show that EIG is encoded in the left sensorimotor cortex at the time of action execution, specifically in dorsal premotor and primary motor cortex, and broadcast to primary somatosensory cortex. These findings are consistent with Active Inference predictions that EIG constitutes a key computational drive for exploratory action selection. However, they challenge the view that epistemic valuation exclusively recruits prefrontal reward circuits, and instead they support an embodied account in which the premotor and sensorimotor system mediates the intrinsic valuation during first-personal interventional causal learning.

neuroscience↗

Higher-order and distributed synergistic functional interactions encode information gain in goal-directed learning

Goal-directed learning arises from distributed neural circuits including the prefrontal, posterior parietal and temporal cortices. However, the role of cortico-cortical functional interactions remains unclear. To address this question, we integrated information dynamics analysis with magnetoencephalography to investigate the encoding of learning signals through neural interactions. Our findings revealed that information gain (the reduction in uncertainty about the causal relationship between actions and outcomes) is represented over the visual, parietal, lateral prefrontal and ventromedial/orbital prefrontal cortices. Cortico-cortical interactions encoded information gain synergistically at the level of pairwise and higher-order relations, such as triplets and quadruplets. Higher-order synergistic interactions were characterized by long-range relationships centered in the ventromedial and orbitofrontal cortices, which served as key receivers in the broadcast of information gain across cortical circuits. Overall, this study provides evidence that information gain is encoded through synergistic and higher-order functional interactions and is broadcast to prefrontal reward circuits.

neuroscience↗

Neural interactions in the human frontal cortex dissociate reward and punishment learning

How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.

neuroscience↗

Group-level inference of information-based measures for the analyses of cognitive brain networks from neurophysiological data

The reproducibility crisis in neuroimaging and in particular in the case of underpowered studies has introduced doubts on our ability to reproduce, replicate and generalize findings. As a response, we have seen the emergence of suggested guidelines and principles for neuroscientists known as Good Scientific Practice for conducting more reliable research. Still, every study remains almost unique in its combination of analytical and statistical approaches. While it is understandable considering the diversity of designs and brain data recording, it also represents a striking point against reproducibility. Here, we propose a non-parametric permutation-based statistical framework, primarily designed for neurophysiological data, in order to perform group-level inferences on non-negative measures of information encompassing metrics from information-theory, machine-learning or measures of distances. The framework supports both fixed- and random-effect models to adapt to inter-individuals and inter-sessions variability. Using numerical simulations, we compared the accuracy in ground-truth retrieving of both group models, such as test- and cluster-wise corrections for multiple comparisons. We then reproduced and extended existing results using both spatially uniform MEG and non-uniform intracranial neurophysiological data. We showed how the framework can be used to extract stereotypical task- and behavior-related effects across the population covering scales from the local level of brain regions, inter-areal functional connectivity to measures summarizing network properties. We also present an open-source Python toolbox called Frites1 that includes the proposed statistical pipeline using information-theoretic metrics such as single-trial functional connectivity estimations for the extraction of cognitive brain networks. Taken together, we believe that this framework deserves careful attention as its robustness and flexibility could be the starting point toward the uniformization of statistical approaches. Graphical abstract O_FIG_DISPLAY_L [Figure 1] M_FIG_DISPLAY C_FIG_DISPLAY HighlightsO_LIGroup-level statistics for extracting neurophysiological cognitive brain networks C_LIO_LICombining non-parametric permutations with measures of information C_LIO_LIFixed- and random-effect models, test- and cluster-wise corrections C_LIO_LIMulti-level inferences, from local regions to inter-areal functional connectivity C_LIO_LIA Python open-source toolbox called Frites includes the proposed statistical methods C_LI

neuroscience↗

A spiking neural-network model of goal-directed behaviour

In mammals, goal-directed and planning processes support flexible behaviour usable to face new situations or changed conditions that cannot be tackled through more efficient but rigid habitual behaviours. Within the Bayesian modelling approach of brain and behaviour, probabilistic models have been proposed to perform planning as a probabilistic inference. Recently, some models have started to face the important challenge met by this approach: grounding such processes on the computations implemented by brain spiking networks. Here we propose a model of goal-directed behaviour that has a probabilistic interpretation and is centred on a recurrent spiking neural network representing the world model. The model, building on previous proposals on spiking neurons and plasticity rules having a probabilistic interpretation, presents these novelties at the system level: (a) the world model is learnt in parallel with its use for planning, and an arbitration mechanism decides when to exploit the world-model knowledge with planning, or to explore, on the basis of an entropy-based confidence on the world model knowledge; (b) the world model is a hidden Markov model (HMM) able to simulate sequences of states and actions, thus planning selects actions through the same neural generative process used to predict states; (c) the world model learns the hidden causes of observations, and their temporal dependencies, through a biologically plausible unsupervised learning mechanism. The model is tested with a visuomotor learning task and validated by comparing its behaviour with the performance and reaction times of human participants solving the same task. The model represents a further step towards the construction of an autonomous architecture bridging goal-directed behaviour as probabilistic inference to brain-like computations. Author summaryGoal-directed behaviour relies on brain processes supporting planning of actions based on the prediction of their consequences before performing them in the environment. An important computational modelling approach of these processes sees the brain as a probabilistic machine implementing goal-directed processes relying on probability distributions and operations on them. An important challenge for this approach is to explain how these distributions and operations might be grounded on the brain spiking neurons and learning processes. Here we propose a hypothesis of how this might happen by presenting a computational model of goal-directed processes based on artificial spiking neural networks. The model presents three main novelties. First, it can plan even while it is still learning the consequences of actions by deciding if planning or exploring the environment based on how confident it is on its predictions. Second, it is able to think alternative possible actions, and their consequences, by relying on the low-level stochasticity of neurons. Third, it can learn to anticipate the consequences of actions in an autonomous fashion based on experience. Overall, the model represents a novel hypothesis on how goal-directed behaviour might rely on the stochastic spiking processes and plasticity mechanisms of the brain neurons.

animal behavior and cognition↗