Biology subjects

Pavani, F.

Publications and source records attributed to Pavani, F..

7 recordsLinked to original sources

bioRxiv2025

Spatial distance and temporal attentional focus modulate voluntary action preparation and awareness

Peripersonal space (PPS)--the immediate space surrounding the body--modulates perception and motor control. However, its impact on how voluntary actions are initiated and subjectively experienced remains underexplored. Similarly, how directing attention to different phases of an action, such as intention formation versus execution, and anticipating outcomes of an action, modulates the neural readiness for movement, has yet to be fully examined. This study investigates whether spatial proximity, attentional focus, and anticipated action outcomes influence action preparation and action awareness, using a virtual reality adaptation of the Libet clock paradigm during EEG recordings. Neural results reveal that attentional focus and anticipated action outcomes modulate different phases of motor preparation, as indexed by the readiness potential (RP)--a gradual buildup of neural activity preceding voluntary movement. Focusing on decision timing (without subsequent action outcomes) enhances early RP amplitude and decreases the late RP slope, suggesting increased preparatory neural engagement during intention formation. In contrast, focusing on action execution leads to a steeper late RP slope, indicating later and faster motor activity buildup when attention is directed toward movement onset. Anticipating action outcomes increased late RP slope, which was accompanied by the temporal binding effect: when a tone followed the action, both decision and action estimates shifted toward it. Spatial proximity also modulates early RP slope, with a steeper buildup in near versus far space, suggesting facilitated motor preparation within PPS. It further enhances the late RP amplitude when participants focused on their intention to act. Behavioural results show that actions are perceived as occurring earlier when the clock is displayed near compared to far, indicating that PPS influences the temporal perception of action timing. Overall, these findings highlight the dynamic interplay among external spatial context and internal cognitive processes in shaping motor preparation and action awareness. Importantly, a temporal internal attentional focus on intention to act modulates early RP--traditionally considered an unconscious stage of neural readiness. These results contribute to a deeper understanding of how PPS and the locus of attention on specific action phases affect action preparation and awareness, with potential implications for future research on the sense of agency and voluntary action decision making.

neuroscience↗

bioRxiv2025

Prior expectations guide multisensory integration during face-to-face communication

Face-to-face communication relies on the seamless integration of multisensory signals, including voice, gaze, and head movements, to convey meaning effectively. This poses a fundamental computational challenge: optimally binding signals sharing the same communicative intention (e.g. looking at the addressee while speaking) and segregating unrelated signals (e.g. looking away while coughing), all within the rapid turn-taking dynamics of conversation. Critically, the computational mechanisms underlying this extraordinary feat remain largely unknown. Here, we cast face-to-face communication as a Bayesian Causal Inference problem to formally test whether prior expectations arbitrate between the integration and segregation of vocal and bodily signals. Moreover, we asked whether there is a stronger prior tendency to integrate audiovisual signals that show the same communicative intention, thus carrying a crossmodal pragmatic correspondence. In a spatial localization task, participants watched audiovisual clips of a speaker where the audio (voice) and the video (bodily cues) were sampled either from congruent positions or at increasing spatial disparities. Crucially, we manipulated the pragmatic correspondence of the signals: in a communicative condition, the speaker addressed the participant with their head, gaze and speech; in a non-communicative condition, the speaker kept the head down and produced a meaningless vocalization. We measured audiovisual integration through the ventriloquist effect, which quantifies how much the perceived audio position is misplaced towards the video position. Bayesian Causal Inference outperformed competing models in explaining participants behaviour, demonstrating that prior expectations guide multisensory integration during face-to-face communication. Remarkably, participants showed a stronger prior tendency to integrate vocal and bodily information when signals conveyed congruent communicative intent, suggesting that pragmatic correspondences enhance multisensory integration. Collectively, our findings provide novel and compelling evidence that face-to-face communication is shaped by deeply ingrained expectations about how multisensory signals should be structured and interpreted. Author summaryFace-to-face communication is complex: what we say is coupled with bodily signals, offset in time, which may or may not work in concert to convey meaning. Yet, the brain rapidly determines which multisensory signals belong together and which, instead, must be kept apart, suggesting that prior expectations play a crucial role in this decision-making process. Here, we directly tested this hypothesis using Bayesian computational modelling, which allows for isolating the contribution of prior expectations and sensory uncertainty on the final perceptual decision. We found that people have a stronger prior tendency to combine vocal and bodily signals when they convey the same communicative intent (i.e. the speaker addresses the observer concurrently with their head, gaze and speech) relative to when this correspondence is absent. Thus, the brain uses prior expectations to bind multisensory signals that carry converging communicative meaning. These findings provide key insight into the sophisticated mechanisms underpinning efficient multimodal communication.

neuroscience↗

bioRxiv2024

Resilience and vulnerability of speech neural tracking to early auditory deprivation

Infants are born with biological biases that favour language acquisition. One is the auditory systems ability to track the envelope of continuous speech, a pivotal feature for spoken language comprehension in adulthood. However, the extent to which neural speech tracking relies on postnatal auditory experience remains unknown. In this case-control study, we tested children with or without access to functional hearing in the first year of life after they received cochlear implants (CIs) for hearing restoration. We measured neural speech tracking in CI users with a congenital bilateral profound deafness (CD) or who acquired it later in development (AD; minimum auditory experience after birth 12 months), as well as in two groups of hearing controls listening to original (HC) or vocoded-speech (HC-v). Remarkably, neural speech tracking in children with CIs was unaffected by the absence of perinatal auditory experience. Regardless of deafness onset, CI users and HC exhibited a similar neural tracking magnitude at short timescales [~]50- 130 ms (P1TRF) of brain activity. However, this neural tracking phase (P1TRF) was delayed in CI users, and its timing depended on the age of hearing restoration. Conversely, at longer timescales [~]130-260 ms (N2TRF) of brain activity, speech tracking was substantially dampened in participants with CIs, thereby accounting for their comprehension deficits. Speech tracking in HC listening to vocoded-speech and in a phantom head-model with CIs suggested that neural processing differences between HC and CI children could not merely be explained by the degraded acoustic stimulation, nor by electrical artifacts of the implants. These findings highlight (i) the resilience of sensory components of neural speech tracking to the lack of hearing in the first year of life, (ii) the crucial role played when hearing restoration takes place in mitigating the impact of atypical auditory experience, (iii) the vulnerability of higher hierarchical levels of speech processing in CI users.

neuroscience↗

bioRxiv2024

The impact of face masks on face-to-face neural tracking of speech: auditory and visual obstacles

Face masks provide fundamental protection against the transmission of respiratory viruses but hamper communication. We estimated auditory and visual obstacles generated by face masks on communication by measuring the neural tracking of face-to-face speech. To this end, we recorded the EEG while participants were exposed to naturalistic audio-visual speech, embedded in multi-talker noise, in three contexts: (i) no-mask (audio-visual information was fully available), (ii) virtual mask (occluded lips, but intact audio), and (iii) real mask (occluded lips and degraded audio). The neural tracking of lip movements and the sound envelope of speech was measured through backward modeling, that is, by reconstructing stimulus properties from neural activity. Behaviorally, face masks increased listening -phonological-errors in speech content retrieval and perceived listening difficulty. At the neural level, we observed that the occlusion of the mouth abolished lip tracking and dampened neural tracking of the speech envelope at the earliest processing stages. Degraded acoustic information due to face mask filtering altered neural tracking at later processing stages instead. Finally, a consistent link emerged between the increment of listening perceived difficulty and the drop in reconstruction performance of speech envelope when attending to a speaker wearing a face mask. Results clearly dissociated the visual and auditory impacts of face masks on face-to-face neural tracking of speech. While face masks hampered the ability to predict and integrate audio-visual speech, the auditory filter generated by face masks impacted the neural processing stages typically associated with auditory selective attention. The link between perceived difficulty and neural tracking drop provided evidence of a major impact of face masks on the metacognitive levels subtending speech processing.

neuroscience↗

bioRxiv2020

Reaching to sounds in virtual reality: A multisensory-motor approach to re-learn sound localisation

When localising sounds in space the brain relies on internal models that specify the correspondence between the auditory input reaching the ears and initial head-position with coordinates in external space. These models can be updated throughout life, setting the basis for re-learning spatial hearing abilities in adulthood. This is particularly important for individuals who experience long-term auditory alterations (e.g., hearing loss, hearing aids, cochlear implants) as well as individuals who have to adapt to novel auditory cues when listening in virtual auditory environments. Until now, several methodological constraints have limited our understanding of the mechanisms involved in spatial hearing re-learning. In particular, the potential role of active listening and head-movements have remained largely overlooked. Here, we overcome these limitations by using a novel methodology, based on virtual reality and real-time kinematic tracking, to study the role of active multisensory-motor interactions with sounds in the updating of sound-space correspondences. Participants were immersed in a virtual reality scenario showing 17 speakers at ear-level. From each visible speaker a free-field real sound could be generated. Two separate groups of participants localised the sound source either by reaching or naming the perceived sound source, under binaural or monaural listening. Participants were free to move their head during the task and received audio-visual feedback on their performance. Results showed that both groups compensated rapidly for the short-term auditory alteration caused by monaural listening, improving sound localisation performance across trials. Crucially, compared to naming, reaching the sounds induced faster and larger sound localisation improvements. Furthermore, more accurate sound localisation was accompanied by progressively wider head-movements. These two measures were significantly correlated selectively for the Reaching group. In conclusion, reaching to sounds in an immersive visual VR context proved most effective for updating altered spatial hearing. Head movements played an important role in this fast updating, pointing to the importance of active listening when implementing training protocols for improving spatial hearing. HIGHLIGHTS- We studied spatial hearing re-learning using virtual reality and kinematic tracking - Audio-visual feedback combined with active listening improved monaural sound localisation - Reaching to sounds improved performance more than naming sounds - Monaural listening triggered compensatory head-movement behaviour - Head-movement behaviour correlated with re-learning only when reaching to sounds

neuroscience↗

bioRxiv2020

SPHERE: A novel approach to 3D and active sound localization

In everyday life, localizing a sound source in free-field entails more than the sole extraction of monaural and binaural auditory cues to define its location in the three-dimensions (azimuth, elevation and distance). In spatial hearing, we also take into account all the available visual information (e.g., cues to sound position, cues to the structure of the environment), and we resolve perceptual ambiguities through active listening behavior, exploring the auditory environment with head or/and body movements. Here we introduce a novel approach to sound localization in 3D named SPHERE (European patent n{degrees} WO2017203028A1), which exploits a commercially available Virtual Reality Head-mounted display system with real-time kinematic tracking to combine all of these elements (controlled positioning of a real sound source and recording of participants responses in 3D, controlled visual stimulations and active listening behavior). We prove that SPHERE allows accurate sampling of the 3D spatial hearing abilities of normal hearing adults, and it allowed detecting and quantifying the contribution of active listening. Specifically, comparing static vs. free head-motion during sound emission we found an improvement of sound localization accuracy and precisions. By combining visual virtual reality, real-time kinematic tracking and real-sound delivery we have achieved a novel approach to the study of spatial hearing, with the potentials to capture real-life behaviors in laboratory conditions. Furthermore, our new approach also paves the way for clinical and industrial applications that will leverage the full potentials of active listening and multisensory stimulation intrinsic to the SPHERE approach for the purpose rehabilitation and product assessment.

neuroscience↗

bioRxiv2017

Functional selectivity for face processing in the temporal voice area of early deaf individuals

Brain systems supporting face and voice processing both contribute to the extraction of important information for social interaction (e.g., person identity). How does the brain reorganize when one of these channels is absent? Here we explore this question by combining behavioral and multimodal neuroimaging measures (magneto-encephalography and functional imaging) in a group of early deaf humans. We show enhanced selective neural response for faces and for individual face coding in a specific region of the auditory cortex that is typically specialized for voice perception in hearing individuals. In this region, selectivity to face signals emerges early in the visual processing hierarchy, shortly following typical face-selective responses in the ventral visual pathway. Functional and effective connectivity analyses suggest reorganization in long-range connections from early visual areas to the face-selective temporal area in individuals with early and profound deafness. Altogether, these observations demonstrate that regions that typically specialize for voice processing in the hearing brain preferentially reorganize for face processing in born deaf people. Our results support the idea that cross-modal plasticity in case of early sensory deprivation relates to the original functional specialization of the reorganized brain regions.

neuroscience↗