Search bioRxiv⌕ Search

Biology subjects

Weisz, N.

Publications and source records attributed to Weisz, N..

At least 19 recordsLinked to original sources

The dynamic relationship between pupil dilation and neural surprise in natural language comprehension

Predictive processing accounts hold that the brain continuously generates predictions and updates internal models from error signals, but it remains unclear whether prediction representation and model-updating reflect a single graded computation or computationally distinct operations implemented in dissociable systems. We recorded magnetoencephalography (MEG) and pupillometry while participants listened to continuous natural speech, quantifying word-by-word lexical surprise and semantic prediction error with a GPT-2 model. Broadly speaking, lexical surprise was tracked in a predominantly graded fashion, whereas the response to semantic error was better captured by a rectified linear (ReLU) gating function - i.e., that responds only when the error exceeds a recent contextual baseline. There were also some interesting dissociations in the strength of these relative effects. The auditory cortex tracked lexical surprise in a graded, continuous manner, with later cortical stages reflecting semantic error. By contrast, tonic pupil diameter and source-localised brainstem responses were predominantly captured by a gated response to semantic error. A pupil-coupling analysis confirmed that this gating signature was statistically shared between pupil-linked arousal and brainstem-localised, but not cortical, responses. Together, these findings reveal a division of labour in which the cortex maintains a continuous, high-fidelity map of predictive information while a pupil-linked model-update system acts as a selective gate, engaged specifically by meaning-disrupting events that have crossed a threshold level of error. This asymmetry suggests that signals serving continuous parsing of prediction error and signals serving model revision may be computationally dissociated, with a range of implications for our understanding of the intrinsic interactions between mechanisms serving perception and learning.

neuroscience↗

Accelerated neural aging as a systems-level vulnerability for tinnitus

Tinnitus, the perception of sound without an external source, affects 10-15% of individuals, yet its neural mechanisms remain poorly understood. Building on evidence that chronological age predicts tinnitus risk beyond hearing loss, we tested the hypothesis that accelerated neural aging increases susceptibility to tinnitus by integrating cross-sectional resting-state MEG with longitudinal structural imaging data. In a large MEG dataset, spectral parametrization revealed that age-neural relationships were amplified in the tinnitus group compared to age-, sex- & hearing-matched controls. Complementing these findings, prospective analyses using data from the UK Biobank showed that among participants without tinnitus at baseline, stronger age-related declines in white-matter density predicted later tinnitus onset. Collectively, these converging functional and structural findings support accelerated brain aging as a key risk factor for tinnitus.

neuroscience↗

Brain-body timing gates conscious access across sensory systems

Conscious awareness fluctuates with the brains internal state at the moment of perception, yet how these states are temporally coordinated remains unclear. Although such internal states are reflected in ongoing neural activity, their temporal structure may arise from intrinsic interactions between the brain and the body. To test this hypothesis, we simultaneously recorded neural, cardiac, and respiratory activity while participants detected auditory, tactile, or visual stimuli presented at perceptual threshold. Across sensory modalities, stimulus detection was preceded by transient bursts of alpha-band (8-13 Hz) activity localized to lateralized prefrontal and premotor regions. Crucially, these neural events were aligned with specific phases of the cardiac and respiratory cycles, revealing coordinated brain-body states at the time of perception. This cross-system coupling predicted whether sensory stimuli reached conscious awareness. Together, these findings show that brain-body synchrony acts as a temporal gate for conscious access across sensory systems.

neuroscience↗

Ocular speech tracking persists in blindness, but its dynamics and oculo-cerebral connectivity depend on visual status

While eye movements have been shown to track the speech envelope, it is unknown whether this reflects a hard-wired mechanism or one shaped by (lifetime) audiovisual experience. Further, questions remain about whether ocular tracking is modulated by speech intelligibility and which brain regions drive these synchronized eye movements. Here, we investigate ocular speech tracking in blindfolded early blind, late blind, and sighted individuals using magnetoencephalography (MEG) and source-reconstructed oculomotor signals while participants listened to narrative speech of varying intelligibility. We found that oculomotor activity tracks acoustic speech features and, unlike neural speech tracking, is not modulated by intelligibility. Interestingly, we found effects reflected in two frequency-specific components: a low-frequency ([~]1 Hz) effect present across all groups, indicating that visual experience is not required, and a high-frequency ([~]6 Hz) effect reduced in early- and late-blind individuals. Moreover, this finding is not driven by cerebro-ocular connectivity, as late-blind individuals exhibit stronger connectivity between the eyes and the left temporal cortices without a corresponding increase in ocular tracking. In conclusion, ocular speech tracking seems to respond selectively to acoustic but not to intelligibility features of speech, and it does not require visual experience to develop. It may thus represent a hard-wired oculomotor mechanism within the oculo-cerebral network involved in speech processing. Significance StatementEye movements provide a unique window into the interaction between auditory and visual systems. By studying early blind, late blind, and sighted individuals, we demonstrate that speech-related eye movements arise from at least two distinct mechanisms: a low-frequency component that occurs independently of (lifetime) visual experience and is linked to processing of acoustic speech features, and a high-frequency component shaped by prior visual exposure. Importantly, speech intelligibility - unlike its impact on neural measures - does not modulate these ocular responses. This dissociation suggests that eye movements reflect mechanisms of spoken language processing that are independent of intelligibility, thereby revealing novel pathways of auditory-motor coupling and broadening our understanding of sensory integration in the absence of vision.

neuroscience↗

Inflexible center-frequency shifts in neural speech tracking are linked to reading and phonological deficits in developmental dyslexia

Developmental dyslexia is marked by persistent deficits in reading and phonological awareness, potentially linked to atypical neural tracking of acoustic speech rhythms at frequencies below 10 Hz. Using magnetoencephalography, we compared adults with developmental dyslexia and matched controls while they listened to speech with varying levels of intelligibility (manipulated via noise vocoding). In controls, decreasing intelligibility led to systematic increases in the tracked frequency of the speech stream, replicating previous findings. This increase in tracking frequency was largely absent in individuals with developmental dyslexia. Unexpectedly, the magnitude of periodic speech tracking in the low frequency range was preserved in DD. Instead, the increase in central tracking frequency was linked to phonological awareness and reading performance.

neuroscience↗

Two senses, one rhythm: Pre- and post-stimulus neural states predict perceived audio-visual synchrony

How does the brain integrate or segregate multiple sensory inputs? In our study, we used magnetoencephalography to comprehensively investigate local and network dynamics before and after the presentation of sequences of beeps and flashes that are sometimes perceived as synchronous or asynchronous. Frequency-tagging and spectral analysis revealed that under identical physical conditions, subjective perceptual fusion of multisensory signals elicits stronger evoked sensory responses in both visual and auditory cortices. Crucially, perceptual fusion is preceded by locally reduced pre-stimulus alpha activity, as well as enhanced functional connectivity between auditory and visual cortices within the pre-stimulus gamma activity. We also show that pre-stimulus neuronal states in the occipital cortex predict post-stimulus sensory responses to auditory sequences in the temporal cortex, but not the opposite. The current findings provide evidence that the perceptual fusion of multisensory events relate to a complex interplay between local and inter-sensory neuronal states before and after stimulus presentation. Significance StatementHow does the brain blend information from multiple sensory systems into one holistic perception? We developed a novel frequency-tagging paradigm in Magnetoencephalography (MEG) to robustly estimate the sensory responses to a series of flashes and beeps in early sensory areas, and to demonstrate how these responses are shaped by ongoing fluctuations in local, and long-range network activity. By combining the steady-state method with spectral, and functional connectivity analysis of ongoing oscillations in source space, the current study provides novel insights into the relationship between internal brain states and the way we perceive multisensory events.

neuroscience↗

The "Ocular Response Function" for encoding and decoding oculomotor related neural activity

Oculomotor activity provides critical insights into cognition and health, with growing evidence demonstrating its involvement in various cognitive functions such as attention, memory, and sensory processing, and that it is a significant indicator of psychopathologies and neurological disorders. Despite its crucial importance across domains, the neural mechanisms supporting oculomotion have been underexplored, largely because eye movements are typically treated as artefacts to be removed from the neural signal. While useful for data cleaning, this approach risks discarding valuable information about oculomotor control, and there has been recent interest in modelling these signals instead to understand them. Using time-resolved regression methods with magnetoencephalography (MEG) and eye tracking during the resting state, we thus here sought to model Ocular Response Functions (ORFs), that characterise the neural signatures of distinct oculomotor events, specifically saccades, blinks, and pupil dilation. We demonstrate the relationships between ocular action and neural activity (encoding), revealing a range of sensory cortical, cerebellar and frontal signatures preceding and following such ocular events. We conversely show how we can reconstruct ocular events from brain activity, and further apply resting-state derived ORFs to a passive listening task - demonstrating how some neural markers interpreted as directly related to sensation may in principle indirectly result from oculomotor contributions to task-related neural processing. By providing an accessible framework for examining the interplay between eye movements and neural processes, we offer a range of insights with potential applications across cognitive and clinical neuroscience.

neuroscience↗

FEATURE-SPECIFIC ANTICIPATORY PROCESSING FADES DURING HUMAN SLEEP

Imagine you are listening to a familiar song on the radio. As the melody and rhythm unfold, you can often anticipate the next note or beat, even before it plays. This ability demonstrates the brains capacity to extract statistical regularities from sensory input and to generate predictions about future sensory events. It is considered automatic, requiring no conscious effort or attentional resources (1-4). But to what extent does this predictive ability operate when our attention is greatly reduced, such as during sleep? Experimental findings from animal and human studies reveal a complex picture of how the brain engages in predictive processing during sleep (5-13). Although evidence suggests that the brain differentially reacts to unexpected stimuli and rhythmic music (5,7,13), there is a notable disruption in feedback processing, which is essential for generating accurate predictions of upcoming stimuli (10). Here, for the first time, we examine the brains ability during sleep to predict or pre-activate low-level features of expected stimuli before presentation. We use sequences of predictable or unpredictable/random tones in a passive-listening paradigm while recording simultaneous electroencephalography (EEG) and magnetoencephalography (MEG) during wakefulness and sleep. We found that during wakefulness, N1 sleep and N2 sleep, subtle changes in tone frequencies elicit unique/distinct neural activations. However, these activations are less distinct and less sustained during sleep than during wakefulness. Critically, replicating previous work in wakefulness (4), we find evidence that neural activations specific to the anticipated tone occur before its presentation. Extending previous findings, we show that such predictive neural patterns fade as individuals fall into sleep. In BriefThe extent to which predictive processing takes place in sleep is yet to be determined. Using a passive-listening EEG/MEG paradigm, Topalidis et al. show that auditory representations in sleep are brief and unstable, easily overwritten by subsequent inputs, which possibly hinders the tracking and extraction of sensory associations. HighlightsO_LIParticipants passively listened to random and predictable sequences of tones during both wakefulness and sleep, without being made aware of the underlying pattern. C_LIO_LIThe brain reta C_LIO_LIins the ability to process basic low-level features during sleep. C_LIO_LIWhile these feature-specific responses are preserved during sleep, they are less distinct and sustained than in wakefulness. C_LIO_LIUnlike in wakefulness, during sleep, the brain does not predict or anticipate upcoming sounds, despite continuing to process basic auditory information. C_LI

neuroscience↗

Eye Movements in Silent Visual Speech track Unheard Acoustic Signals and Relate to Hearing Experience

Behavioral and neuroscientific studies have shown that watching a speakers lip movements aids speech comprehension. Intriguingly, even when videos of speakers are presented silently, various cortical regions track auditory features, such as the envelope. Recently, we demonstrated that eye movements track low-level acoustic information when attentively listening to speech. In this study we investigated whether ocular speech tracking occurs during visual speech and how it influences cortical silent speech tracking. Furthermore, we compared the data of hearing individuals with congenitally deaf individuals, and those with acquired deafness or hearing loss (DHH; Deaf or hard of hearing) to assess how auditory deprivation (early vs. late onset) affects neural and ocular speech tracking during silent lip-reading. Using magnetoencephalography (MEG), we examined ocular and neural speech tracking of 75 participants observing silent videos of a speaker played forward and backward. Our main finding is a clear ocular unheard speech tracking effect with a dominance <1 Hz, which was not present for the lip movements. Similarly, we observed a <=1.3 Hz effect of neural unheard speech tracking in temporal regions for hearing participants. Importantly, neural tracking was not directly linked to ocular tracking in this study. Strikingly, across different listening groups, deaf participants with auditory listening experience showed higher ocular speech tracking than hearing participants, while no ocular speech tracking effect was revealed for congenitally deaf participants in a very small sample. This study extends our previous work by demonstrating the involvement of eye movements in speech processing, even in the absence of acoustic input.

neuroscience↗

Decreasing hearing ability does not lead to improved visual speech extraction as revealed in a neural speech tracking paradigm

The use of visual speech is thought to be especially important in situations where acoustics are unclear and in individuals with hearing impairment. To investigate this in a neural speech tracking paradigm, we measured MEG in sixty-seven mid- to old-age individuals during audiovisual (AV), audio-only (A), and visual-only (V) speech in the context of face masks. First, we could extend previous findings by showing that not only in young normal-hearing individuals but also in aging individuals with decreasing hearing ability the brain is superior in neurally tracking the acoustic spectrogram in AV compared to A presentations, especially in multi-speaker situations. The addition of visual lip movements further increases this benefit. Second, we could show that neural speech tracking in individuals with lower levels of hearing ability is affected more by face masks. However, in this population, the effect seems to be a composite of blocked visual speech and distorted acoustics. Third, we could confirm previous findings, that the neural benefit of visual speech varies strongly across individuals. We show that this general individual ability predicts how much people engage in visual speech tracking in difficult AV listening situations. Interestingly, this was not correlated with hearing thresholds and therefore does seem to be a widely used compensatory strategy in the hearing impaired.

neuroscience↗

Carrier-frequency specific omission-related neural activity in ordered sound sequences are independent of omissions-predictability

Regularities in our surroundings lead to predictions about upcoming events. Previous research has shown, that omitted sounds during otherwise regular tone sequences elicit frequency-specific neural activity related to the upcoming but omitted tone. We tested whether this neural response is depending on the unpredictability of the omission. Therefore we recorded MEG data while participants listened to ordered or random tone sequences with omissions occurring either ordered or randomly. Using multivariate pattern analysis shows that the frequency-specific neural pattern during omission within ordered tone sequences occurs independent of the regularity of the omissions suggesting that the auditory predictions based on sensory experiences are not immediately updated by violations of those expectations.

neuroscience↗

Hemispheric asymmetries in auditory cortex reflect discriminative responses to temporal details or summary statistics of stationary sounds.

The processing of stationary sounds relies on both local features and compact representations. As local information is compressed into summary statistics, abstract representations emerge. Whether the brain is endowed with distinct neural architectures overseeing such computations is unknown. In this magnetoencephalography (MEG) study, we employed a validated protocol to localize cortical correlates of local and summary representations, exposing participants to triplets of synthetic sound textures systematically varying for either local details or summary statistics. Sounds also varied for their sound duration, specifically short (40ms) or long (478ms). Results revealed clear distinct activation patterns for local features and summary statistics changes. Such activations diverged in magnitude, spatiotemporal distribution, and hemispheric lateralization. For short sounds, a change in local features, compared to summary statistics, predominantly activated the right hemisphere. Conversely, for long sounds, a change in summary statistics elicited higher activation than a change in local features in both hemispheres. Specifically, while the right auditory cortex was responding more to changes in local features or summary statistics depending on sound duration (short or long, respectively), the left frontal lobe was selectively engaged in processing a change in summary statistics at a long sound duration. These findings provide insights into the neural mechanisms underlying the computation of local and summary acoustic information and highlight the involvement of distinct cortical pathways and hemispheric lateralization in auditory processing at different temporal resolutions. Significant StatementWe revealed hemispheric specializations for auditory computations at high (local) and low (summary statistics) temporal resolutions. The right hemisphere was engaged for both computations, while the left hemisphere responded more to summary statistics changes. These findings highlight the multifaceted functions of the right hemisphere in capturing acoustic properties of stationary sounds and the left hemispheres involvement in processing abstract representations.

neuroscience↗

Prediction tendency, eye movements, and attention in a unified framework of neural speech tracking

Auditory speech comprehension is a multi-faceted process in which attention, prediction, and sensorimotor integration (via active sensing) interact with or complement each other. Although different conceptual models that focus on one of these aspects exist, we still lack a unified understanding of their role in speech processing. Here, we first replicated two recently published studies from our lab, confirming 1) a positive relationship between individual prediction tendencies and neural speech tracking, and 2) the phenomenon of ocular speech tracking - the tracking of attended speech by eye movements - and its shared contribution with neural activity to speech processing. In addition, we extended these findings with complementary analyses and investigated these phenomena in relation to each other in a multi-speaker paradigm with continuous, narrative speech. Importantly, prediction tendency and ocular speech tracking seem to be unrelated. In contrast to the shared contributions of oculomotor and neural activity to speech processing over a distributed set of brain regions that are critical for attention, individual prediction tendency and its relation to neural speech tracking seem to be largely independent of attention. Based on these findings, we propose a framework that aims to bridge the gaps between attention, prediction, and active (ocular) sensing in order to contribute to a holistic understanding of neural speech processing. In this speculative framework for listening, auditory inflow is, on a basic level, temporally modulated via active ocular sensing, and incoming information is interpreted based on probabilistic assumptions.

neuroscience↗

Lip movements and lexical features improve speech tracking differently for clear and multi-speaker speech

Visual speech plays a powerful role in facilitating auditory speech processing and has been a publicly noticed topic with the wide usage of face masks during the Covid-19 pandemic. In a previous magnetoencephalography (MEG) study we showed that occluding the mouth area significantly impairs neural speech tracking. To rule out the possibility that this deterioration is due to degraded sound quality, in the present follow-up study, we presented participants with audiovisual (AV) and audio-only (A) speech. We further independently manipulated the trials by adding a face mask and a distractor speaker. Our results clearly show that face masks only affect speech tracking in AV conditions, not in A conditions. This shows that face masks indeed primarily impact speech processing by blocking visual speech and not by acoustic degradation. Furthermore, we observe differences in the speech features that are used for visual speech processing. On the one hand, processing in clear speech, but not in noisy speech, is profiting more from lexical unit features (phonemes and word onsets) hinting at improved phoneme discrimination. On the other hand, we observe an improvement in speech tracking driven by the modulations of the lip area in clear speech and conditions with a distractor speaker, which might aid by providing temporal cues for subsequent auditory processing. With this work, we highlight the effects of face masks in AV speech tracking and show two separate ways how visual speech might support successful speech processing.

neuroscience↗

Neural speech tracking benefit of lip movements predicts behavioral deterioration when the speaker's mouth is occluded

Observing lip movements of a speaker is known to facilitate speech understanding, especially in challenging listening situations. Converging evidence from neuroscientific studies shows enhanced processing of audiovisual stimuli. However, the interindividual variability of this visual benefit and its consequences on behavior are unknown. Here, we analyzed source-localized magnetoencephalographic (MEG) responses from normal-hearing participants listening to audiovisual speech with or without an additional distractor speaker. Using temporal response functions (TRFs), we show that neural responses to lip movements are, in general, enhanced when speech is challenging. After conducting a crucial control for speech acoustics, we show that lip movements effectively contribute to higher neural speech tracking, particularly when a distractor speaker is present. However, the extent of this visual benefit varied greatly among participants. Probing the behavioral relevance, we show that individuals who benefit more from lip movement information in terms of neural speech tracking, show a stronger drop in performance and an increase in perceived difficulty when the mouth is occluded by a surgical face mask. By contrast, no effect was found when the mouth was not occluded. We provide novel insights on how the benefit of lip movements in terms of neural speech tracking varies among individuals. Furthermore, we reveal its behavioral relevance by demonstrating negative consequences for behavior when visual speech is absent. Our results also offer potential implications for future objective assessments of audiovisual speech perception.

neuroscience↗

Individual prediction tendencies are related but not the same across modalities

Predictive processing theories, which model the brain as a "prediction machine", explain a wide range of cognitive functions, including learning, perception and action. Furthermore, it is increasingly accepted that aberrant prediction tendencies play a crucial role in psychiatric disorders. Given this explanatory value for clinical psychiatry, prediction tendencies are often implicitly conceptualised as individual traits or as tendencies that generalise across situations. As this has not yet explicitly been shown, in the current study, we quantify to what extent the individual tendency to anticipate sensory features of high probability generalises across modalities. Using magnetoencephalography (MEG), we recorded brain activity while participants were presented a sequence of four different (either visual or auditory) stimuli, which changed according to predefined transitional probabilities of two entropy levels: ordered vs. random. Our results show that, on a group-level, under conditions of low entropy, stimulus features of high probability are preactivated in the auditory but not in the visual modality. Crucially, the magnitude of the individual tendency to predict sensory events seems not to correlate between the two modalities. Furthermore, reliability statistics indicate poor internal consistency, suggesting that the measures from the different modalities are unlikely to reflect a single, common cognitive process. In sum, our findings suggest that quantification and interpretation of individual prediction tendencies cannot be generalised across modalities.

neuroscience↗

Eye movements track prioritized auditory features in selective attention to natural speech

Over the last decades, cognitive neuroscience has identified a distributed set of brain regions that are critical for attention - one of the key principles of adaptive behavior. A strong anatomical overlap with brain regions critical for oculomotor processes suggests a joint network for attention and eye movements. However, the role of this shared network in complex, naturalistic environments remains understudied. Here, we investigated eye movements in relation to (un)attended sentences of natural speech in simultaneously recorded eye tracking and magnetoencephalographic (MEG) data. Using temporal response functions (TRF), we show that eye gaze tracks acoustic features (envelope and acoustic onsets) of attended speech, a phenomenon we termed ocular speech tracking. Ocular speech envelope tracking even differentiates a target from a distractor in a multi speaker context and is further related to intelligibility. Moreover, we provide evidence for its contribution to neural differences in speech processing, emphasizing the necessity to consider oculomotor activity in future research and in the interpretation of neural differences in auditory cognition. Our results extend previous findings of a joint network of attention and eye movement control as well as motor theories of speech. They provide valuable new directions for research into the neurobiological mechanisms of the phenomenon, its dependence on learning and plasticity, and its functional implications in social communication.

neuroscience↗

Network topology in brain tumor patients with and without structural epilepsy- a prospective MEG-study

It has been proposed that functional connectivity (FC) and network topology (NT) are altered in patients with glial brain tumors. So far there is no consensus on the pattern of these changes, furthermore data on FC in patients with brain metastases (BMs) as well as on the presence and absence of tumor-related epilepsy is lacking. We aimed to analyze preoperative NT of newly diagnosed, singular, supratentorial glial brain tumors (GBTs) and BMs with and without structural epilepsy. FC and NT derived from resting state magnetoencephalography (MEG) were compared between patients (PAs) and matched healthy controls (HCs), between GBTs and BMs as well as between patients with and without structural epilepsy. We investigated all patients, who met our inclusion criteria from February 2019 to March 2021. Clinical data was collected from patients electronic medical charts. We analyzed whole brain (wb) connectivity in six frequency bands, calculated three different network topological parameters (node degree (ND), shortest path length (L), clustering coefficient (CC)) and performed a stratification, where differences in the power were to be found. For data analysis we used Fieldtrip, Brain Connectivity Matlab toolboxes and in-house built scripts. We consecutively included 41 patients (21 men), mean age 60.1ys (range 23-82), who were operated on at our institution. Tumor histology included high-grade gliomas (n=18), low-grade gliomas (n=4), dysembryoplastic neuroepithelial tumor (DNET, n=1), BMs (n=14) and others (n=4). Statistical analysis revealed a significant decrease for wb ND in patients compared to healthy controls in every frequency range analyzed at the descriptive and corrected level (p1-30Hz=0.002, p{gamma}=0.002, p{beta}=0.002, p=0.002, p{theta}=0.024, p{delta}=0.002). Furthermore, at the descriptive level, we found a significant augmentation for wb CC (p1-30Hz=0.031, p{delta}=0.013) in PAs compared to HCs, which did not persist the false discovery rate (FDR) correction. There were no differences in the networks of glial brain tumors and metastases identified. However, we found a significant increase in wb CC in patients with structural epilepsy (p{theta}= 0.048), and significantly lower wb ND (p= 0.039) at the uncorrected level. Our data suggests that network topology is altered in brain tumor patients, which is in line with previous studies. Tumor histology per se might not influence the brains functional network, however, tumor-related epilepsy seems to do so. Longitudinal studies and in-depth analysis of possible factors and confounders might be helpful to further substantiate these findings.

neuroscience↗