Search bioRxiv⌕ Search

Biology subjects

Decruy, L.

Publications and source records attributed to Decruy, L..

10 recordsLinked to original sources

Neural tracking of the speech envelope predicts binaural unmasking

Binaural unmasking is the remarkable phenomenon that it is substantially easier to detect a signal in noise, when the interaural parameters of the signal are different from those of the noise - a mechanism that comes in handy in so-called cocktail party scenarios. In this study, we investigated the effect of binaural unmasking on neural tracking of the speech envelope. We measured EEG in 8 participants who listened to speech in noise at a fixed signal-to-noise ratio (-12 dB or -9 dB, depending on the speech material), in two conditions: one where speech and noise had the same interaural phase difference (both speech and noise having an opposite waveform across ears, S{pi}N{pi}), and one where the interaural phase difference of the speech was different from that of the noise (only the speech having an opposite waveform across ears, S{pi}N0). We measured a clear benefit of binaural unmasking in behavioral speech understanding scores, accompanied with increased neural tracking of the speech envelope. Moreover, analyzing the temporal response functions revealed that binaural unmasking also resulted in decreased peak latencies and increased peak amplitudes. Our results are consistent with previous research using auditory evoked potentials and steady-state responses to quantify binaural unmasking at cortical levels. Moreover, they confirm that neural tracking of speech is modulated by speech understanding, even if the acoustic signal-to-noise ratio is kept constant. Significance StatementBinaural unmasking in an important contributing factor to speech understanding in noisy environments. This is the first time that this benefit in speech understanding is measured objectively with EEG. From a clinical perspective, these results could enable the evalu-ation of binaural speech understanding mechanisms in populations for whom behavioral measures are difficult to obtain, such as young children or people with cognitive impair-ment. Moreover, behavioral research has shown that many pathologies (e.g., asymmetric hearing loss, auditory neuropathy, and age-related deficits) are more sensitive to tests that contain a binaural processing component. Our paradigm could enable the detection of such pathologies with an objective approach using neural tracking of speech.

neuroscience↗

Effects of Aging on Cortical Representations of Continuous Speech

Understanding speech in a noisy environment is crucial in day-to-day interactions, and yet becomes more challenging with age, even for healthy aging. Age-related changes in the neural mechanisms that enable speech-in-noise listening have been investigated previously; however, the extent to which age affects the timing and fidelity of encoding of target and interfering speech streams are not well understood. Using magnetoencephalography (MEG), we investigated how continuous speech is represented in auditory cortex in the presence of interfering speech, in younger and older adults. Cortical representations were obtained from neural responses that time-locked to the speech envelopes using speech envelope reconstruction and temporal response functions (TRFs). TRFs showed three prominent peaks corresponding to auditory cortical processing stages: early ([~]50 ms), middle ([~]100 ms) and late ([~]200 ms). Older adults showed exaggerated speech envelope representations compared to younger adults. Temporal analysis revealed both that the age-related exaggeration starts as early as [~]50 ms, and that older adults needed a substantially longer integration time window to achieve their better reconstruction of the speech envelope. As expected, with increased speech masking, envelope reconstruction for the attended talker decreased and all three TRF peaks were delayed, with aging contributing additionally to the reduction. Interestingly, for older adults the late peak was delayed, suggesting that this late peak may receive contributions from multiple sources. Together these results suggest that there are several mechanisms at play compensating for age-related temporal processing deficits at several stages, but which are not able to fully reestablish unimpaired speech perception. NEW & NOTEWORTHYWe observed age-related changes in cortical temporal processing of continuous speech that may be related to older adults difficulty understanding speech in noise. These changes occur in both timing and strength of the speech representations at different cortical processing stages, and depend on both noise condition and selective attention. Critically, their dependency on noise condition changes dramatically among the early, middle, and late cortical processing stages, underscoring how aging differentially affects these stages.

neuroscience↗

Speech understanding oppositely affectsacoustic and linguistic neural tracking in aspeech rate manipulation paradigm.

When listening to continuous speech, the human brain can track features of the presented speech signal. It has been shown that neural tracking of acoustic features is a prerequisite for speech understanding and can predict speech understanding in controlled circumstances. However, the brain also tracks linguistic features of speech, which may be more directly related to speech understanding. We investigated acoustic and linguistic speech processing as a function of varying speech understanding by manipulating the speech rate. In this paradigm, acoustic and linguistic speech processing are affected simultaneously but in opposite directions: When the speech rate increases, more acoustic information per second is present. In contrast, the tracking of linguistic information becomes more challenging when speech is less intelligible at higher speech rates. We measured the EEG of 18 participants (4 male) who listened to speech at various speech rates. As expected and confirmed by the behavioral results, speech understanding decreased with increasing speech rate. Accordingly, linguistic neural tracking decreased with increasing speech rate, but acoustic neural tracking increased. This indicates that neural tracking of linguistic representations can capture the gradual effect of decreasing speech understanding. In addition, increased acoustic neural tracking does not necessarily imply better speech understanding. This suggests that, although more challenging to measure due to the low signal-to-noise ratio, linguistic neural tracking may be a more direct predictor of speech understanding. Significance statementAn increasingly popular method to investigate neural speech processing is to measure neural tracking. Although much research has been done on how the brain tracks acoustic speech features, linguistic speech features have received less attention. In this study, we disentangled acoustic and linguistic characteristics of neural speech tracking via manipulating the speech rate. A proper way of objectively measuring auditory and language processing paves the way towards clinical applications: An objective measure of speech understanding would allow for behavioral-free evaluation of speech understanding, which allows to evaluate hearing loss and adjust hearing aids based on brain responses. This objective measure would benefit populations from whom obtaining behavioral measures may be complex, such as young children or people with cognitive impairments.

neuroscience↗

Hearing loss is associated with delayed neural responses to continuous speech

We investigated the impact of hearing loss on the neural processing of speech. Using a forward modeling approach, we compared the neural responses to continuous speech of 14 adults with sensorineural hearing loss with those of age-matched normal-hearing peers. Compared to their normal-hearing peers, hearing-impaired listeners had increased neural tracking and delayed neural responses to continuous speech in quiet. The latency also increased with the degree of hearing loss. As speech understanding decreased, neural tracking decreased in both populations; however, a significantly different trend was observed for the latency of the neural responses. For normal-hearing listeners, the latency increased with increasing background noise level. However, for hearing-impaired listeners, this increase was not observed. Our results support the idea that the neural response latency indicates the efficiency of neural speech processing. Hearing-impaired listeners process speech in silence less efficiently than normal-hearing listeners. Our results suggest that this reduction in neural speech processing efficiency is a gradual effect which occurs as hearing deteriorates. Moreover, the efficiency of neural speech processing in hearing-impaired listeners is already at its lowest level when listening to speech in quiet, while normal-hearing listeners show a further decrease in efficiency when the noise level increases. From our results, it is apparent that sound amplification does not solve hearing loss. Even when listing to speech in silence at a comfortable loudness, hearing-impaired listeners process speech less efficiently.

neuroscience↗

Top-down modulation of neural envelope tracking: the interplay with behavioral, self-reported and neural measures of listening effort

When listening to natural speech, our neural activity tracks the speech envelope. Moreover, recent research has demonstrated that this neural envelope tracking can be affected by top-down processes. The present study was designed to examine if neural envelope tracking is modulated by the effort that a person expends during listening. Five measures were included to quantify listening effort: two behavioral measures based on a novel dual-task paradigm, a self-report effort measure and two neural measures related to neural phase synchronization and alpha power. Electroencephalography responses to sentences, presented at a wide range of subject-specific signal-to-noise ratios, were recorded in thirteen young, normal-hearing adults. A comparison of the five measures revealed different effects of listening effort as a function of speech understanding. Reaction times on the primary task and self-reported effort decreased with increasing speech understanding. In contrast, reaction times on the secondary task and alpha power showed a peak-shaped behavior with highest effort at intermediate speech understanding levels. We found a positive association between envelope tracking and speech understanding. While a significant effect of listening effort was found on theta-band envelope tracking, the effect size was negligible. Therefore, our results suggest that listening effort is not a confound when using envelope tracking to objectively measure speech understanding in young, normal-hearing adults.

neuroscience↗

Hearing impairment is associated with enhanced neural tracking of the speech envelope

Elevated hearing thresholds in hearing impaired adults are usually compensated by providing amplification through a hearing aid. In spite of restoring hearing sensitivity, difficulties with understanding speech in noisy environments often remain. One main reason is that sensorineural hearing loss not only causes loss of audibility but also other deficits, including peripheral distortion but also central temporal processing deficits. To investigate the neural consequences of hearing impairment in the brain underlying speech-in-noise difficulties, we compared EEG responses to natural speech of 14 hearing impaired adults with those of 14 age-matched normal-hearing adults. We measured neural envelope tracking to sentences and a story masked by different levels of a stationary noise or competing talker. Despite their sensorineural hearing loss, hearing impaired adults showed higher neural envelope tracking of the target than the competing talker, similar to their normal-hearing peers. Furthermore, hearing impairment was related to an additional increase in neural envelope tracking of the target talker, suggesting that hearing impaired adults may have an enhanced sensitivity to envelope modulations or require a larger differential tracking of target versus competing talker to neurally segregate speech from noise. Lastly, both normal-hearing and hearing impaired participants showed an increase in neural envelope tracking with increasing speech understanding. Hence, our results open avenues towards new clinical applications, such as neuro-steered prostheses as well as objective and automatic measurements of speech understanding performance. HighlightsO_LIAdults with hearing impairment can neurally segregate speech from background noise C_LIO_LIHearing loss is related to enhanced neural envelope tracking of the target talker C_LIO_LINeural envelope tracking has potential to objectively measure speech understanding C_LI

neuroscience↗

Effect of task and attention on neural tracking of speech

EEG-based measures of neural tracking of natural running speech are becoming increasingly popular to investigate neural processing of speech and have applications in audiology. When the stimulus is a single speaker, it is usually assumed that the listener actively attends to and understands the stimulus. However, as the level of attention of the listener is inherently variable, we investigated how it affected neural envelope tracking. Using a movie as a distractor, we varied the level of attention while we estimated neural envelope tracking. We varied the intelligibility level by adding stationary noise. We found a significant difference in neural envelope tracking between the condition with maximal attention and the movie condition. This difference was most pronounced in the right-frontal region of the brain. The degree of neural envelope tracking was highly correlated with the stimulus signal-to-noise ratio, even in the movie condition. This could be due to residual neural resources to passively attend to the stimulus. When envelope tracking is used to objectively measure speech understanding this means that the procedure can be made more enjoyable and feasible by letting participants watch a movie during stimulus presentation.

neuroscience↗

Evidence for enhanced neural tracking of the speech envelope underlying age-related speech-in-noise difficulties

Elevated hearing thresholds in hearing impaired adults are usually compensated by providing amplification through a hearing aid. In spite of restoring hearing sensitivity, difficulties with understanding speech in noisy environments often remain. One main reason is that sensorineural hearing loss not only causes loss of audibility but also other deficits, including peripheral distortion but also central temporal processing deficits. To investigate the neural consequences of hearing impairment in the brain underlying speech-in-noise difficulties, we compared EEG responses to natural speech of 14 hearing impaired adults with those of 14 age-matched normal-hearing adults. We measured neural envelope tracking to sentences and a story masked by different levels of a stationary noise or competing talker. Despite their sensorineural hearing loss, hearing impaired adults showed higher neural envelope tracking of the target than the competing talker, similar to their normal-hearing peers. Furthermore, hearing impairment was related to an additional increase in neural envelope tracking of the target talker, suggesting that hearing impaired adults may have an enhanced sensitivity to envelope modulations or require a larger differential tracking of target versus competing talker to neurally segregate speech from noise. Lastly, both normal-hearing and hearing impaired participants showed an increase in neural envelope tracking with increasing speech understanding. Hence, our results open avenues towards new clinical applications, such as neuro-steered prostheses as well as objective and automatic measurements of speech understanding performance. HighlightsO_LIAdults with hearing impairment can neurally segregate speech from background noise C_LIO_LIHearing loss is related to enhanced neural envelope tracking of the target talker C_LIO_LINeural envelope tracking has potential to objectively measure speech understanding C_LI

neuroscience↗

Predicting individual speech intelligibility from the neural tracking of acoustic- and phonetic-level speech representations

ObjectiveTo objectively measure speech intelligibility of individual subjects from the EEG, based on cortical tracking of different representations of speech: low-level acoustical, higher-level discrete, or a combination. To compare each models prediction of the speech reception threshold (SRT) for each individual with the behaviorally measured SRT.\n\nMethodsNineteen participants listened to Flemish Matrix sentences presented at different signal-to-noise ratios (SNRs), corresponding to different levels of speech understanding. For different EEG frequency bands (delta, theta, alpha, beta or low-gamma), a model was built to predict the EEG signal from various speech representations: envelope, spectrogram, phonemes, phonetic features or a combination of phonetic Features and Spectrogram (FS). The same model was used for all subjects. The model predictions were then compared to the actual EEG of each subject for the different SNRs, and the prediction accuracy in function of SNR was used to predict the SRT.\n\nResultsThe model based on the FS speech representation and the theta EEG band yielded the best SRT predictions, with a difference between the behavioral and objective SRT below 1 decibel for 53% and below 2 decibels for 89% of the subjects.\n\nConclusionA model including low- and higher-level speech features allows to predict the speech reception threshold from the EEG of people listening to natural speech. It has potential applications in diagnostics of the auditory system.\n\nSearch Termscortical speech tracking, objective measure, speech intelligibility, auditory processing, speech representations.\n\nHighlightsO_LIObjective EEG-based measure of speech intelligibility\nC_LIO_LIImproved prediction of speech intelligibility by combining speech representations\nC_LIO_LICortical tracking of speech in the delta EEG band monotonically increased with SNRs\nC_LIO_LICortical responses in the theta EEG band best predicted the speech reception threshold\nC_LI\n\nDisclosureThe authors report no disclosures relevant to the manuscript.

neuroscience↗

Speech intelligibility predicted from neural entrainment of the speech envelope

Speech intelligibility is currently measured by scoring how well a person can identify a speech signal. The results of such behavioral measures reflect neural processing of the speech signal, but are also influenced by language processing, motivation and memory. Very often electrophysiological measures of hearing give insight in the neural processing of sound. However, in most methods non-speech stimuli are used, making it hard to relate the results to behavioral measures of speech intelligibility. The use of natural running speech as a stimulus in electrophysiological measures of hearing is a paradigm shift which allows to bridge the gap between behavioral and electrophysiological measures. Here, by decoding the speech envelope from the electroencephalogram, and correlating it with the stimulus envelope, we demonstrate an electrophysiological measure of neural processing of running speech. We show that behaviorally measured speech intelligibility is strongly correlated with our electrophysiological measure. Our results pave the way towards an objective and automatic way of assessing neural processing of speech presented through auditory prostheses, reducing confounds such as attention and cognitive capabilities. We anticipate that our electrophysiological measure will allow better differential diagnosis of the auditory system, and will allow the development of closed-loop auditory prostheses that automatically adapt to individual users.

neuroscience↗