Todorovic, A. | Search bioRxiv

bioRxiv2019

Dissociable neural effects of temporal expectations due to passage of time and contextual probability

The human brain is equipped with complex mechanisms to track the changing probability of events in time. While the passage of time itself usually leads to a mounting expectation, context can provide additional information about when events are likely to happen. In this study we dissociate these two sources of temporal expectation in terms of their neural correlates and underlying brain connectivity patterns. We analysed magnetoencephalographic (MEG) data acquired from N=24 healthy participants listening to auditory stimuli. These stimuli could be presented at different temporal intervals but occurred most often at intermediate intervals, forming a contextual probability distribution. Evoked MEG response amplitude was sensitive to both passage of time and contextual probability, albeit at different latencies: the effects of passage of time were observed earlier than the effects of context. The underlying sources of MEG activity were also different across the two types of temporal prediction: the effects of passage of time were localised to early auditory regions and superior temporal gyri, while context was additionally linked to activity in inferior parietal cortices. Finally, these differences were modelled using biophysical (dynamic causal) modelling: passage of time was explained in terms of widespread gain modulation and decreased prediction error signalling at lower levels of the hierarchy, while contextual expectation led to more localised gain modulation and decreased prediction error signalling at higher levels of the hierarchy. These results present a comprehensive account of how independent sources of temporal prediction may be differentially expressed in cortical circuits.\n\nHIGHLIGHTS- Predictability of tone onset times affects auditory network connectivity\n- Foreperiod and distribution of events in time have dissociable neural substrates\n- Decreased prediction error at different levels of cortical hierarchy

neuroscience↗

bioRxiv2018

Predicting audiovisual speech: Early combined effects of sentential and visual constraints

In language comprehension, a variety of contextual cues act in unison to render upcoming words more or less predictable. As a sentence unfolds, we use prior context (sentential constraints) to predict what the next words might be. Additionally, in a conversation, we can predict upcoming sounds through observing the mouth movements of a speaker (visual constraints). In electrophysiological studies, effects of visual salience have typically been observed early in language processing, while effects of sentential constraints have typically been observed later. We hypothesized that the visual and the sentential constraints might feed into the same predictive process such that effects of sentential constraints might also be detectable early in language processing through modulations of the early effects of visual salience. We presented participants with audiovisual speech while recording their brain activity with magnetoencephalography. Participants saw videos of a person saying sentences where the last word was either sententially constrained or not, and began with a salient or non-salient mouth movement. We found that sentential constraints indeed exerted an early (N1) influence on language processing. Sentential modulations of the N1 visual predictability effect were visible in brain areas associated with semantic processing, and were differently expressed in the two hemispheres. In the left hemisphere, visual and sentential constraints jointly suppressed the auditory evoked field, while the right hemisphere was sensitive to visual constraints only in the absence of strong sentential constraints. These results suggest that sentential and visual constraints can jointly influence even very early stages of audiovisual speech comprehension.

neuroscience↗