Search bioRxiv⌕ Search

Biology subjects

Riecke, L.

Publications and source records attributed to Riecke, L..

12 recordsLinked to original sources

Repeated listening induces exposure-specific cortical tracking of intelligible continuous speech

Neural encoding of acoustic and linguistic features of continuous speech is sensitive to cognitive factors, such as attention and comprehension. We investigated whether neural tracking is also sensitive to the predictability of speech. Participants were repeatedly exposed to intelligible or unintelligible versions of the same audiobook segment while EEG was recorded. First, we fit encoding models to predict EEG responses from acoustic, sublexical, and lexical features of the presented speech. Model comparisons revealed no reliable improvement in model fit when lexical features were included; subsequent analyses were performed on models including only acoustic and sublexical predictors. Second, we compared prediction accuracy for models trained and tested on the same exposures with models trained and tested across different exposures. While we observed no overall change in prediction performance across exposures, we found that models were exposure-specific: prediction performance was highest within the same exposure and decreased with increasing temporal distance between the training and test exposure. This effect was observed for intelligible but not for unintelligible speech, suggesting that the effect depends on properties unique to intelligible speech, such as the ability to form increasingly specific predictions about upcoming linguistic input, rather than general, non-linguistic factors related to repeated exposure. This distance effect was associated with increased model weights from -90 ms to 130 ms, indicating an enhancement of familiar input during an early cortical processing stage. In summary, these findings indicate that cortical tracking of sublexical speech features is modulated by repeated exposure to intelligible speech, consistent with a role for linguistic predictability.

neuroscience↗

Deep Sound Synthesis Reveals Novel Category-Defining Sound Features in the Human Auditory Cortex

The human auditory system extracts meaning from the environment by transforming acoustic input signals into semantic categories. Specific acoustic features give rise to distinct categorical percepts, such as speech or music, and to spatially distinct preferential responses in the auditory cortex. These responses contain category-relevant information, yet their representational level and role within the acoustic-to-semantic transformation process remain unclear. We combined neuroimaging, a deep neural network, a brain-based sound synthesis, and psychophysics to identify the sound features that are internally represented in the speech- and music-selective human auditory cortex and test their functional role in sound categorization. We found that the synthetized sounds exhibit unnatural features distinct from those normally associated with speech and music, yet they elicit categorical cortical and behavioral responses resembling those of natural speech and music. Our findings provide new insights into the fundamental sound features underlying speech and music categorization in the human auditory cortex.

neuroscience↗

Natural body-selective motion processing in humans: Evidence from event-related potentials

As social species, perception of body motion is crucial to daily interactions, yet the underlying neural processes and their dynamics are not fully understood. While well-established EEG evidence has identified temporal markers of biological body motion, and recent fMRI research points to naturalistic body networks, the temporal markers of higher-level, naturalistic body motion processes remain unknown. The present study bridges this gap, showing that at the stage of P2, the cortex may already distinguish between the global motion of naturalistic bodies compared to objects. Exploratory analyses point to a similar body-specific modulation across stimulus species, namely human and monkey. The findings of the present study expand our understanding of body motion processes, in line with emerging, integrative models of multi-faceted body processes.

neuroscience↗

Behavioral and neural evidence for perceptual predictions in social interactions

The ability to predict others behavior is crucial for social interactions. The goal of the present study was to test whether predictions are derived during observation of social interactions and whether these predictions influence how the whole-body emotional expressions of the agents are perceived. Using a novel paradigm, we induced social predictions in participants by presenting them with a short video of a social interaction in which a person approached another person and greeted him by touching the shoulder in either a neutral or an aggressive fashion. The video was followed by a still image showing a later stage in the interaction and we measured participants behavioral and neural responses to the still image, which was either congruent or incongruent with the emotional valence of the touching. We varied the strength of the induced predictions by parametrically reducing the saliency of emotional cues in the video. Behaviorally, we found that reducing the emotional cues in the video led to a significant decrease in participants ability to correctly judge the appropriateness of the emotional reaction in the image. At the neural level, EEG recordings revealed that observing an angry reaction elicited significantly larger N170 amplitudes than observing a neutral reaction. This emotion effect was only found in the high prediction condition (where the context in the preceding video was intact and clear), not in the mid and low prediction conditions. We further found that incongruent conditions elicited larger N300 amplitudes than congruent conditions only for the neutral images. Our findings provide evidence that viewing the initial stages of social interactions triggers predictions about their outcome in early cortical processing stages.

neuroscience↗

Theta activity discriminates high-level, species-specific body processes

Among social stimuli that trigger rapid reactions, body images occupy a prominent place. Given that bodies carry information about other agents intentions, actions and emotional expressions, a foundational question concerns the neural basis of body processing. Previous fMRI studies have investigated this but were not yet able to clarify the time course and its functional significance. The present EEG study investigated the role of slow oscillatory cortical activity in body processing and species-specificity. Human participants viewed naturalistic images of human and monkey bodies, faces, and objects, along with mosaic-scrambled versions to control for low-level visual features. Analysis of event-related theta power (4 - 7 Hz) combined with data-driven methods revealed a strong, body-evoked neural response that is specific to human bodies and likely originates from a widespread cortical region during a time window of 150 - 550 ms after the onset of the body image. Our results corroborate recent research proposing a widespread, species-specific cortical network of human body processing. We submit that this network may play an essential role in linking body processes to movement intentions.

neuroscience↗

Multimodal acoustic-electric trigeminal nerve stimulation modulates conscious perception

Multimodal stimulation has the potential to reverse pathological neural activity and alleviate symptoms in neuropsychiatric diseases. However, the reliability of this approach and the mechanisms through which it improves consciousness remain largely unknown. We investigated the effects of multimodal stimulation combining music stimulation with electrical trigeminal nerve stimulation in healthy human participants. We assessed conscious perception before and after acoustic-electric stimulation and investigated the mechanisms underlying the putative stimulation effects. Our results show that (1) acoustic-electric stimulation improves conscious tactile perception in healthy human participants without a concomitant change in auditory perception, (2) this improvement is caused by the interplay of the acoustic and electric stimulation rather than any of the unimodal stimulation alone, and (3) the effect of acoustic-electric stimulation on conscious perception correlates with inter-regional connection changes in a recurrent neural processing model. These findings provide evidence that multimodal acoustic-electric stimulation can promote conscious perception and offer insights into its underlying mechanisms.

neuroscience↗

Early threat perception is independent of later cognitive and behavioral control. A virtual reality-EEG-ECG study

Research on social threat has shown influences of various factors, such as agent characteristics, proximity and social interaction on social threat perception. An important, yet understudied aspect of threat experience concerns the ability to exert control over the thread. In this study, we used a Virtual Reality (VR) environment showing an approaching avatar that was either angry (threatening body expression) or neutral (neutral body expression) and informed participants to stop avatars from coming closer under five levels of control success (0, 25, 50, 75, or 100%) when they felt uncomfortable. Behavioral results revealed that social threat triggered faster reactions at a greater virtual distance from the participant than the neutral avatar. Event-related potentials (ERPs) revealed that the angry avatar elicited a larger N170/vertex positive potential (VPP) and a smaller N3 than the neutral avatar. The 100% control condition elicited a larger late positive potential (LPP) than the 75% control condition. In addition, we observed enhanced theta power and accelerated heart rate for the angry avatar vs. neutral avatar, suggesting that these measures index threat perception. Our results indicate that perception of social threat takes place in early to middle cortical processing stages, and control ability is associated with cognitive evaluation in middle to late stages.

neuroscience↗

Effects of continuous tactile stimulation on auditory-evoked cortical responses depend on the audio-tactile phase

Auditory perception can benefit from stimuli in non-auditory sensory modalities, as for example in lip-reading. Compared with such visual influences, tactile influences are still poorly understood. It has been shown that single tactile pulses can enhance the perception of auditory stimuli depending on their relative timing, but whether and how such brief auditory enhancements can be stretched in time with more sustained, phase-specific periodic tactile stimulation is still unclear. To address this question, we presented tactile stimulation that fluctuated coherently and continuously at 4Hz with an auditory noise (either in-phase or anti-phase) and assessed its effect on the cortical processing and perception of an auditory signal embedded in that noise. Scalp-electroencephalography recordings revealed an enhancing effect of in-phase tactile stimulation on cortical responses phase-locked to the noise and a suppressive effect of anti-phase tactile stimulation on responses evoked by the auditory signal. Although these effects appeared to follow well-known principles of multisensory integration of discrete audio-tactile events, they were not accompanied by corresponding effects on behavioral measures of auditory signal perception. Our results indicate that continuous periodic tactile stimulation can enhance cortical processing of acoustically-induced fluctuations and mask cortical responses to an ongoing auditory signal. They further suggest that such sustained cortical effects can be insufficient for inducing sustained bottom-up auditory benefits.

neuroscience↗

Categorical encoding of speech sounds: beyond auditory cortices

Which processes in the human brain lead to the categorical perception of speech sounds? Investigation of this question is hampered by the fact that categorical speech perception is normally confounded by acoustic differences in the stimulus. By using ambiguous sounds, however, it is possible to dissociate acoustic from perceptual stimulus representations. Twenty-seven normally hearing individuals took part in an fMRI study in which they were presented with an ambiguous syllable (intermediate between /da/ and /ga/) in one ear and with disambiguating acoustic feature (third formant, F3) in the other ear. Multi-voxel pattern searchlight analysis was used to identify brain areas that consistently differentiated between response patterns associated with different syllable reports. By comparing responses to different stimuli with identical syllable reports and identical stimuli with different syllable reports, we disambiguated whether these regions primarily differentiated the acoustics of the stimuli or the syllable report. We found that BOLD activity patterns in left perisylvian regions (STG, SMG), left inferior frontal regions (vMC, IFG, AI), left supplementary motor cortex (SMA/pre-SMA), and right motor and somatosensory regions (M1/S1) represent listeners syllable report irrespective of stimulus acoustics. Most of these regions are outside of what is traditionally regarded as auditory or phonological processing areas. Our results indicate that the process of speech sound categorization implicates decision-making mechanisms and auditory-motor transformations. HighlightsO_LIAmbiguous dichotic syllables elicit distinct percepts of identical stimuli C_LIO_LIMultivariate searchlight analysis reveals syllabic-category sensitive brain areas C_LIO_LICategorical responses arise in non-auditory cortical areas including motor areas C_LIO_LISMA is a possible locus for transforming sensory signals into perceptual decisions C_LI

neuroscience↗

Biasing the perception of spoken words with tACS

Recent neuroimaging evidence suggests that the frequency of entrained oscillations in auditory cortices influences the perceived duration of speech segments, impacting word perception (Kosem et al. 2018). We further tested the causal influence of neural entrainment frequency during speech processing, by manipulating entrainment with continuous transcranial alternating current stimulation (tACS) at distinct oscillatory frequencies (3 Hz and 5.5 Hz) above the auditory cortices. Dutch participants listened to speech and were asked to report their percept of a target Dutch word, which contained a vowel with an ambiguous duration. Target words were presented either in isolation (first experiment) or at the end of spoken sentences (second experiment). We predicted that the frequency of the tACS current would influence neural entrainment and therewith how speech is perceptually sampled, leading to a perceptual over- or underestimation of the vowel duration. Experiment 1 revealed no significant result. In contrast, results from experiment 2 showed a significant effect of tACS frequency on target word perception. Faster tACS lead to more long-vowel word percepts, in line with previous findings suggesting that neural oscillations are instrumental in the temporal processing of speech. The different results from the two experiments suggest that the impact of tACS is dependent on the sensory context. tACS may have a stronger effect on spoken word perception when the words are presented in a continuous stream of speech as compared to when they are isolated, potentially because prior (stimulus-induced) entrainment of brain oscillations might be a prerequisite for tACS to be effective.

neuroscience↗

How to test for oscillatory modulation of neural function and behaviour

Research on whether perception or other processes depend on the phase of neural oscillations is rapidly gaining popularity. However, it is unknown which methods are optimally suited to evaluate the hypothesized phase effect. Using a simulation approach, we here test the ability of different methods to detect such an effect on dichotomous (e.g., \"hit\" vs \"miss\") and continuous (e.g., scalp potentials) response variables. We manipulated parameters that characterise the phase effect or define the experimental approach to test for this effect. For each parameter combination and response variable, we identified an optimal method. We found that methods regressing single-trial responses on circular (sine and cosine) predictors perform best for all of the simulated parameters, regardless of the nature of the response variable (dichotomous or continuous). In sum, our study lays a foundation for optimized experimental designs and analyses in future studies investigating the role of phase for neural and behavioural responses. We provide MATLAB code for the statistical methods tested.

neuroscience↗

Dual-site high-density 4Hz transcranial alternating current stimulation applied over auditory and motor cortical speech areas does not influence auditory-motor mapping

BackgroundVerbal repetition of auditory speech requires the mapping of a sensory acoustic input onto articulatory motor plans (auditory-motor mapping). Recent evidence indicates that auditory-motor mapping could rely on low frequency neural synchronization (i.e., theta oscillatory phase coupling) between sensory and motor speech areas.\n\nObjectiveIn the present study, we apply dual-site high-density (HD) Transcranial Alternating Current Stimulation (TACS) above the auditory and motor cortex to induce, or disrupt, theta phase coupling between the two areas. We predicted that functionally coupling the two areas would strengthen auditory-motor mapping, compared with functionally decoupling them. We assessed the strength of auditory-motor mapping using a verbal repetition task.\n\nResultsWe found no significant effect of TACS-induced theta phase coupling on auditory-motor mapping as indexed by verbal repetition performance.\n\nConclusionAuditory-motor mapping may rely on a different mechanism than we hypothesized, for example, oscillatory phase-coupling outside the theta range. Alternatively, modulation of interregional theta-phase coupling may require more effective stimulation protocols, for example, TACS at higher intensities.

neuroscience↗