Search bioRxiv⌕ Search

Biology subjects

Hallum, L. E.

Publications and source records attributed to Hallum, L. E..

5 recordsLinked to original sources

Involuntary facial muscle activity during imagined vocalisation contaminates EEG and enables emotion decoding

AO_SCPLOWBSTRACTC_SCPLOWDecoding imagined speech from electroencephalography (EEG) recordings is potentially useful for brain-computer interfaces. Previous studies have focused on decoding semantic information from EEG, leaving the decoding of emotion - an important component of human communication - largely unexplored. Here, we report two experiments involving participants tasked with overt (n = 14) or imagined (n = 21) emotional vocalisation in five different categories: anger, happiness, neutral, sadness, and pleasure. Throughout, we recorded 64-channel EEG; we computed time-frequency features and used a logistic-regression classifier to evaluate emotion decoding accuracy. In five participants, we also recorded facial surface electromyography (sEMG) during imagined vocalisation, and studied the contamination of EEG by sEMG. Our results show that emotion can be decoded from single-trial EEG recordings of both overt (78.1%, chance = 20%) and imagined vocalisation (36.4%). The high-gamma band (50 to 100 Hz) and lateral EEG channels (T7, T8, and proximal) were important for decoding. sEMG analysis indicated that involuntary facial muscle activity contributed to these spectral and spatial patterns during imagined vocalisation, especially during happy vocalisations. We conclude that involuntary facial muscle activity is associated with certain emotion categories (i.e., happiness), and drives above-chance decoding of emotion from single-trial EEG recordings of imagined vocalisation.

physiology↗

Acoustic features of emotional vocalisations account for early modulations of event-related brain potentials

Emotion is key to human communication, inferring emotion in a speakers voice is a cross-cultural and cross-linguistic capability. Electroencephalography (EEG) studies of neural mechanisms supporting emotion perception have reported that early components of the event-related potential (ERP) are modulated by emotion. However, the nature of emotions effect, especially on the P200 component, is disputed. We hypothesised that early acoustic features of emotional utterances might account for ERP modulations previously attributed to emotion. We recorded multi-channel EEG from healthy participants (n = 30) tasked with recognising the emotion of utterances. We used fifty vocalisations in five emotions - anger, happiness, neutral, sadness and pleasure - drawn from the Montreal Affective Voices dataset. We statistically quantified instantaneous associations between ERP amplitudes, emotion categories, and acoustic features, specifically, intensity, pitch, first formant, and second formant. We found that shortly after utterance onset (120-250 ms, i.e., P200, early P300) ERP amplitude for sad vocalisations was less than for other emotional categories. Moreover, ERP amplitude at around 180 ms for happy vocalisation was less than for anger, sadness, and pleasure. Our analysis showed that acoustic intensity explains most of these early-latency effects. We also found that, at longer latency (220-500 ms; late P200, P300) ERP amplitude for neutral vocalisations was less than for other emotional categories. Furthermore, there were also ERP differences between anger and happiness, anger and pleasure, anger and sadness, happiness and pleasure, as well as happiness and sadness in shorter windows during this late period. Acoustic pitch and, to a lesser degree, acoustic intensity explain most of these later effects. We conclude that acoustic features can account for early ERP modulations evoked by emotional utterances. Because previous studies used a variety of stimuli, our result likely resolves previous disputes on emotions effect on P200.

physiology↗

Balanced, Orientation-Dependent Dichoptic Masking in Cortex of Visually Normal Humans Measured Using Electroencephalography (EEG)

In the human visual system, cerebral cortex combines left- and right-eye retinal inputs, enabling single, comfortable binocular vision. In visual cortex, the signals from each eye inhibit one another (interocular suppression). While this mechanism may be disrupted by e.g. traumatic brain injury, clinical assessments of interocular suppression are subjective, qualitative, and lack reliability. EEG is a potentially useful clinical tool for objective, quantitative assessment of binocular vision. In a cohort of normal participants, we measured occipital, visual evoked potentials (VEPs) in response to dichoptically-presented vertical and/or horizontal sine-wave gratings. Response amplitudes to orthogonal gratings were greater than that of parallel gratings, which were in turn greater than that of monocular gratings. Our results indicate that interocular suppression is (normally) balanced, orientation-tuned, and that suppression per se is reduced for orthogonal gratings. This objective measure of suppression may have application in clinical settings.

neuroscience↗

Detection of sleep apnea from single-channel electroencephalogram (EEG) using an explainable convolutional neural network

Sleep apnea (SA) is a common disorder involving the cessation of breathing during sleep. It can cause daytime hypersomnia, accidents, and, if allowed to progress, serious, chronic conditions. Continuous positive airway pressure is an effective SA treatment. However, long waitlists impede timely diagnosis; overnight sleep studies involve trained technicians scoring a polysomnograph, which comprises multiple physiological signals including multi-channel electroencephalography (EEG). Therefore, it is important to develop simplified and automated approaches to detect SA. We have developed an explainable convolutional neural network (CNN) to detect SA from single-channel EEG recordings which generalizes across subjects. The network architecture consisted of three convolutional layers. We tuned hyperparameters using the Hyperband algorithm, optimized parameters using Adam, and quantified network performance with subjectwise 10-fold cross-validation. Our CNN performed with an accuracy of 76.7% and a Matthews correlation coefficient (MCC) of 0.54. This performance was reliably above the conservative baselines of 50% (accuracy) and 0.0 (MCC). To explain the mechanisms of our trained network, we used critical-band masking (CBM): after training, we added bandlimited noise to test recordings; we parametrically varied the noise band center frequency and noise intensity, quantifying the deleterious effect on performance. We reconciled the effects of CBM with lesioning, wherein we zeroed the trained networks 1st-layer filter kernels in turn, quantifying the deleterious effect on performance. These analyses indicated that the network learned frequency-band information consistent with known SA biomarkers, specifically, delta and beta band activity. Our results indicate single-channel EEG may have clinical potential for SA diagnosis.

neuroscience↗

Laminar differences in responses to naturalistic texture in macaque V1 and V2

Most single units recorded from macaque V2 respond with higher firing rates to synthetic texture images containing \"naturalistic\" higher-order statistics than to spectrally matched \"noise\" images lacking these statistics. In contrast, few single units in V1 show this property. We explored how the strength and dynamics of response vary across the different layers of visual cortex by recording multiunit and gamma band activity evoked by brief presentations of naturalistic and noise images in V1 and V2 of anesthetized macaque monkeys. As previously reported, recordings in V2 showed consistently stronger responses to naturalistic texture than to spectrally matched noise. In contrast to single unit recordings, V1 multiunit activity showed some preference for images with naturalistic statistics, and in gamma band activity this preference was comparable across V1 and V2. Sensitivity to naturalistic image structure was strongest in the supragranular and infragranular layers of V1, but weak in granular layers, suggesting that it might reflect feedback from V2. Response timing was consistent with this idea. Visual responses appeared first in V1, followed by V2. Sensitivity to naturalistic texture emerged first in V2, followed by the supragranular and infragranular layers of V1, and finally in the granular layers of V1. Our results demonstrate laminar differences in the encoding of higher-order statistics of natural texture, and suggest that this sensitivity first arises in V2 and is fed back to modulate activity in V1.\n\nSignificance StatementThe circuit mechanisms responsible for visual representations of intermediate complexity are largely unknown. We used a well-validated set of synthetic texture stimuli to probe the temporal and laminar profile of sensitivity to the higher-order statistical structure of natural images. We found that this sensitivity emerges first and most strongly in V2 but soon after in V1. However, sensitivity in V1 is higher in the laminae (extragranular) and recording modalities (local field potential) most likely affected by V2 connections, suggesting a feedback origin. Our results show how sensitivity to naturalistic image structure emerges across time and circuitry in the early visual cortex.

neuroscience↗