EEG Microstate Sequences as Potential Brain-Computer Interface Triggers Derived from Motor Imagery Classification

Abstract

EEG microstates are a distinct number of quasi-stable spatial distributions of brain activity. Microstate trajectories are strongly suspected to reflect the underlying neural mechanisms during information processing and are therefore also called the "building blocks" of human thought. In this study, we examined, if EEG microstate sequences can serve as potential triggers for a Brain-Computer Interface (BCI). To this end, a semi-supervised deep learning model architecture consisting of an LSTM-based autoencoder and a dense neural network was utilized to classify between left- and right-hand motor imagery EEG data, with the resulting classification output serving as the BCI trigger. On the one hand, this was done in a 2-step approach, in which the autoencoder and classifer have been trained separately. On the other hand, an end-to-end approach was employed, where training was performed by combining reconstruction and classification losses. Results show that the proposed model architecture was able to extract relevant features from microstate sequences and exploit them for within subjects and sessions classification. Applying transfer learning to session-to-session or across-subject transfer resulted in peak classification accuracies around 89%. We also investigated to what extent transfer learning has to be applied to reach considerable classification accuracies serving as the calibration time representative. We found that on average around 400s are needed for BCI calibration when emplyoing our approach to reach 80% classification accuracy. The present study signifies that the investigation of EEG microstate trajectories can be a promising approach for extracting BCI triggers, as it reduces the dimensionality of multi-channel recorded EEG signals to a distinct number of brain states over time. Deep learning methods, especially transfer learning, applied to EEG microstate trajectories seem promising regarding user-convenient and calibration-free BCIs in real-world applications.