Search bioRxiv⌕ Search

Biology subjects

Ellis, C. A.

Publications and source records attributed to Ellis, C. A..

At least 19 recordsLinked to original sources

Diagnosis-Optimized Dynamic Feature Learning Reveals Altered Default Mode Network Connectivity in Schizophrenia

Schizophrenia (SZ) is characterized by widespread neural dysconnectivity, with particularly pronounced alterations in the default mode network (DMN)--a set of brain regions involved in self-referential thought and mind-wandering. We investigated dynamic functional connectivity within the DMN in SZ by analyzing resting-state fMRI data from two independent cohorts (FBIRN and COBRE). Using a novel iterative feature-removal clustering approach focusing on DMN independent components, we identified distinct recurring connectivity states while iteratively removing dominant connectivity features to reveal subtler network patterns. This approach iteratively refines the set of features considered, ensuring a more balanced representation and facilitating the identification of significant interactions that would otherwise be overlooked. Cluster centroids for the four connectivity states were highly similar across both datasets, reflecting stable shared DMN patterns. State occupancy was compared between participants with SZ and healthy controls, and associations with clinical symptom severity were examined. The SZ group exhibited significant alterations in DMN connectivity dynamics, spending more time than controls in certain connectivity states characterized by atypical DMN coupling and less time in a state reflecting a normative DMN configuration. A comparison between the FBIRN and COBRE datasets reveals both similarities and differences in occupancy rate (OCR) states. Overall, the pattern of group effects converged while state-specific divergences likely reflected protocol/sample differences rather than conflicting biology. Crucially, the explainability pipeline yielded a highly similar feature-removal order across datasets, indicating that the same DMN edges drive the diagnostic signal in both cohorts. Several OCR effects also tracked symptom ratings, linking abnormal DMN dynamics to clinical expression. Our findings suggest that SZ is characterized by reproducible disturbances in the temporal organization of DMN connectivity. These dynamic DMN features may serve as potential biomarkers for SZ, offering diagnostic and clinical utility by capturing network dysfunction that static connectivity measures could overlook.

neuroscience↗

Refining Brain Stimulation Therapies: An Active Learning Approach to Personalization

Brain stimulation holds promise for treating brain disorders, but personalizing therapy remains challenging. Effective treatment requires establishing a functional link between stimulation parameters and brain response, yet traditional methods like random sampling (RS) are inefficient and costly. To overcome this, we developed an active learning (AL) framework that identifies optimal relationships between stimulation parameters and brain response with fewer experiments. We validated this framework through three experiments: (1) in silico modeling with synthetic data from a Parkinsons disease model, (2) in silico modeling with real data from a non-human primate, and (3) in vivo modeling with a real-time rat optogenetic stimulation experiment. In each experiment, we compared AL models to RS models, using various query strategies and stimulation parameters (amplitude, frequency, pulse width). AL models consistently outperformed RS models, achieving lower error on unseen test data in silico (p<0.0056, N=1,000) and in vivo (p=0.0036, N=20). This approach represents a significant advancement in brain stimulation, potentially improving both research and clinical applications by making them more efficient and effective. Our findings suggest that AL can substantially reduce the cost and time required for developing personalized brain stimulation therapies, paving the way for more effective and accessible treatments for brain disorders.

neuroscience↗

Uncovering Effects of Schizophrenia upon a Maximally Significant, Minimally Complex Subset of Default Mode Network Connectivity Features

A common analysis approach for resting state functional magnetic resonance imaging (rs-fMRI) dynamic functional network connectivity (dFNC) data involves clustering windowed correlation time-series and assigning time windows to clusters (i.e., states) that can be quantified to summarize aspects of the dFNC dynamics. However, those methods can be dominated by a select few features and obscure key dynamics related to less dominant features. This study presents an iterative feature learning approach to identify a maximally significant and minimally complex subset of dFNC features within the default mode network (DMN) in schizophrenia (SZ). Utilizing dFNC data from individuals with SZ and healthy controls (HC), our approach uncovers a subset of features that has a greater number of dFNC states with disorder-related dynamics than is found when all features are present in the clustering. We find that anterior cingulate cortex/posterior cingulate cortex (ACC/PCC) interactions are consistently related to SZ across the most significant iterations of the feature learning analysis and that individuals with SZ tend to spend more time in states with greater intra-ACC anticorrelation and almost no time in a state of high intra-ACC correlation that HCs periodically enter. Our findings highlight the need for nuanced analyses to reveal disorder-related dynamics and advance our understanding of neuropsychiatric disorders.

neuroscience↗

Identifying EEG Biomarkers of Depression with Novel Explainable Deep Learning Architectures

Deep learning methods are increasingly being applied to raw electro-encephalogram (EEG) data. However, if these models are to be used in clinical or research contexts, methods to explain them must be developed, and if these models are to be used in research contexts, methods for combining explanations across large numbers of models must be developed to counteract the inherent randomness of existing training approaches. Model visualization-based explainability methods for EEG involve structuring a model architecture such that its extracted features can be characterized and have the potential to offer highly useful insights into the patterns that they uncover. Nevertheless, model visualization-based explainability methods have been underexplored within the context of multichannel EEG, and methods to combine their explanations across folds have not yet been developed. In this study, we present two novel convolutional neural network-based architectures and apply them for automated major depressive disorder diagnosis. Our models obtain slightly lower classification performance than a baseline architecture. However, across 50 training folds, they find that individuals with MDD exhibit higher {beta} power, potentially higher {delta} power, and higher brain-wide correlation that is most strongly represented within the right hemisphere. This study provides multiple key insights into MDD and represents a significant step forward for the domain of explainable deep learning applied to raw EEG. We hope that it will inspire future efforts that will eventually enable the development of explainable EEG deep learning models that can contribute both to clinical care and novel medical research discoveries.

neuroscience↗

Identifying Reproducibly Important EEG Markers of Schizophrenia with an Explainable Multi-Model Deep Learning Approach

The diagnosis of schizophrenia (SZ) can be challenging due to its diverse symptom presentation. As such, many studies have sought to identify diagnostic biomarkers of SZ using explainable machine learning methods. However, the generalizability of identified biomarkers in many machine learning-based studies is highly questionable given that most studies only analyze explanations from a small number of models. In this study, we present (1) a novel feature interaction-based explainability approach and (2) several new approaches for summarizing multi-model explanations. We implement our approach within the context of electroencephalogram (EEG) spectral power data. We further analyze both training and test set explanations with the goal of extracting generalizable insights from the models. Importantly, our analyses identify effects of SZ upon the , {beta}, and {theta} frequency bands, the left hemisphere of the brain, and interhemispheric interactions across a majority of folds. We hope that our analysis will provide helpful insights into SZ and inspire the development of robust approaches for identifying neuropsychiatric disorder biomarkers from explainable machine learning models.

neuroscience↗

Evaluating Augmentation Approaches for Deep Learning-based Major Depressive Disorder Diagnosis with Raw Electroencephalogram Data

While deep learning methods are increasingly applied in research contexts for neuropsychiatric disorder diagnosis, small dataset size limits their potential for clinical translation. Data augmentation (DA) could address this limitation, but the utility of EEG DA methods remains relatively underexplored in neuropsychiatric disorder diagnosis. In this study, we train a model for major depressive disorder diagnosis. We then evaluate the utility of 6 EEG DA approaches. Importantly, to remove the bias that could be introduced by comparing performance for models trained on larger augmented training sets to models trained on smaller baseline sets, we also introduce a new baseline trained on duplicate training data to better. We lastly examine the effects of the DA approaches upon representations learned by the model with a pair of explainability analyses. We find that while most approaches boost model performance, they do not improve model performance beyond that of simply using a duplicate training set without DA. The exception to this is channel dropout augmentation, which does improve model performance. These findings suggest the importance of comparing EEG DA methods to a baseline with a duplicate training set of equal size to the augmented training set. We also found that some DA methods increased model robustness to frequency (Fourier transform surrogates) and channel (channel dropout) perturbation. While our findings on EEG DA efficacy are restricted to our dataset and model, we hope that future studies on deep learning for small EEG datasets and on new EEG DA methods will find our findings helpful.

neuroscience↗

Cross-Sampling Rate Transfer Learning for Enhanced Raw EEG Deep Learning Classifier Performance in Major Depressive Disorder Diagnosis

Transfer learning offers a route for developing robust deep learning models on small raw electroencephalography (EEG) datasets. Nevertheless, the utility of applying representations learned from large datasets with a lower sampling rate to smaller datasets with higher sampling rates remains relatively unexplored. In this study, we transfer representations learned by a convolutional neural network on a large, publicly available sleep dataset with a 100 Hertz sampling rate to a major depressive disorder (MDD) diagnosis task at a sampling rate of 200 Hertz. Importantly, we find that the early convolutional layers contain representations that are generalizable across tasks. Moreover, our approach significantly increases mean model accuracy from 82.33% to 86.99%, increases the models use of lower frequencies, ({theta}-band), and increases its robustness to channel loss. We expect this analysis to provide useful guidance and enable more widespread use of transfer learning in EEG deep learning studies.

neuroscience↗

An Explainable and Robust Deep Learning Approach for Automated Electroencephalography-based Schizophrenia Diagnosis

Schizophrenia (SZ) is a neuropsychiatric disorder that affects millions globally. Current diagnosis of SZ is symptom-based, which poses difficulty due to the variability of symptoms across patients. To this end, many recent studies have developed deep learning methods for automated diagnosis of SZ, especially using raw EEG, which provides high temporal precision. For such methods to be productionized, they must be both explainable and robust. Explainable models are essential to identify biomarkers of SZ, and robust models are critical to learn generalizable patterns, especially amidst changes in the implementation environment. One common example is channel loss during EEG recording, which could be detrimental to classifier performance. In this study, we developed a novel channel dropout (CD) approach to increase the robustness of explainable deep learning models trained on EEG data for SZ diagnosis to channel loss. We developed a baseline convolutional neural network (CNN) architecture and implement our approach as a CD layer added to the baseline (CNN-CD). We then applied two explainability approaches to both models for insight into learned spatial and spectral features and show that the application of CD decreases model sensitivity to channel loss. The CNN and CNN-CD achieved accuracies of 81.9% and 80.9% on testing data, respectively. Furthermore, our models heavily prioritized the parietal electrodes and the -band, which is supported by existing literature. It is our hope that this study motivates the further development of explainable and robust models and bridges the transition from research to application in a clinical decision support role.

neuroscience↗

Improving Multichannel Raw Electroencephalography-based Diagnosis of Major Depressive Disorder by Pretraining Deep Learning Models with Single Channel Sleep Stage Data

As the field of deep learning has grown in recent years, its application to the domain of raw resting-state electroencephalography (EEG) has also increased. Relative to traditional machine learning methods or deep learning methods applied to extracted features, there are fewer methods for developing deep learning models on small raw EEG datasets. One potential approach for enhancing deep learning performance in this case is the use of transfer learning. In this study, we propose a novel EEG transfer learning approach wherein we first train a model on a large publicly available sleep stage classification dataset. We then use the learned representations to develop a classifier for automated major depressive disorder diagnosis with raw multichannel EEG. We find that our approach improves model performance, and we further examine how transfer learning affected the representations learned by the model through a pair of explainability analyses. Our proposed approach represents a significant step forward for the domain raw resting-state EEG classification. Furthermore, it has the potential to expand the use of deep learning methods across more raw EEG datasets and lead to the development of more reliable EEG classifiers. Clinical RelevanceThe proposed approach takes the field of deep learning in EEG a step closer to the robustness needed for clinical implementation.

neuroscience↗

Improving Explainability for Single-Channel EEG Deep Learning Classifiers via Interpretable Filters and Activation Analysis

As the field of deep learning has grown in recent years, its application to the domain of raw resting-state electroencephalography (EEG) has also increased. Relative to traditional machine learning methods or deep learning methods applied to manually engineered features, there are fewer methods for developing deep learning models on small raw EEG datasets. One potential approach for enhancing deep learning performance, in this case, is the use of transfer learning. While a number of studies have presented transfer learning approaches for manually engineered EEG features, relatively few approaches have been developed for raw resting-state EEG. In this study, we propose a novel EEG transfer learning approach wherein we first train a model on a large publicly available single-channel sleep stage classification dataset. We then use the learned representations to develop a classifier for automated major depressive disorder diagnosis with raw multichannel EEG. Statistical testing reveals that our approach significantly improves the performance of our model (p < 0.05), and we also find that the performance of our approach exceeds that of many previous studies using both engineered features and raw EEG. We further examine how transfer learning affected the representations learned by the model through a pair of explainability analyses, identifying key frequency bands and channels utilized across models. Our proposed approach represents a significant step forward for the domain of raw resting-state EEG classification and has broader implications for use with other electrophysiology and time-series modalities. Importantly, it has the potential to expand the use of deep learning methods across a greater variety of raw EEG datasets and lead to the development of more reliable EEG classifiers.

neuroscience↗

A Framework for Systematically Evaluating the Representations Learned by A Deep Learning Classifier from Raw Multi-Channel Electroencephalogram Data

The application of deep learning methods to raw electroencephalogram (EEG) data is growing increasingly common. While these methods offer the possibility of improved performance relative to other approaches applied to manually engineered features, they also present the problem of reduced explainability. As such, a number of studies have sought to provide explainability methods uniquely adapted to the domain of deep learning-based raw EEG classification. In this study, we present a taxonomy of those methods, identifying existing approaches that provide insight into spatial, spectral, and temporal features. We then present a novel framework consisting of a series of explainability approaches for insight into classifiers trained on raw EEG data. Our framework provides spatial, spectral, and temporal explanations similar to existing approaches. However, it also, to the best of our knowledge, proposes the first explainability approaches for insight into spatial and spatio-spectral interactions in EEG. This is particularly important given the frequent use and well-characterized importance of EEG connectivity measures for neurological and neuropsychiatric disorder analysis. We demonstrate our proposed framework within the context of automated major depressive disorder (MDD) diagnosis, training a high performing one-dimensional convolutional neural network with a robust cross-validation approach on a publicly available dataset. We identify interactions between frontal and central electrodes and other electrodes and identify differences in frontal {delta}, {theta}, {beta}, and {gamma}low between healthy controls and individuals with MDD. Our study represents a significant step forward for the field of deep learning-based raw EEG classification, providing new capabilities in interaction explainability and providing direction for future innovations through our proposed taxonomy.

neuroscience↗

Pairing Explainable Deep Learning Classification with Clustering to Uncover Effects of Schizophrenia Upon Whole Brain Functional Network Connectivity Dynamics

Many studies have analyzed resting state functional magnetic resonance imaging (rs-fMRI) dynamic functional network connectivity (dFNC) data to elucidate the effects of neurological and neuropsychiatric disorders upon the interactions of brain regions over time. Existing studies often use either machine learning classification or clustering algorithms. Additionally, several studies have used clustering algorithms to extract features related to brain states trajectories that can be used to train interpretable classifiers. However, the combination of explainable dFNC classifiers followed by clustering algorithms is highly underutilized. In this study, we show how such an approach can be used to study the effects of schizophrenia (SZ) upon brain activity. Specifically, we train an explainable deep learning model to classify between individuals with SZ and healthy controls. We then cluster the resulting explanations, identifying discriminatory states of dFNC. We lastly apply several novel measures to quantify aspects of the classifier explanations and obtain additional insights into the effects of SZ upon brain network dynamics. Specifically, we uncover effects of schizophrenia upon subcortical, sensory, and cerebellar network interactions. We also find that individuals with SZ likely have reduced variability in overall brain activity and that the effects of SZ may be temporally localized. In addition to uncovering effects of SZ upon brain network dynamics, our approach could provide novel insights into a variety of neurological and neuropsychiatric disorders in future dFNC studies.

neuroscience↗

Novel Approach Explains Spatio-Spectral Interactions in Raw Electroencephalogram Deep Learning Classifiers

The application of deep learning classifiers to resting-state electroencephalography (rs-EEG) data has become increasingly common. However, relative to studies using traditional machine learning methods and extracted features, deep learning methods are less explainable. A growing number of studies have presented explainability approaches for rs-EEG deep learning classifiers. However, to our knowledge, no approaches give insight into spatio-spectral interactions (i.e., how spectral activity in one channel may interact with activity in other channels). In this study, we combine gradient and perturbation-based explainability approaches to give insight into spatio-spectral interactions in rs-EEG deep learning classifiers for the first time. We present the approach within the context of major depressive disorder (MDD) diagnosis identifying differences in frontal {delta} activity and reduced interactions between frontal electrodes and other electrodes. Our approach provides novel insights and represents a significant step forward for the field of explainable EEG classification.

neuroscience↗

Explainable Fuzzy Clustering Framework Reveals Divergent Default Mode Network Connectivity Dynamics in Schizophrenia

Dynamic functional network connectivity (dFNC) analysis of resting state functional magnetic resonance imaging data has yielded insights into many neurological and neuropsychiatric disorders. A common dFNC analysis approach uses hard clustering methods like k-means clustering to assign samples to states that summarize network dynamics. However, hard clustering methods obscure network dynamics by assuming (1) that all samples within a cluster are equally like their assigned centroids and (2) that samples closer to one another in the data space than to their centroids are well-represented by their centroids. In addition, it can be hard to compare subjects, as in some cases an individual may not manifest a state strongly enough to enter a hard cluster. Approaches that allow a dimensional approach to connectivity patterns (e.g., fuzzy clustering) can mitigate these issues. In this study, we present an explainable fuzzy clustering framework by combining fuzzy c-means clustering with several explainability metrics. We apply our framework for schizophrenia (SZ) default mode network analysis, identifying 5 states and characterizing those states with a new explainability approach. While also showing that features typically used in hard clustering can be extracted in our framework, we present a variety of unique features to quantify state dynamics and identify effects of SZ upon network dynamics. We further uncover relationships between symptom severity and interactions of the precuneus with the anterior and posterior cingulate cortex. Given the ease of implementing our framework and its enhanced insight into network dynamics, it has great potential for use in future dFNC studies.

neuroscience↗

A Novel Explainable Fuzzy Clustering Approach for fMRI Dynamic Functional Network Connectivity Analysis

Resting state functional magnetic resonance imaging (rs-fMRI) dynamic functional network connectivity (dFNC) analysis has illuminated brain network interactions across many neuropsychiatric disorders. A common analysis approach involves using hard clustering methods to identify transitory states of brain activity, and in response to this, other methods have been developed to quantify the importance of specific dFNC interactions to identified states. Some of these methods involve perturbing individual features and examining the number of samples that switch states. However, only a minority of samples switch states. As such, these methods actually identify the importance of dFNC features to the clustering of a subset of samples rather than the overall clustering. In this study, we present a novel approach that more capably identifies the importance of each feature to the overall clustering. Our approach uses fuzzy clustering to output probabilities of each sample belonging to states and then measures their Kullback-Leibler divergence after perturbation. We show the viability of our approach in the context of schizophrenia (SZ) default mode network analysis, identifying significant differences in state dynamics between individuals with SZ and healthy controls. We further compare our approach with an existing approach, showing that it captures the effects of perturbation upon most samples. We also find that interactions between the posterior cingulate cortex (PCC) and the anterior cingulate cortex and the PCC and precuneus are important across methods. We expect that our novel explainable clustering approach will enable further progress in rs-fMRI analysis and to other clustering applications.

neuroscience↗

A Convolutional Autoencoder-based Explainable Clustering Approach for Resting-State EEG Analysis

Machine learning methods have frequently been applied to electroencephalography (EEG) data. However, while supervised EEG classification is well-developed, relatively few studies have clustered EEG, which is problematic given the potential for clustering EEG to identify novel subtypes or patterns of dynamics that could improve our understanding of neuropsychiatric disorders. There are established methods for clustering EEG using manually extracted features that reduce the richness of the feature space for clustering, but only a couple studies have sought to use deep learning-based approaches with automated feature learning to cluster EEG. Those studies involve separately training an autoencoder and then performing clustering on the extracted features, and the separation of those steps can lead to poor quality clustering. In this study, we propose an explainable convolutional autoencoder-based approach that combines model training with clustering to yield high quality clusters. We apply the approach within the context of schizophrenia (SZ), identifying 8 EEG states characterized by varying levels of {delta} activity. We also find that individuals who spend more time outside of the dominant state tend to have increased negative symptom severity. Our approach represents a significant step forward for clustering resting-state EEG data and has the potential to lead to novel findings across a variety of neurological and neuropsychological disorders in future years.

neuroscience↗

Neuropsychiatric Disorder Subtyping Via Clustered Deep Learning Classifier Explanations

Identifying subtypes of neuropsychiatric disorders based on characteristics of their brain activity has tremendous potential to contribute to a better understanding of those disorders and to the development of new diagnostic and personalized treatment approaches. Many studies focused on neuropsychiatric disorders examine the interaction of brain networks over time using dynamic functional network connectivity (dFNC) extracted from resting-state functional magnetic resonance imaging data. Some of these studies involve the use of either deep learning classifiers or traditional clustering approaches, but usually not both. In this study, we present a novel approach for subtyping individuals with neuropsychiatric disorders within the context of schizophrenia (SZ). We train an explainable deep learning classifier to differentiate between dFNC data from individuals with SZ and controls, obtaining a test accuracy of 79%. We next make use of cross-validation to obtain robust average explanations for SZ training participants across folds, identifying 5 SZ subtypes that each differ from controls in a distinct manner and that have different degrees of symptom severity. These subtypes specifically differ from one another in their interaction between the visual network and the subcortical, sensorimotor, and auditory networks and between the cerebellar network and the cognitive control and subcortical networks. Additionally, there are statistically significant differences in negative symptom scores between the subtypes. It is our hope that the proposed novel subtyping approach will contribute to the improved understanding and characterization of SZ and other neuropsychiatric disorders.

neuroscience↗

Identifying Neuropsychiatric Disorder Subtypes and Subtype-dependent Variation in Diagnostic Deep Learning Classifier Performance

Clinicians and developers of deep learning-based neuroimaging clinical decision support systems (CDSS) need to know whether those systems will perform well for specific individuals. However, relatively few methods provide this capability. Identifying neuropsychiatric disorder subtypes for which CDSS may have varying performance could offer a solution. Dynamic functional network connectivity (dFNC) is often used to study disorders and develop neuroimaging classifiers. Unfortunately, few studies have identified neurological disorder subtypes using dFNC. In this study, we present a novel approach with which we identify 4 states of dFNC activity and 4 schizophrenia subtypes based on their time spent in each state. We also show how the performance of an explainable diagnostic deep learning classifier is subtype-dependent. We lastly examine how the dFNC features used by the classifier vary across subtypes. Our study provides a novel approach for subtyping disorders that (1) has implications for future scientific studies and (2) could lead to more reliable CDSS.

bioinformatics↗