Search bioRxiv⌕ Search

Biology subjects

Nichols, T.

Publications and source records attributed to Nichols, T..

At least 19 recordsLinked to original sources

ComCat: Combating Covariate Effects in Brain Analysis

As neuroimaging analysis shifts toward large-scale, multi-site studies, managing the unwanted variability introduced by combining heterogeneous datasets has become a critical challenge. Although tools such as ComBat and its neuroimaging extensions are widely used to address this variability, they only permit the modeling of categorical site effects and cannot account for continuous sources of confounding, such as image quality, head motion, and acquisition parameters. We introduce ComCat, an extension of the ComBat framework that preserves biologically relevant covariates while removing the effects of categorical site indicators and continuous nuisance variables. The latter are modeled as smooth nonlinear functions via B-spline basis expansion. ComCat is applicable to a broad range of brain analysis tasks, including voxel- and surface-based morphometry, normative modeling, and machine learning-based prediction. To demonstrate its capabilities, we evaluated ComCat on brain age prediction across five datasets covering complementary multi-site harmonization scenarios: ON-Harmony (10 subjects x 6 scanners; n = 80); the Buchert traveling-phantom dataset (1 subject x 116 scanners; n = 531); the Tohoku single-scanner, varying-acquisition dataset (n = 121); MR-ART (148 subjects with varying motion levels); and an ABIDE subset comprising 229 control subjects and 208 individuals with autism spectrum disorder across 14 scanners. Using image quality measures derived from CAT12 as continuous nuisance variables, ComCat reduced the mean absolute error (MAE) in brain age prediction relative to ComBat-GAM in all five datasets, including the two scenarios where site information was unavailable or uninformative. In the ABIDE dataset, ComCat improved harmonization while preserving the difference between the control and ASD groups, demonstrating that scanner-related variance can be removed without affecting biologically meaningful signals. ComCat can operate with or without site labels and is agnostic to the source of image quality metrics.

neuroscience↗

The Hidden Landscape of Missed Effects in Human Functional Neuroimaging

Functional neuroimaging aims to uncover brain processes underlying behavior and disease, yet studies are often underpowered to detect these effects. How this literature has shaped our understanding of brain function remains unknown, and little guidance exists for planning better powered studies. An underappreciated barrier is that commonly reported effect sizes across the brain are inflated, biasing study planning. Here, we introduce a correction for this inflation bias and show how more accurate studies can be planned using corrected effect size benchmarks from a mega-analysis of 63 typical studies across seven large datasets (52,979 participants). We find that common methods of planning studies based on uncorrected effects lead to roughly half the expected detections at typical sample sizes, with limited spatial overlap with original findings. These missed effects collectively explain meaningful additional variance in the desired outcome. We show how to recover missed effects by planning not only for power but also for a target number of detections via corrected benchmarks, or by taking a whole-brain approach with multivariate effects that individual research groups can detect (n < 50 compared to n > 1,000 for a typical univariate effect). These findings lay the groundwork for more informed study planning and a richer understanding of the widespread nature of brain effects, with implications for shared challenges (and solutions) across biomedicine.

neuroscience↗

Widespread use of invalid statistical tests in biomedical machine learning

Cross-validation is routinely used to compare performance in biomedical artificial intelligence. Standard tests ignore correlation across cross-validation folds, inflating false-positive rates. In a PRISMA-guided meta-analysis of 184 studies (impact factor [&ge;] 15) across 30 biomedical fields, 97% use invalid tests. Among studies with abstract-level claims supported by invalid tests, 59% rely on a spurious comparison: one that loses significance after correcting for this correlation. On average, regaining significance requires a 43% larger effect. Extending these findings to the broader literature, we estimate that spurious comparisons occur in nearly two in three studies and support abstract-level claims in nearly one in three studies. Simulations confirm false-positive rates paradoxically approach 100% when cross-validation is repeated to improve stability. We introduce SHARP, a redesign of cross-validation, which best balances false-positive control and power among 13 benchmarked tests. These results reveal widespread fragility in biomedical artificial intelligence and offer a practical route to valid comparisons.

bioinformatics↗

Age associations with cortical and subcortical brain structure in adolescents age 9-17

IntroductionAdolescence is a pivotal period in brain structural development and maturation. However, investigation of cortical and subcortical brain changes during this time have been limited by small sample size and have generally examined the brain at the level of predetermined regions of interest. The recently developed Fast Efficient Mixed-Effects Algorithm (FEMA) allows for increased computational speed using mixed-effects models applied at the voxel or vertex level, as well as across multiple regions of interest. MethodsWe extended the existing FEMA framework to represent predictors using natural spline basis functions, enabling us to model nonlinear trajectories of brain structure as a function of age. We then applied this model to the The Adolescent Brain Cognitive DevelopmentSM Study (22,651 observations from 10,521 unique subjects aged 9.00-17.77) to study the age-related trajectories of tabulated cortical and subcortical volumes, vertexwise cortical thickness and surface area, and voxelwise volume assessed using the Jacobian. Models are reported separately in males and females. ResultsGlobal volume variables, including total subcortical gray matter volume, peaked near 13 years in females and 15 years in males. Vertexwise cortical surface area followed an inverted U-shaped curve, whereas vertexwise cortical thickness followed a monotonic decrease during the age range studied. Voxelwise imaging analysis revealed regional differences in age trajectories at the subregional level. DiscussionThe results of this work replicate and extend prior findings related to adolescent brain development, and illustrate distinct spatiotemporal patterns of structural changes in subcortical regions. The updated FEMA framework is publicly available for use in similar large datasets.

neuroscience↗

Brain-wide functional connectome analysis of 40,000 individuals reveals brain networks that show aging effects in older adults

The functional connectome changes with aging. We systematically evaluated aging related alterations in the functional connectome using a whole-brain connectome network analysis in 39,675 participants in UK Biobank project. We used adaptive dense network discovery tools to identify networks directly associated with aging from resting-state fMRI data. We replicated our findings in 499 participants from the Lifespan Human Connectome Project in Aging study. The results consistently revealed two motor-related subnetworks (both permutation test p-values <0.001) that showed a decline in resting-state functional connectivity (rsFC) with increasing age. The first network primarily comprises sensorimotor and dorsal/ventral attention regions from precentral gyrus, postcentral gyrus, superior temporal gyrus, and insular gyrus, while the second network is exclusively composed of basal ganglia regions, namely the caudate, putamen, and globus pallidus. Path analysis indicates that white matter fractional anisotropy mediates 19.6% (p<0.001, 95% CI [7.6% 36.0%]) and 11.5% (p<0.001, 95% CI [6.3% 17.0%]) of the age-related decrease in both networks, respectively. The total volume of white matter hyperintensity mediates 32.1% (p<0.001, 95% CI [16.8% 53.0%]) of the aging-related effect on rsFC in the first subnetwork.

neuroscience↗

MRI economics: Balancing sample size and scan duration in brain wide association studies

A pervasive dilemma in brain-wide association studies (BWAS) is whether to prioritize functional MRI (fMRI) scan time or sample size. We derive a theoretical model showing that individual-level phenotypic prediction accuracy increases with sample size and total scan duration (sample size x scan time per participant). The model explains empirical prediction accuracies extremely well across 76 phenotypes from nine resting-fMRI and task-fMRI datasets (R2 = 0.89), spanning a wide range of scanners, acquisitions, racial groups, disorders and ages. For scans [&le;]20 mins, prediction accuracy increases linearly with the logarithm of total scan duration, suggesting interchangeability of sample size and scan time. However, sample size is ultimately more important than scan time in determining prediction accuracy. Nevertheless, when accounting for overhead costs associated with each participant (e.g., recruitment costs), to boost prediction accuracy, longer scans can yield substantial cost savings over larger sample size. To achieve high prediction performance, 10-min scans are highly cost inefficient. In most scenarios, the optimal scan time is [&ge;]20 mins. On average, 30-min scans are the most cost-effective, yielding 22% cost savings over 10-min scans. Overshooting is cheaper than undershooting the optimal scan time, so we recommend aiming for [&ge;]30 mins. Compared with resting-state whole-brain BWAS, the most cost-effective scan time is shorter for task-fMRI and longer for subcortical-cortical BWAS. Standard power calculations maximize sample size at the expense of scan time. Our study demonstrates that optimizing both sample size and scan time can boost prediction power while cutting costs. Our empirically informed reference is available for future study planning: WEB_APPLICATION_LINK

neuroscience↗

Fecal microbiomics biomarkers for Chronic Wasting Disease

Chronic wasting disease (CWD) is a naturally occurring prion disease in cervids that has been rapidly proliferating in the US. Here we investigated a potential link between CWD infection and gut microbiome by analyzing 50 fecal samples obtained from CWD-positive animals of different sexes from various regions in the US, compared to 50 CWD-negative controls using high throughput sequencing of the 16S ribosomal RNA and targeted metabolomics. Our analysis reveals promising trends in the gut microbiota that could potentially be CWD-dependent, including several bacterial taxa at each rank level, as well as taxa pairs, that can differentiate between CWD-negative and CWD-positive deer. At each rank level, these taxa and taxa pairs could facilitate identification of around 70% of both the CWD-negative and the CWD-positive samples. Our results provide a potential tool for diagnostics and surveillance of CWD in the wild, as well as conceptual advances in our understanding of the disease. ImportanceThis is a comprehensive study that tests the connection between the composition of the gut microbiome in deer in response to Chronic Wasting Disease (CWD). We analyzed 50 fecal samples obtained from CWD-positive animals compared to 50 CWD-negative controls to identify CWD-dependent changes in the gut microbiome, matched with the analysis of fecal metabolites. Our results show promising trends suggesting that fecal microbial composition can directly correspond to CWD disease status. These results point to microbial composition of the feces as a potential tool for diagnostics and surveillance of CWD in the wild, including non-invasive CWD detection in asymptomatic deer and deer habitats, and enable conceptual advances in our understanding of the disease.

microbiology↗

A scalable approach for continuous time Markov models with covariates

Existing methods for fitting continuous time Markov models (CTMM) in the presence of covariates suffer from scalability issues due to high computational cost of matrix exponentials calculated for each observation. In this paper we propose an optimization technique for CTMM which uses a stochastic gradient descent algorithm combined with differentiation of the matrix exponential using a Pade approximation which we show then makes fitting large scale data feasible. We compare two methods for computing standard errors, one using Pade expansion, and the other using power series expansion of the matrix exponential. Through simulations we find improved performance relative to existing CTMM methods, and we demonstrate the method on the large-scale multiple sclerosis NO.MS dataset.

bioinformatics↗

BLMM: Parallelised Computing for Big Linear Mixed Models

Within neuroimaging large-scale, shared datasets are becoming increasingly commonplace, challenging existing tools both in terms of overall scale and complexity of the study designs. As sample sizes grow, researchers are presented with new opportunities to detect and account for grouping factors and covariance structure present in large experimental designs. In particular, standard linear model methods cannot account for the covariance and grouping structures present in large datasets, and the existing linear mixed models (LMM) tools are neither scalable nor exploit the computational speed-ups afforded by vectorisation of computations over voxels. Further, nearly all existing tools for imaging (fixed or mixed effect) do not account for variability in the patterns of missing data near cortical boundaries and the edge of the brain, and instead omit any voxels with any missing data. Yet in the large-n setting, such a voxel-wise deletion missing data strategy leads to severe shrinkage of the final analysis mask. To counter these issues, we describe the "Big" Linear Mixed Models (BLMM) toolbox, an efficient Python package for large-scale fMRI LMM analyses. BLMM is designed for use on high performance computing clusters and utilizes a Fisher Scoring procedure made possible by derivations for the LMM Fisher information matrix and score vectors derived in our previous work, Maullin-Sapey and Nichols (2021).

neuroscience↗

Isolating the Sources of Pipeline-Variability in Group-Level Task-fMRI results

While the development of tools and techniques has broadened our horizons for comprehending the complexities of the human brain, a growing body of research has highlighted the pitfalls of such methodological plurality. In a recent study, we found that the choice of software package used to run the analysis pipeline can have a considerable impact on the final group-level results of a task-fMRI investigation (Bowring et al., 2019, BMN). Here we revisit our work, seeking to identify the stages of the pipeline where the greatest variation between analysis software is induced. We carry out further analyses on the three datasets evaluated in BMN, employing a common processing strategy across parts of the analysis workflow and then utilizing procedures from three software packages (AFNI, FSL and SPM) across the remaining steps of the pipeline. We use quantitative methods to compare the statistical maps and isolate the main stages of the workflow where the three packages diverge. Across all datasets, we find that variation between the packages results is largely attributable to a handful of individual analysis stages, and that these sources of variability were heterogeneous across the datasets (e.g. choice of first-level signal model had the most impact for the ds000001 dataset, while first-level noise model was more influential for ds000109 dataset). We also observe areas of the analysis workflow where changing the software package causes minimal differences in the final results, finding that the group-level results were largely unaffected by which software package is used to model the low-frequency fMRI drifts.

neuroscience↗

Improved Interpretability of Brain-Behavior CCA with Domain-driven Dimension Reduction

Canonical Correlation Analysis (CCA) has been widely applied to study correlations between neuroimaging data and behavioral data. Practical use of CCA typically requires dimensionality reduction with, for example, Principal Components Analysis (PCA), however, this can result in CCA results that are difficult to interpret. In this paper, we introduce a Domain-driven Dimension Reduction (DDR) method, reducing the dimensionality of the original datasets combining human knowledge of the structure of the variables studied. We apply the method to the Human Connectome Project S1200 release and compare standard PCA across all variables with DDR applied to individual classes of variables, finding that DDR-CCA results are more stable and interpretable, allowing the contribution of each class of variable to be better understood. By carefully designing the analysis pipeline and cross-validating the results, we offer more insights on the interpretation of CCA applied to brain-behaviour data.

neuroscience↗

Meaningful Effects in the Adolescent Brain Cognitive Development Study

The Adolescent Brain Cognitive Development (ABCD) Study is the largest single-cohort prospective longitudinal study of neurodevelopment and childrens health in the United States. A cohort of n= 11,880 children aged 9-10 years (and their parents/guardians) were recruited across 22 sites and are being followed with in-person visits on an annual basis for at least 10 years. The study approximates the US population on several key sociodemographic variables, including sex, race, ethnicity, household income, and parental education. Data collected include assessments of health, mental health, substance use, culture and environment and neurocognition, as well as geocoded exposures, structural and functional magnetic resonance imaging (MRI), and whole-genome genotyping. Here, we describe the ABCD Study aims and design, as well as issues surrounding estimation of meaningful associations using its data, including population inferences, hypothesis testing, power and precision, control of covariates, interpretation of associations, and recommended best practices for reproducible research, analytical procedures and reporting of results.

neuroscience↗

Towards Reproducible Brain-Wide Association Studies

Magnetic resonance imaging (MRI) continues to drive many important neuroscientific advances. However, progress in uncovering reproducible associations between individual differences in brain structure/function and behavioral phenotypes (e.g., cognition, mental health) may have been undermined by typical neuroimaging sample sizes (median N=25)1,2. Leveraging the Adolescent Brain Cognitive Development (ABCD) Study3 (N=11,878), we estimated the effect sizes and reproducibility of these brain-wide associations studies (BWAS) as a function of sample size. The very largest, replicable brain-wide associations for univariate and multivariate methods were r=0.14 and r=0.34, respectively. In smaller samples, typical for brain-wide association studies (BWAS), irreproducible, inflated effect sizes were ubiquitous, no matter the method (univariate, multivariate). Until sample sizes started to approach consortium-levels, BWAS were underpowered and statistical errors assured. Multiple factors contribute to replication failures4-6; here, we show that the pairing of small brain-behavioral phenotype effect sizes with sampling variability is a key element in wide-spread BWAS replication failure. Brain-behavioral phenotype associations stabilize and become more reproducible with sample sizes of N{gap}2,000. While investigator-initiated brain-behavior research continues to generate hypotheses and propel innovation, large consortia are needed to usher in a new era of reproducible human brain-wide association studies.

neuroscience↗

The quest for measuring myelin with MRI - An interactive meta-analysis of quantitative comparisons with histology

Several MRI measures have been proposed as in vivo biomarkers of myelin, each with applications ranging from plasticity to pathology. Despite the availability of these myelin-sensitive modalities, specificity and sensitivity have been a matter of discussion. Debate about which MRI measure is the most suitable for quantifying myelin is still ongoing. In this study, we performed a systematic review of published quantitative validation studies to clarify how different these measures are when compared to the underlying histology. We analysed the results from 43 studies applying meta-analysis tools, controlling for study sample size and using interactive visualization (https://neurolibre.github.io/myelin-meta-analysis). We report the overall estimates and the prediction intervals for the coefficient of determination and find that MT and relaxometry-based measures exhibit the highest correlations with myelin content. We also show which measures are, and which measures are not statistically different regarding their relationship with histology.

neuroscience↗

Spatial distribution and cognitive impact of cerebrovascular risk-related white matter hyperintensities

ObjectivesWhite matter hyperintensities (WMHs) are considered macroscale markers of cerebrovascular burden and are associated with increased risk of vascular cognitive impairment and dementia. However, the spatial location of WMHs has typically been considered in broad categories of periventricular versus deep white matter. The spatial distribution of WHMs associated with individual cerebrovascular risk factors (CVR), controlling for frequently comorbid risk factors, has not been systematically investigated at the population level in a healthy ageing cohort. Furthermore, there is an inconsistent relationship between total white matter hyperintensity load and cognition, which may be due to the confounding of several simultaneous risk factors in models based on smaller cohorts. MethodsWe examined trends in individual CVR factors on total WMH burden in 13,680 individuals (aged 45-80) using data from the UK Biobank. We estimated the spatial distribution of white matter hyperintensities associated with each risk factor and their contribution to explaining total WMH load using voxel-wise probit regression and univariate linear regression. Finally, we explored the impact of CVR-related WMHs on speed of processing using regression and mediation analysis. ResultsContrary to the assumed dominance of hypertension as the biggest predictor of WMH burden, we show associations with a number of risk factors including diabetes, heavy smoking, APOE{varepsilon} 4/{varepsilon}4 status and high waist-to-hip ratio of similar, or greater magnitude to hypertension. The spatial distribution of WMHs varied considerably with individual cerebrovascular risk factors. There were independent effects of visceral adiposity, as measured by waist-to-hip ratio, and carriage of the APOE{varepsilon} 4 allele in terms of the unique spatial distribution of CVR-related WMHs. Importantly, the relationship between total WMH load and speed of processing was mediated by waist-to-hip ratio suggesting cognitive consequences to WMHs associated with excessive visceral fat deposition. ConclusionWaist-to-hip ratio, diabetes, heavy smoking, hypercholesterolemia and homozygous APOE{varepsilon} 4 status are important risk factors, beyond hypertension, associated with WMH total burden and warrant careful control across ageing. The spatial distribution associated with different risk factors may provide important clues as to the pathogenesis and cognitive consequences of WMHs. High waist-to-hip ratio is a key risk factor associated with slowing in speed of processing. With global obesity levels rising, focused management of visceral adiposity may present a useful strategy for the mitigation of cognitive decline in ageing.

neuroscience↗

Confound modelling in UK Biobank brain imaging

Dealing with confounds is an essential step in large cohort studies to address problems such as unexplained variance and spurious correlations. UK Biobank is a powerful resource for studying associations between imaging and nonimaging measures such as lifestyle factors and health outcomes, in part because of the large subject numbers. However, the resulting high statistical power also raises the sensitivity to confound effects, which therefore have to be carefully considered. In this work we describe a set of possible confounds (including non-linear effects and interactions) that researchers may wish to consider for their studies using such data. We include descriptions of how we can estimate the confounds, and study the extent to which each of these confounds affects the data, and the spurious correlations that may arise if they are not controlled. Finally, we discuss several issues that future studies should consider when dealing with confounds.

neuroscience↗

How does group differences in motion scrubbing affect false positives in functional connectivity studies?

Analyzing resting state fMRI data is difficult due to a weak signal and several noise sources. Head motion is also a major problem and it is common to apply motion scrubbing, i.e. to remove time points where a subject has moved more than some pre-defined motion threshold. A problem arises if one cohort on average moves more than another, since the remaining temporal degrees of freedom are then different for the two groups. The effect of this is that the uncertainty of the functional connectivity estimates (e.g. Pearson correlations) are different for the two groups, but this is seldom modelled in resting state fMRI. We demonstrate that group differences in motion scrubbing can result in inflated false positives, depending on how the temporal auto correlation is modelled when performing the Fisher r-to-z transform.

neuroscience↗

Emergence of neural dynamics within a co-ordinate space of large-scale neural hierarchies

When unoccupied by an explicit external task, humans engage in a wide range of different types of self-generated thinking. These are often unrelated to the immediate environment and have unique psychological features. Although contemporary perspectives on ongoing thought recognise the heterogeneity of these self-generated states, we lack both a clear understanding of how to classify the specific states, and how they can be mapped empirically. In the current study, we capitalise on advances in machine learning that allow continuous neural data to be divided into a set of distinct temporally re-occurring patterns, or states. We applied this technique to a large set of resting state data in which we also acquired retrospective descriptions of the participants experiences during the scan. We found that two of the identified states were predictive of patterns of thinking at rest. One state highlighted a pattern of neural activity commonly seen during demanding tasks, and the time individuals spent in this state was associated with descriptions of experience focused on problem solving in the future. A second state was associated with patterns of activity that are commonly seen under less demanding conditions, and the time spent in it was linked to reports of negative rumination. Finally, we found that these two neural states tended to fall at either end of a neural hierarchy that is thought to reflect the brains response to cognitive demands. Together, these results demonstrate that approaches which take advantage of time-varying changes in neural function can play an important role in understanding the repertoire of self-generated states. Moreover, they establish that important features of self-generated ongoing experience are related to variation along a similar vein to those seen when the brain responds to cognitive task demands.

neuroscience↗