On the replicability of diffusion weighted MRI-based brain-behavior models

Abstract

Establishing replicable inter-individual brain-wide associations is key to advancing our understanding of the crucial links between brain structure, function, and behavior, as well as applying this knowledge in clinical contexts. While the replicability and sample size requirements for anatomical and functional MRI-based brain-behavior associations have been extensively discussed recently, systematic replicability assessments are still lacking for diffusion-weighted imaging (DWI), despite it being the dominant non-invasive method to investigate white matter microstructure and structural connectivity. We report results of a comprehensive evaluation of the replicability of various DWI-based multivariate brain-behavior models. This evaluation is based on large-scale data from the Human Connectome Project, including five different DWI-based brain features (from fractional anisotropy to structural connectivity) and 58 different behavioral phenotypes. Our findings show an overall moderate replicability, with 24-31% of phenotypes replicable with sample sizes of fewer than 500. As DWI yields trait-like brain features, we restricted the analysis to trait-like phenotypes, such as cognitive and motor skills, and found much more promising replicability estimates, with 67-75% of these phenotypes replicable with n<500. Contrasting our empirical results to analytical replicability estimates substantiated that the replicability of DWI-based models is primarily a function of the true, unbiased effect size. Our work highlights the potential of DWI to produce replicable brain-behavior associations. However, it shows that achieving replicability with small-to-moderate samples requires stable, reliable and neurobiologically relevant target phenotypes. Our work highlights the potential of DWI to produce replicable brain-behavior associations, but only for stable, reliable and neurobiologically relevant target phenotypes. HIGHLIGHTSO_LIModerate replicability in DWI-based models: Overall replicability of DWI-based brain-behavior associations ranges from 24-31% with sample sizes under 500. C_LIO_LIImproved replicability for trait-like phenotypes: Trait-like phenotypes e.g., cognitive and motor skills exhibit higher replicability estimates of 67-75%, compared to state-like phenotypes such as emotion. C_LIO_LIEffect size as a key factor: Replicability is primarily influenced by the true, unbiased effect size, highlighting the importance of targeting stable and reliable phenotypes. C_LIO_LIPromise of -based multivariate associations: DWI-based brain-behaviour models should focus on phenotypes that display a sufficient temporal stability and test-retest reliability. C_LI