Biology subjects

Ooi, L. Q. R.

Publications and source records attributed to Ooi, L. Q. R..

16 recordsLinked to original sources

bioRxiv2026

Widespread use of invalid statistical tests in biomedical machine learning

Cross-validation is routinely used to compare performance in biomedical artificial intelligence. Standard tests ignore correlation across cross-validation folds, inflating false-positive rates. In a PRISMA-guided meta-analysis of 184 studies (impact factor [≥] 15) across 30 biomedical fields, 97% use invalid tests. Among studies with abstract-level claims supported by invalid tests, 59% rely on a spurious comparison: one that loses significance after correcting for this correlation. On average, regaining significance requires a 43% larger effect. Extending these findings to the broader literature, we estimate that spurious comparisons occur in nearly two in three studies and support abstract-level claims in nearly one in three studies. Simulations confirm false-positive rates paradoxically approach 100% when cross-validation is repeated to improve stability. We introduce SHARP, a redesign of cross-validation, which best balances false-positive control and power among 13 benchmarked tests. These results reveal widespread fragility in biomedical artificial intelligence and offer a practical route to valid comparisons.

bioinformatics↗

bioRxiv2025

Convergent and divergent brain-cognition relationships during development revealed by cross-sectional and longitudinal analyses in the ABCD Study

How brain networks and cognition co-evolve during development remains poorly understood. Here, we use resting-state functional magnetic resonance imaging (rs-fMRI) and cognitive data at baseline and Year 2 of 2,949 individuals in the Adolescent Brain Cognitive Development (ABCD) Study to examine how stable and changing features of brain network organization predict cognitive development during early adolescence. We find that baseline resting-state functional connectivity (FC) more strongly predicts future cognitive ability than baseline cognitive ability. Models trained on baseline FC to predict baseline cognition generalize better to Year 2 FC and cognition, suggesting that brain-cognition relationships strengthen over time. Intriguingly, baseline FC outperforms longitudinal FC change in predicting future cognitive ability. One potential reason is the lower reliability of FC change compared to baseline FC: ICC = 0.24 vs. 0.56. However, reducing baseline FCs reliability by shortening scan duration only partially narrows the predictive gap, suggesting reliability alone cannot be the full explanation. Furthermore, neither baseline FC nor FC change meaningfully predicts longitudinal change in cognitive ability. We also identify converging and diverging predictive network features across cross-sectional and longitudinal models of brain-cognition relationships, revealing a multivariate twist on Simpsons paradox. Together, these findings suggest that during early adolescence, stable individual differences in brain functional network organization play a more critical role than dynamic changes in shaping future cognitive outcomes.

neuroscience↗

bioRxiv2025

Network-based Near-Scalp Personalized Brain Stimulation Targets

Functional connectivity (FC) is often used to identify personalized targets for transcranial magnetic stimulation (TMS). However, existing methods often overlook individual differences in whole-cortex network organization. Furthermore, in some personalized TMS protocols, lower stimulation intensity is used for targets closer to the scalp, which may improve patient tolerance. Here, we develop an algorithm to simultaneously optimize FC and scalp proximity for target localization. We first use the multi-session hierarchical Bayesian model (MS-HBM) to estimate high-quality individual-specific cortical networks. A tree-based algorithm is then used to select the optimal target. With essentially no parameter to tune, our framework may potentially improve generalizability across populations. We compare our approach to existing "cluster" and "cone" algorithms. In two test-retest datasets of healthy individuals from the United States and Singapore, tree-based MS-HBM reliably identifies personalized TMS targets for depression near the scalp. Tree-based MS-HBM targets compare favorably with cluster and cone targets in terms of reliability, scalp proximity, and FC to the subgenual anterior cingulate cortex (sACC) in new out-of-sample MRI sessions. To demonstrate versatility, the same algorithm identifies personalized anxiety targets without tuning any parameter. In patients with treatment-resistant depression, tree-based MS-HBM targets compare favorably with cluster and cone targets in terms of reliability, scalp proximity, and sACC FC, hypothetically reducing stimulation intensity by 15% and 5% respectively. MS-HBM also exhibits the best (most negative) electric-field hotspot sACC FC and highest reliability in induced electric fields. Overall, tree-based MS-HBM provides a robust, generalizable framework to estimate near-scalp personalized targets across populations.

neuroscience↗

bioRxiv2025

Associations between epilepsy-related polygenic risk and brain morphology in childhood

AO_SCPLOWBSTRACTC_SCPLOWTemporal lobe epilepsy with hippocampal sclerosis (TLE-HS) is associated with a complex genetic architecture, but the translation from genetic risk factors to brain vulnerability remains unclear. Here, we examined associations between epilepsy-related polygenic risk scores for HS (PRS-HS) and brain structure in a large sample of neurotypical children, and correlated these signatures with case-control findings in in multicentric cohorts of patients with TLE-HS. Imaging-genetic analyses revealed PRS-related cortical thinning in temporo-parietal and fronto-central regions, strongly anchored to distinct functional and structural network epicentres. Compared to disease-related effects derived from epilepsy case-control cohorts, structural correlates of PRS-HS mirrored atrophy and epicentre patterns in patients with TLE-HS. By identifying a potential pathway between genetic vulnerability and disease mechanisms, our findings provide new insights into the genetic underpinnings of structural alterations in TLE-HS and highlight potential imaging-genetic biomarkers for early risk stratification and personalized interventions.

neuroscience↗

bioRxiv2024

Protective role of parenthood on age-related brain function in mid- to late-life

The experience of parenthood can profoundly alter ones body, mind, and environment, yet we know little about the long-term associations between parenthood and brain function and aging in adulthood. Here, we investigate the link between number of children parented (parity) and age on brain function in 19,964 females and 17,607 males from the UK Biobank. In both females and males, increased parity was positively associated with functional connectivity, particularly within the somato/motor network. Critically, the spatial topography of parity-linked effects was inversely correlated with the impact of age on functional connectivity across the brain for both females and males, suggesting that a higher number of children is associated with patterns of brain function in the opposite direction to age-related alterations. These results indicate that the changes accompanying parenthood may confer benefits to brain health across the lifespan, highlighting the importance of future work to understand the associated mechanisms.

neuroscience↗

bioRxiv2024

Sex differences in the functional network underpinnings of psychotic-like experiences in children

Psychotic-like experiences (PLEs) include a range of sub-threshold symptoms that resemble aspects of psychosis but do not necessarily indicate the presence of psychiatric illness. These experiences are highly prevalent in youth and are associated with developmental disruptions across social, academic, and emotional domains. While not all youth who report PLEs develop psychosis, many develop other psychiatric illnesses during adolescence and adulthood. As such, PLEs are theorized to represent early markers of poor mental health. Here, we characterized the similarities and differences in the neurobiological underpinnings of childhood PLEs across the sexes using a large sample from the ABCD Study (n=5,260), revealing sex-specific associations between functional networks connectivity and PLEs. We find that although the networks associated with PLEs overlap to some extent across the sexes, there are also crucial differences. In females, PLEs are associated with dispersed cortical and non-cortical connections, whereas in males, they are primarily associated with functional connections within limbic, temporal parietal, somato/motor, and visual networks. These results suggest that early transdiagnostic markers of psychopathology may be distinct across the sexes, further emphasizing the need to consider sex in psychiatric research as well as clinical practice.

neuroscience↗

bioRxiv2024

MRI economics: Balancing sample size and scan duration in brain wide association studies

A pervasive dilemma in brain-wide association studies (BWAS) is whether to prioritize functional MRI (fMRI) scan time or sample size. We derive a theoretical model showing that individual-level phenotypic prediction accuracy increases with sample size and total scan duration (sample size x scan time per participant). The model explains empirical prediction accuracies extremely well across 76 phenotypes from nine resting-fMRI and task-fMRI datasets (R2 = 0.89), spanning a wide range of scanners, acquisitions, racial groups, disorders and ages. For scans [≤]20 mins, prediction accuracy increases linearly with the logarithm of total scan duration, suggesting interchangeability of sample size and scan time. However, sample size is ultimately more important than scan time in determining prediction accuracy. Nevertheless, when accounting for overhead costs associated with each participant (e.g., recruitment costs), to boost prediction accuracy, longer scans can yield substantial cost savings over larger sample size. To achieve high prediction performance, 10-min scans are highly cost inefficient. In most scenarios, the optimal scan time is [≥]20 mins. On average, 30-min scans are the most cost-effective, yielding 22% cost savings over 10-min scans. Overshooting is cheaper than undershooting the optimal scan time, so we recommend aiming for [≥]30 mins. Compared with resting-state whole-brain BWAS, the most cost-effective scan time is shorter for task-fMRI and longer for subcortical-cortical BWAS. Standard power calculations maximize sample size at the expense of scan time. Our study demonstrates that optimizing both sample size and scan time can boost prediction power while cutting costs. Our empirically informed reference is available for future study planning: WEB_APPLICATION_LINK

neuroscience↗

bioRxiv2023

Multilayer meta-matching: translating phenotypic prediction models from multiple datasets to small data

Resting-state functional connectivity (RSFC) is widely used to predict phenotypic traits in individuals. Large sample sizes can significantly improve prediction accuracies. However, for studies of certain clinical populations or focused neuroscience inquiries, small-scale datasets often remain a necessity. We have previously proposed a "meta-matching" approach to translate prediction models from large datasets to predict new phenotypes in small datasets. We demonstrated large improvement of meta-matching over classical kernel ridge regression (KRR) when translating models from a single source dataset (UK Biobank) to the Human Connectome Project Young Adults (HCP-YA) dataset. In the current study, we propose two meta-matching variants ("meta-matching with dataset stacking" and "multilayer meta-matching") to translate models from multiple source datasets across disparate sample sizes to predict new phenotypes in small target datasets. We evaluate both approaches by translating models trained from five source datasets (with sample sizes ranging from 862 participants to 36,834 participants) to predict phenotypes in the HCP-YA and HCP-Aging datasets. We find that multilayer meta-matching modestly outperforms meta-matching with dataset stacking. Both meta-matching variants perform better than the original "meta-matching with stacking" approach trained only on the UK Biobank. All meta-matching variants outperform classical KRR and transfer learning by a large margin. In fact, KRR is better than classical transfer learning when less than 50 participants are available for finetuning, suggesting the difficulty of classical transfer learning in the very small sample regime. The multilayer meta-matching model is publicly available at GITHUB_LINK.

neuroscience↗

bioRxiv2023

Distinct brain network features predict internalizing and externalizing traits in children and adults

Internalizing and externalizing traits are two distinct classes of behaviors in psychiatry. However, whether shared or unique brain network features predict internalizing and externalizing behaviors in children and adults remain poorly understood. Using a sample of 2262 children from the Adolescent Brain Cognitive Development (ABCD) study and 752 adults from the Human Connectome Project (HCP), we show that network features predicting internalizing and externalizing behavior are, at least in part, dissociable in children, but not in adults. In ABCD children, traits within internalizing and externalizing behavioral categories are predicted by more similar network features concatenated across task and resting states than those between different categories. We did not observe this pattern in HCP adults. Distinct network features predict internalizing and externalizing behaviors in ABCD children and HCP adults. These data reveal shared and unique brain network features accounting for individual variation within broad internalizing and externalizing categories across developmental stages.

neuroscience↗

bioRxiv2023

Multimodal neural correlates of childhood psychopathology

AO_SCPLOWBSTRACTC_SCPLOWComplex structural and functional changes occurring in typical and atypical development necessitate multidimensional approaches to better understand the risk of developing psychopathology. Here, we simultaneously examined structural and functional brain network patterns in relation to dimensions of psychopathology in the Adolescent Brain Cognitive Development dataset. Several components were identified, recapitulating the psychopathology hierarchy, with the general psychopathology (p) factor explaining most covariance with multimodal imaging features, while the internalizing, externalizing, and neurodevelopmental dimensions were each associated with distinct morphological and functional connectivity signatures. Connectivity signatures associated with the p factor and neurodevelopmental dimensions followed the sensory-to-transmodal axis of cortical organization, which is related to the emergence of complex cognition and risk for psychopathology. Results were consistent in two separate data subsamples, supporting generalizability, and robust to variations in analytical parameters. Our findings help in better understanding biological mechanisms underpinning dimensions of psychopathology, and could provide brain-based vulnerability markers.

neuroscience↗

bioRxiv2022

Brain-based predictions of psychiatric illness-linked behaviors across the sexes

BackgroundIndividual differences in functional brain connectivity can be used to predict both the presence of psychiatric illness and variability in associated behaviors. However, despite evidence for sex differences in functional network connectivity and in the prevalence, presentation, and trajectory of psychiatric illnesses, the extent to which disorder-relevant aspects of network connectivity are shared or unique across the sexes remains to be determined. MethodsIn this work, we used predictive modelling approaches to evaluate whether shared or unique functional connectivity correlates underlie the expression of psychiatric illness-linked behaviors in males and females in data from the Adolescent Brain Cognitive Development study (n=5260; 2571 females). ResultsWe demonstrate that functional connectivity profiles predict individual differences in externalizing behaviors in males and females, but only predict internalizing behaviors in females. Furthermore, models trained to predict externalizing behaviors in males generalize to predict internalizing behaviors in females, and models trained to predict internalizing behaviors in females generalize to predict externalizing behaviors in males. Finally, the neurobiological correlates of many behaviors are largely shared within and across sexes: functional connections within and between heteromodal association networks including default, limbic, control, and dorsal attention networks are associated with internalizing and externalizing behaviors as well as attentional deficits. ConclusionsTaken together, these findings suggest that shared neurobiological patterns may manifest as distinct behaviors across the sexes. These results highlight the need to consider factors beyond just neurobiology in the diagnosis and treatment of psychiatric illnesses.

neuroscience↗

bioRxiv2022

Comparison Between Gradients and Parcellations for Functional Connectivity Prediction of Behavior

Resting-state functional connectivity (RSFC) is widely used to predict behavioral measures. To predict behavioral measures, representing RSFC with parcellations and gradients are the two most popular approaches. Here, we compare parcellation and gradient approaches for RSFC-based prediction of a broad range of behavioral measures in the Human Connectome Project (HCP) and Adolescent Brain Cognitive Development (ABCD) datasets. Among the parcellation approaches, we consider group-average "hard" parcellations (Schaefer et al., 2018), individual-specific "hard" parcellations (Kong et al., 2021a), and an individual-specific "soft" parcellation (spatial independent component analysis with dual regression; Beckmann et al., 2009). For gradient approaches, we consider the well-known principal gradients (Margulies et al., 2016) and the local gradient approach that detects local RSFC changes (Laumann et al., 2015). Across two regression algorithms, individual-specific hard-parcellation performs the best in the HCP dataset, while the principal gradients, spatial independent component analysis and group-average "hard" parcellations exhibit similar performance. On the other hand, principal gradients and all parcellation approaches perform similarly in the ABCD dataset. Across both datasets, local gradients perform the worst. Finally, we find that the principal gradient approach requires at least 40 to 60 gradients to perform as well as parcellation approaches. While most principal gradient studies utilize a single gradient, our results suggest that incorporating higher order gradients can provide significant behaviorally relevant information. Future work will consider the inclusion of additional parcellation and gradient approaches for comparison.

neuroscience↗

bioRxiv2022

There is no fundamental trade-off between prediction accuracy and feature importance reliability

There is significant interest in using neuroimaging data to predict behavior. The predictive models are often interpreted by the computation of feature importance, which quantifies the predictive relevance of an imaging feature. Tian and Zalesky (2021) suggest that feature importance estimates exhibit low split-half reliability, as well as a trade-off between prediction accuracy and feature importance reliability across parcellation resolutions. However, it is unclear whether the trade-off between prediction accuracy and feature importance reliability is universal. Here, we demonstrate that, with a sufficient sample size, feature importance (operationalized as Haufe-transformed weights) can achieve fair to excellent split-half reliability. With a sample size of 2600 participants, Haufe-transformed weights achieve average intra-class correlation coefficients of 0.75, 0.57 and 0.53 for cognitive, personality and mental health measures respectively. Haufe-transformed weights are much more reliable than original regression weights and univariate FC-behavior correlations. Original regression weights are not reliable even with 2600 participants. Intriguingly, feature importance reliability is strongly positively correlated with prediction accuracy across phenotypes. Within a particular behavioral domain, there is no clear relationship between prediction performance and feature importance reliability across regression models. Furthermore, we show mathematically that feature importance reliability is necessary, but not sufficient, for low feature importance error. In the case of linear models, lower feature importance error is mathematically related to lower prediction error. Therefore, higher feature importance reliability might yield lower feature importance error and higher prediction accuracy. Finally, we discuss how our theoretical results relate with the reliability of imaging features and behavioral measures. Overall, the current study provides empirical and theoretical insights into the relationship between prediction accuracy and feature importance reliability.

neuroscience↗

bioRxiv2022

Proportional intracranial volume correction differentially biases behavioral predictions across neuroanatomical features and populations

Individual differences in brain anatomy can be used to predict variability in cognitive function. Most studies to date have focused on broad population-level trends, but the extent to which the observed predictive features are shared across sexes and age groups remains to be established. While it is standard practice to account for intracranial volume (ICV) using proportion correction in both regional and whole-brain morphometric analyses, in the context of brain-behavior predictions the possible differential impact of ICV correction on anatomical features and subgroups within the population has yet to be systematically investigated. In this work, we evaluate the effect of proportional ICV correction on sex-independent and sex-specific predictive models of individual cognitive abilities across multiple anatomical properties (surface area, gray matter volume, and cortical thickness) in healthy young adults (Human Connectome Project; n=1013, 548 females) and typically developing children (Adolescent Brain Cognitive Development study; n=1823, 979 females). We demonstrate that ICV correction generally reduces predictive accuracies derived from surface area and gray matter volume, while increasing predictive accuracies based on cortical thickness in both adults and children. Furthermore, the extent to which predictive models generalize across sexes and age groups depends on ICV correction: models based on surface area and gray matter volume are more generalizable without ICV correction, while models based on cortical thickness are more generalizable with ICV correction. Finally, the observed neuroanatomical features predictive of cognitive abilities are unique across age groups regardless of ICV correction, but whether they are shared or unique across sexes (within age groups) depends on ICV correction. These findings highlight the importance of considering individual differences in ICV, and show that proportional ICV correction does not remove the effects of cranium volumes from anatomical measurements and can introduce ICV bias where previously there was none. ICV correction choices affect not just the strength of the relationships captured, but also the conclusions drawn regarding the neuroanatomical features that underlie those relationships.

neuroscience↗

bioRxiv2022

Comparison of individualized behavioral predictions across anatomical, diffusion and functional connectivity MRI

A fundamental goal across the neurosciences is the characterization of relationships linking brain anatomy, functioning, and behavior. Although various MRI modalities have been developed to probe these relationships, direct comparisons of their ability to predict behavior have been lacking. Here, we compared the ability of anatomical T1, diffusion and functional MRI (fMRI) to predict behavior at an individual level. Cortical thickness, area and volume were extracted from anatomical T1 images. Diffusion Tensor Imaging (DTI) and approximate Neurite Orientation Dispersion and Density Imaging (NODDI) models were fitted to the diffusion images. The resulting metrics were projected to the Tract-Based Spatial Statistics (TBSS) skeleton. We also ran probabilistic tractography for the diffusion images, from which we extracted the stream count, average stream length, and the average of each DTI and NODDI metric across tracts connecting each pair of brain regions. Functional connectivity (FC) was extracted from both task and resting-state fMRI. Individualized prediction of a wide range of behavioral measures were performed using kernel ridge regression, linear ridge regression and elastic net regression. Consistency of the results were investigated with the Human Connectome Project (HCP) and Adolescent Brain Cognitive Development (ABCD) datasets. In both datasets, FC-based models gave the best prediction performance, regardless of regression model or behavioral measure. This was especially true for the cognitive domain. Furthermore, all modalities were able to predict cognition better than other behavioral domains. Combining all modalities improved prediction of cognition, but not other behavioral domains. Finally, across all behaviors, combining resting and task FC yielded prediction performance similar to combining all modalities. Overall, our study suggests that in the case of healthy children and young adults, behaviorally-relevant information in T1 and diffusion features might reflect a subset of the variance captured by FC. HighlightsO_LIFC predicts behavior better than anatomical and diffusion features C_LIO_LICognition is predicted better than other behavioral domains regardless of modality C_LIO_LICombining resting & task FC improves prediction as much as combining all modalities C_LIO_LIFindings were replicated over 3 regression models and 2 datasets C_LI

neuroscience↗

bioRxiv2020

Shared and unique brain network features predict cognition, personality and mental health in childhood

The manner through which individual differences in brain network organization track population-level behavioral variability is a fundamental question in systems neuroscience. Recent work suggests that resting-state and task-state functional connectivity can predict specific traits at the individual level. However, the focus of most studies on single behavioral traits has come at the expense of capturing broader relationships across behaviors. Here, we utilized a large-scale dataset of 1858 typically developing children to estimate whole-brain functional network organization that is predictive of individual differences in cognition, impulsivity-related personality, and mental health during rest and task states. Predictive network features were distinct across the broad behavioral domains: cognition, personality and mental health. On the other hand, traits within each behavioral domain were predicted by highly similar network features. This is surprising given decades of research emphasizing that distinct brain networks support different mental processes. Although tasks are known to modulate the functional connectome, we found that predictive network features were similar between resting and task states. Overall, our findings reveal shared brain network features that account for individual variation within broad domains of behavior in childhood, yet are unique to different behavioral domains.

neuroscience↗