Search bioRxiv⌕ Search

Biology subjects

Babbi, G.

Publications and source records attributed to Babbi, G..

5 recordsLinked to original sources

On the state of protein function prediction: a report on the fourth CAFA challenge

BackgroundThe Critical Assessment of Functional Annotation (CAFA) is a community effort held to understand the field of computational protein function prediction. Every three years, since 2010, the organizers initiate an experiment to collect function predictions on a large set of proteins and then evaluate the performance of predicting methods on a subset of proteins that have accumulated experimental annotations between the submission deadline and the evaluation time. CAFA provides an independent and rigorous assessment of the current state of the art, thus leveling the playing field, highlighting successes, revealing bottlenecks, and offering a forum for the exchange of ideas in protein science. Here, we report the results of the fourth CAFA experiment (CAFA4). ResultsCAFA4 featured the participation of 148 methods from 70 research groups on a total of 46,205 unique proteins over a 5-year annotation accumulation phase, the longest in any CAFA. In a comparison across CAFA2-CAFA4 methods, the prediction of Gene Ontology (GO) terms has clearly improved across all three GO aspects and traditional evaluation settings. While not achieving the first rank, several CAFA2 and CAFA3 methods featured in the top ten methods in many evaluations, suggesting that earlier methods still hold relevance. The performance is weaker in the newly introduced "partial knowledge" evaluation category (proteins with experimental annotations before submission deadline that gained additional annotations in the same GO aspect during the annotation accumulation phase), highlighting the need for a new class of methods. The rankings of the methods were stable over the years in traditional evaluation settings, but less so in the new partial knowledge evaluation. Overall, the field continues to progress with some influx of new participants. Sustained efforts will be necessary to substantially advance it.

bioinformatics↗

Acinetobacter enrichment shapes composition and function of the bacterial microbiota of field-grown tomato plants

Tomato is a staple crop and an excellent model to study host-microbiota interactions in the plant food chain. In this study we describe a lab-in-the-field approach to investigate the microbiota of field-grown tomato plants. High-throughput amplicon sequencing revealed a three-microhabitat partition, phyllosphere, rhizosphere and root interior, differentiating host-associated communities from the environmental microbiota. An individual bacterium, classified as Acinetobacter sp., emerged as a dominant member of the microbiota at the plant-soil continuum. To gain insights into the functional significance of this enrichment, we subjected rhizosphere specimens to shotgun metagenomics. Similar to the amplicon sequencing survey, a microhabitat effect defined by a set of rhizosphere-enriched functions was identified. Mobilisation of mineral nutrients, as well as adaptation to salinity and polymicrobial communities, including antimicrobial resistance genes (ARGs), emerged as a functional requirement sustaining metagenomic diversification. A metagenome-assembled genome (MAG) representative of Acinetobacter calcoaceticus was retrieved and metagenomic reads associated to this species identified a functional specialisation for plant-growth promotion traits (PGPTs), such as phosphate solubilization, siderophores production and reactive oxygen species detoxification, which were similarly represented in across tomato genotype-independent fashion. Our results revealed that the enrichment of a beneficial bacterium capable of alleviating plants abiotic stresses appears decoupled from ARGs facilitating microbiota persistence at the root-soil interface. IMPORTANCETomatoes are at centre-stage in global food security due to their high nutritional value, widespread cultivation, and versatility. Tomatoes provide essential vitamins and minerals, contribute to diverse diets, and support farmer livelihoods, making them a cornerstone of sustainable food systems. Beyond direct dietary benefits, the intricate relationship between tomatoes, their associated microbiota, and ARG is increasingly recognised. Tomato plants host diverse microbial communities in association with their organs, which influence plant health and productivity. Crop management impacts on composition and function of these communities, contributing to the prevalence of ARG in the soil and on the plants themselves. These genes can potentially transfer to human pathogens, posing a food safety and public health risk. Understanding these complex interactions is critical for developing sustainable agricultural practices capable of mitigating the impact of climatic modifications and the global threat of antimicrobial resistance.

plant biology↗

Critical assessment of missense variant effect predictors on disease-relevant variant data

Regular, systematic, and independent assessment of computational tools used to predict the pathogenicity of missense variants is necessary to evaluate their clinical and research utility and suggest directions for future improvement. Here, as part of the sixth edition of the Critical Assessment of Genome Interpretation (CAGI) challenge, we assess missense variant effect predictors (or variant impact predictors) on an evaluation dataset of rare missense variants from disease-relevant databases. Our assessment evaluates predictors submitted to the CAGI6 Annotate-All-Missense challenge, predictors commonly used by the clinical genetics community, and recently developed deep learning methods for variant effect prediction. To explore a variety of settings that are relevant for different clinical and research applications, we assess performance within different subsets of the evaluation data and within high-specificity and high-sensitivity regimes. We find strong performance of many predictors across multiple settings. Meta-predictors tend to outperform their constituent individual predictors; however, several individual predictors have performance similar to that of commonly used meta-predictors. The relative performance of predictors differs in high-specificity and high-sensitivity regimes, suggesting that different methods may be best suited to different use cases. We also characterize two potential sources of bias. Predictors that incorporate allele frequency as a predictive feature tend to have reduced performance when distinguishing pathogenic variants from very rare benign variants, and predictors supervised on pathogenicity labels from curated variant databases often learn label imbalances within genes. Overall, we find notable advances over the oldest and most cited missense variant effect predictors and continued improvements among the most recently developed tools, and the CAGI Annotate-All-Missense challenge (also termed the Missense Marathon) will continue to assess state-of-the-art methods as the field progresses. Together, our results help illuminate the current clinical and research utility of missense variant effect predictors and identify potential areas for future development.

genetics↗

Evaluation of enzyme activity predictions for variants of unknown significance in Arylsulfatase A

Continued advances in variant effect prediction are necessary to demonstrate the ability of machine learning methods to accurately determine the clinical impact of variants of unknown significance (VUS). Towards this goal, the ARSA Critical Assessment of Genome Interpretation (CAGI) challenge was designed to characterize progress by utilizing 219 experimentally assayed missense VUS in the Arylsulfa-tase A (ARSA) gene to assess the performance of community-submitted predictions of variant functional effects. The challenge involved 15 teams, and evaluated additional predictions from established and recently released models. Notably, a model developed by participants of a genetics and coding bootcamp, trained with standard machine-learning tools in Python, demonstrated superior performance among sub-missions. Furthermore, the study observed that state-of-the-art deep learning methods provided small but statistically significant improvement in predictive performance compared to less elaborate techniques. These findings underscore the utility of variant effect prediction, and the potential for models trained with modest resources to accurately classify VUS in genetic and clinical research.

genetics↗

Mouse Genomic Associations with Ex Vivo Sensitivity to Simulated Space Radiation

Exposure to ionizing radiation is considered by NASA to be a major health hazard for deep space exploration missions. Ionizing radiation sensitivity is modulated by both genomic and environmental factors. Understanding their contributions is crucial for designing experiments in model organisms, evaluating the risk of deep space (i.e. high-linear energy transfer, or LET, particle) radiation exposure in astronauts, and also selecting therapeutic irradiation regimes for cancer patients. We identified single nucleotide polymorphisms in 15 strains of mice, including 10 collaborative cross model strains and 5 founder strains, associated with spontaneous and ionizing radiation-induced ex vivo DNA damage quantified based on immunofluorescent 53BP1+ nuclear foci. Statistical analysis suggested an association with pathways primarily related to cellular signaling, metabolism, tumorigenesis and nervous system damage. We observed different genomic associations in early (4 and 8 hour) responses to different LET radiation, while later (24 hour) DNA damage responses showed a stronger overlap across all LETs. Furthermore, a subset of pathways was associated with spontaneous DNA damage, suggesting 53BP1+ foci as a potential biomarker for DNA integrity in mouse models. Based on our results, we suggest several mouse strains as new models to further study the impact of ionizing radiation and validate the identified genetic loci. We also highlight the importance of future human ex vivo studies to refine the association of genes and pathways with the DNA damage response to ionizing radiation and identify targets for space travel countermeasures.

genomics↗