Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/321919

A large-scale analysis of bioinformatics code on GitHub

Russell, P. H.·Johnson, R. L.·Ananthan, S.·Harnke, B.·Carlson, N. E.
View original source ↗Export metadata ↓

Abstract

In recent years, the explosion of genomic data and bioinformatic tools has been accompanied by a growing conversation around reproducibility of results and usability of software. However, the actual state of the body of bioinformatics software remains largely unknown. The purpose of this paper is to investigate the state of source code in the bioinformatics community, specifically looking at relationships between code properties, development activity, developer communities, and software impact. To investigate these issues, we curated a list of 1,720 bioinformatics repositories on GitHub through their mention in peer-reviewed bioinformatics articles. Additionally, we included 23 high-profile repositories identified by their popularity in an online bioinformatics forum. We analyzed repository metadata, source code, development activity, and team dynamics using data made available publicly through the GitHub API, as well as article metadata. We found key relationships within our dataset, including: certain scientific topics are associated with more active code development and higher community interest in the repository; most of the code in the main dataset is written in dynamically typed languages, while most of the code in the high-profile set is statically typed; developer team size is associated with community engagement and high-profile repositories have larger teams; the proportion of female contributors decreases for high-profile repositories and with seniority level in author lists; and, multiple measures of project impact are associated with the simple variable of whether the code was modified at all after paper publication. In addition to providing the first large-scale analysis of bioinformatics code to our knowledge, our work will enable future analysis through publicly available data, code, and methods. Code to generate the dataset and reproduce the analysis is provided under the MIT license at https://github.com/pamelarussell/githubbioinformatics. Data are available at https://doi.org/10.17605/OSF.IO/UWHX8.\n\nAuthor summaryWe present, to our knowledge, the first large-scale analysis of bioinformatics source code. The purpose of our work is to contribute data to the growing conversation in the bioinformatics community around reproducibility, code quality, and software usability. We analyze a large collection of bioinformatics software projects, identifying relationships between code properties, development activity, developer communities, and software impact. Throughout the work, we compare the large set of projects to a small set of highly popular bioinformatics tools, highlighting features associated with high-profile projects. We make our data and code publicly available to enable others to build upon our analysis or generate new datasets. The significance of our work is to (1) contribute a large base of knowledge to the bioinformatics community about the state of their software, (2) contribute tools and resources enabling the community to conduct their own analyses, and (3) demonstrate that it is possible to systematically analyze large volumes of bioinformatics code. This work and the provided resources will enable a more effective, data-driven conversation around software practices in the bioinformatics community.

Source connections

Explore related subjects

bioinformaticsPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Russell, P. H., Johnson, R. L., Ananthan, S., Harnke, B., Carlson, N. E.. 2018-05-14. A large-scale analysis of bioinformatics code on GitHub. https://doi.org/10.1101/321919

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

The Almond Expression Atlas: A comprehensive multi-tissue transcriptomic resource for almond gene expression

Background: Improving crop adaptation and enhancing agronomic and quality traits requires a deeper understanding of gene expression regulation, for which expression atlases are valuable tools. Almond (Prunus dulcis (Mill.) D.A. Webb) is one of the most economically important tree nut crops worldwide. However, an integrated transcriptomic resource for this species is still lacking. Available data remain fragmented across independent studies, limiting their comparability and reuse. Results: Here, we present the first almond gene expression atlas: a comprehensive multi-tissue transcriptomic resource integrating publicly available RNA sequencing data. A total of 142 high-quality untreated and control samples from 17 independent projects were curated through a metadata standardization process and analyzed using a unified bioinformatics pipeline. Standardized expression profiles were generated for 25,225 annotated genes in the Prunus dulcis Texas v2.0 reference genome. The atlas integrates two complementary expression approaches: a median TPM approach capturing quantitative expression levels and a rank-based strategy implemented using the Bgee expression calling method, designed to improve comparability across heterogeneous datasets. This design enables the identification of tissue-specific candidate genes and the exploration of expression patterns across tissues and developmental stages. Its applicability is demonstrated through two use cases, highlighting its ability to identify biologically meaningful gene sets associated with bud dormancy transitions and to prioritize candidate reference genes for RT-qPCR normalization in almond. Conclusions: The Almond Expression Atlas v1.0 is publicly available through FruitDBase (fruitdbase.csic.es), providing an interactive platform for gene expression exploration and visualization. This resource supports functional genomics studies and facilitates candidate gene discovery in almond, while ensuring data traceability and promoting data reusability.

bioinformatics↗
bioRxiv2026

Leakage-Controlled Benchmarking of Variant Effect Predictors and Development of Gradient-Boosting Consensus Model

Single amino acid mutations are among the most common forms of genetic variation, with effects ranging from negligible to severe disruption of protein function. Accurate quantitative evaluation of protein variants therefore represents a key challenge in medicine and protein engineering. Computational variant effect predictors (VEPs) are widely used to prioritize missense variants, yet their fair comparison is hindered by data circularity, benchmarks restricted to human clinical annotations, and limited availability of code and training data, all of which can inflate apparent performance. Here, we reviewed 18 recent and 3 older, widely adopted variant effect predictors for reproducible benchmarking and assembled a rigorously curated, leakage-controlled Benchmark dataset by integrating clinically annotated human variants from ClinVar and Humsavar as well as cross-species variants with functional annotations. The evaluation on this dataset revealed a narrow overall performance range for the benchmarked tools (AUC 0.631-0.758) and a consistent drop from clinical to functional data. Surprisingly, several tools published two decades ago demonstrated comparable performance to mid-ranked modern predictors. Building on these results, we developed a gradient-boosting consensus model, PredictSNPprot, which achieved an AUC of 0.82 on a held-out test set, outperforming the original PredictSNP meta-predictor and the best individual state-of-the-art tool by 13.6 and 5.7 percentage points, respectively. The Benchmark dataset, including the predictions from the evaluated tools, is available at https://doi.org/10.5281/zenodo.23597130 and PredictSNPprot consensus predictor is available at https://github.com/loschmidt/PredictSNPprot.

bioinformatics↗
bioRxiv2026

MaCADEMIA: a software toolbox for single-molecule fluorescence image quantification

Single-molecule localisation microscopy (SMLM) is a powerful tool in molecular and cellular biology and part of the broad umbrella of super-resolution microscopy. A distinct feature of SMLM, is its capacity for deep quantification, beyond just spatial information, to copy number, stoichiometry, molecular interaction and dynamics in living cells. The hardware required is increasingly straightforward to implement. However, complexity remains in the image analysis where much remains fragmented across specialised software tools. Here, we present MaCADEMIA (Matlab Computational Analysis of Diffusion, Emitter Molecular Intensity and Abundance), a simple yet powerful toolbox of MATLAB functions and associated documentation to enable straightforward extraction of quantitative single-molecule information. MaCADEMIA performs ensemble particle detection achieving localisation accuracies down to 0.5 pixels Root mean squared error (RMSE) across wide signal-to-noise (SNR) ranges on standardised particle tracking benchmarks, consistently matching or exceeding the performance of 14 leading methods. Our integrated workflow enables molecular counting and stoichiometry determination through stepwise photobleaching analysis, mobility measurement via mean squared displacement, colocalisaton analysis and absolute protein copy number quantification using three-dimensional cellular models.

bioinformatics↗