Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2021.02.19.431951

Countering reproducibility issues in mathematical models with software engineering techniques: A case study using a one-dimensional mathematical model of the atrioventricular node

Schölzel, C.·Blesius, V.·Ernst, G.·Goesmann, A.·Dominik, A.
View original source ↗Export metadata ↓

Abstract

One should assume that in silico experiments in systems biology are less susceptible to reproducibility issues than their wet-lab counterparts, because they are free from natural biological variations and their environment can be fully controlled. However, recent studies show that only half of the published mathematical models of biological systems can be reproduced without substantial effort. In this article we examine the potential causes for failed or cumbersome reproductions in a case study of a one-dimensional mathematical model of the atrioventricular node, which took us four months to reproduce. The model demonstrates that even otherwise rigorous studies can be hard to reproduce due to missing information, errors in equations and parameters, a lack in available data files, non-executable code, missing or incomplete experiment protocols, and missing rationales behind equations. Many of these issues seem similar to problems that have been solved in software engineering using techniques such as unit testing, regression tests, continuous integration, version control, archival services, and a thorough modular design with extensive documentation. Applying these techniques, we reimplement the examined model using the modeling language Modelica. The resulting workflow is independent of the model and can be translated to SBML, CellML, and other languages. It guarantees methods reproducibility by executing automated tests in a virtual machine on a server that is physically separated from the development environment. Additionally, it facilitates results reproducibility, because the model is more understandable and because the complete model code, experiment protocols, and simulation data are published and can be accessed in the exact version that was used in this article. We found the additional design and documentation effort well justified, even just considering the immediate benefits during development such as easier and faster debugging, increased understandability of equations, and a reduced requirement for looking up details from the literature. Author summaryReproducibility is one of the cornerstones of the scientific method. In order to draw reliable conclusions, an experiment must yield the same results when it is repeated using the same methods. However, biological systems are complex, which makes experiments cumbersome. It is therefore desirable to build a mathematical representation of the biological system, which captures its essential behavior in a set of variables and equations and allows for easier and faster experimentation. Unfortunately, recent studies have shown that half of the published mathematical models are not immediately reproducible due to missing information, mathematical errors, and incomplete documentation. These issues are similar to those faced in software engineering: A single missing file or a buggy line of code can render any kind of software useless. Software engineering has turned to rigorous software testing, automated development pipelines, and version control systems to overcome these challenges, but these techniques are not yet widely applied to mathematical modeling. In this paper we demonstrate their benefit for the reproducibility of a large mathematical model of the atrioventricular node. The software engineering solutions that we employ can be applied to any mathematical model and could therefore facilitate scientific progress by encouraging and simplifying model reuse.

Source connections

Explore related subjects

systems biologyPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Schölzel, C., Blesius, V., Ernst, G., Goesmann, A., Dominik, A.. 2021-02-19. Countering reproducibility issues in mathematical models with software engineering techniques: A case study using a one-dimensional mathematical model of the atrioventricular node. https://doi.org/10.1101/2021.02.19.431951

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

INFORME: coupling information-theoretic experimental design with nonlinear mixed-effects modeling for efficient observation scheduling

Mathematical models of treatment response can inform individualized therapy, but their calibration often requires longitudinal measurements that are costly, burdensome, and collected on fixed schedules. Such schedules may be inefficient, over-sampling patients whose response is already well characterized while delaying informative measurements for those whose model parameters remain uncertain. We present INFORME (INFORmation-theoretic design with Mixed Effects), a framework that combines Bayesian information-theoretic experimental design with nonlinear mixed-effects modeling to adaptively select each patients next measurement time. Population and response-subgroup parameter distributions learned from an existing cohort provide informative priors, allowing candidate measurement times to be ranked by their expected reduction in patient-specific parameter uncertainty. As observations accumulate, priors can be updated to reflect the response subgroup most consistent with the patients data. We evaluate INFORME in two radiotherapy datasets: 150 synthetic tumor volume trajectories from a hybrid cellular automaton model of prostate cancer spheroids (HD1) and longitudinal tumor volumes from 39 patients with head-and-neck cancer (HD2). In HD1, population priors allowed omission of both pretreatment scans, while adaptive scheduling reduced the protocol from nine scans to three or four, with the response group identified from a single post-treatment scan on day 27. In HD2, the adaptive schedule used three scans instead of six and improved prediction by delaying the first on-treatment scan from week 1 to week 2, avoiding transient dynamics that produced false-positive and false-negative response projections. Across both datasets, the adaptive schedules used a mean of 2.7 scans in stead of seven and advanced completion of the patient-specific prediction by a mean of 15.5 days (95% CI, 6.7-24.3) relative to the equidistant protocol, while treatment duration remained unchanged. INFORME therefore reduces measurement burden and accelerates patient-specific prediction by concentrating observations at times that are most informative for model calibration.

systems biology↗
bioRxiv2026

Sobetirome, a thyroid hormone receptor beta agonist, is a potential therapeutic agent for pulmonary fibrosis

Idiopathic pulmonary fibrosis (IPF) is a progressive and fatal disease with limited treatment options. Our group previously identified the antifibrotic potential of thyroid hormone, triiodothyronine (T3); however, clinical translation of thyroid hormone therapy is limited by its systemic adverse effects. In this study, we investigate whether sobetirome, a selective and well tolerated thyroid hormone receptor beta (THRB) agonist, offers antifibrotic benefits of thyroid hormone while minimizing systemic toxicity. Our study reveals that sobetirome, administered via intraperitoneal or inhalational routes, effectively mitigates bleomycin-induced pulmonary fibrosis in mice, with no evidence of toxicity. We identified that sobetirome restores mitochondrial homeostasis via activating the THRB-PPARGC1a axis. This protects alveolar type II epithelial cells from injury-induced apoptosis while selectively inducing apoptosis and metabolic reprogramming in apoptosis resistant IPF fibroblasts. Cell-specific deletion of Ppargc1a in either alveolar epithelial cells or fibroblasts abolishes sobetirome-mediated protection, establishing PPARGC1a as an essential mediator of therapeutic response. Importantly, sobetirome reverses fibrosis-associated transcriptional programs in human IPF lung tissue, reducing expression of key fibrosis-associated genes, including collagen I alpha 1 (COL1A1), collagen III alpha 1 (COL3A1), periostin (POSTN), cathepsin K (CTSK), and Chitinase 3 Like 1 (CHI3L1), while promoting extracellular matrix remodeling, epithelial restoration, and tissue homeostasis. Collectively, our findings identify THRB activation as a novel metabolic strategy for reversing pulmonary fibrosis. Across complementary in vitro, in vivo, and human ex vivo models, sobetirome restores mitochondrial function, modulates apoptotic pathways in pathogenic cells, and promotes fibrosis resolution, highlighting its potential as a lung-targeted therapeutic approach for IPF and other fibrotic lung diseases.

systems biology↗
bioRxiv2026

Mechanistic modeling of bacterial translation initiation across growth conditions

Translation frequency in bacteria depends on how ribosomes, mRNAs, and initiation factors are allocated across growth conditions. Here, we developed a mechanistic ODE-based model of Escherichia coli translation that represents initiation, elongation, termination, and coupled auxiliary processes. Growth-dependent abundances were derived from physiological relationships and reprocessed omics data, and simulated outputs were compared with translation-frequency and active-ribosome references. The model predicts a continuous shift from complex-formation-limited toward ribosome-limited behavior as growth increases. This shift is characterized by a decline in free-ribosome abundance, whereas initiation-factor pools remain largely unbound and do not become depleted in parallel. Together with the implemented IF-dependent kinetic term, this preserved availability provides a model-internal route through which productive initiation can be maintained despite increasing ribosome utilization. Consistently, transcript-wide ribosome loading remains below its theoretical maximum, while COG-level simulations reveal distinct sector-specific translation-frequency trajectories. The study therefore provides a resource-allocation framework for interpreting how mRNA--ribosome interactions shape bacterial translation across growth conditions.

systems biology↗