Search bioRxiv⌕ Search

bioRxiv · 10.1101/2023.12.16.572011

Open Soil Spectral Library (OSSL): Building reproducible soil calibration models through open development and community engagement

Abstract

Soil spectroscopy is a widely used method for estimating soil properties that are important to environmental and agricultural monitoring. However, a bottleneck to its more widespread adoption is the need for establishing large reference datasets for training machine learning (ML) models, which are called soil spectral libraries (SSLs). Similarly, the prediction capacity of new samples is also subject to the number and diversity of soil types and conditions represented in the SSLs. To help bridge this gap and enable hundreds of stakeholders to collect more affordable soil data by leveraging a centralized open resource, the Soil Spectroscopy for Global Good has created the Open Soil Spectral Library (OSSL). In this paper, we describe the procedures for collecting and harmonizing several SSLs that are incorporated into the OSSL, followed by exploratory analysis and predictive modeling. The results of 10-fold cross-validation with refitting show that, in general, mid-infrared (MIR)-based models are significantly more accurate than visible and near-infrared (VisNIR) or near-infrared (NIR) models. From independent model evaluation, we found that Cubist comes out as the best-performing ML algorithm for the calibration and delivery of reliable outputs (prediction uncertainty and representation flag). Although many soil properties are well predicted, total sulfur, extractable sodium, and electrical conductivity performed poorly in all spectral regions, with some other extractable nutrients and physical soil properties also performing poorly in one or two spectral regions (VisNIR or Neospectra NIR). Hence, the use of predictive models based solely on spectral variations has limitations. This study also presents and discusses several other open resources that were developed from the OSSL, aspects of opening data, current limitations, and future development. With this genuinely open science project, we hope that OSSL becomes the driver of the soil spectroscopy community to accelerate the pace of scientific discovery and innovation.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Safanelli, J. L., Hengl, T., Parente, L. L., Minarik, R., Bloom, D. E., Todd-Brown, K., Gholizadeh, A., Mendes, W. d. S., Sanderman, J.. 2023-12-17. Open Soil Spectral Library (OSSL): Building reproducible soil calibration models through open development and community engagement. https://doi.org/10.1101/2023.12.16.572011

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

From Screening to Differential Diagnosis: Benchmarking 3D Facial Representations Across Craniofacial Conditions

Rare genetic disorders often present with highly heterogeneous physical features: some have distinctive craniofacial characteristics, whereas others produce subtler or more variable facial differences, making phenotype-based diagnosis challenging. Three-dimensional (3D) facial scanning is a noninvasive approach that captures facial shape and surface geometry, providing quantitative information on craniofacial morphology beyond conventional 2D photographs. Here, we investigated how well 3D facial representations support clinical tasks ranging from broad screening to fine-grained differential diagnosis without landmark registration, dense correspondence, or template fitting. We benchmarked four 3D models, including PointNet, PointNet++, DGCNN, and a geometric baseline, using 26,990 facial scans from 18,785 subjects across four prediction tasks. Across models, performance declined as greater diagnostic specificity was required. Broad affected-versus-unaffected screening achieved high performance (accuracy 0.893; AUC 0.956), although sensitivity analyses revealed substantial influences of cohort composition and demographic differences. Fine-grained syndrome diagnosis remained more challenging, with limited top-1 accuracy despite meaningful class-wise discrimination. Combining repeated scans improved patient-level diagnosis beyond differences in patient weighting. Prototype inference further improved diagnostic prioritization, placing the correct syndrome among the top five candidates for about 65\% of held-out patients across 49 diagnoses. Patient-to-patient retrieval identified phenotypically similar confirmed cases, while useful syndrome prototypes could be constructed from relatively few reference patients. Anatomical region-occlusion analysis revealed syndrome-dependent patterns of facial importance broadly consistent with clinically recognized craniofacial features, although overlapping facial phenotypes contributed to diagnostic confusion. Overall, these findings support the potential of 3D facial representations for diagnostic candidate prioritization and retrieval, while emphasizing the influence of cohort composition on screening performance and the challenges of distinguishing phenotypically similar genetic syndromes.

bioinformatics↗

Algorithms for Designing Therapeutic Oligonucleotides on Pangenome Graphs

Designing therapeutic oligonucleotides that act reliably across human genetic diversity requires more than alignment to a single reference genome. Binding affinity of an siRNA or ASO to a usually complementary site in an mRNA target molecule is one main determinant of drug efficacy. Thus, variation in sub-populations can lead to failures in drug development if this variation reduces binding affinity. We provide a first methodological step towards principled, variant-aware design of therapeutic oligonucleotides. The genetic diversity in target genes, or specific regions thereof, is represented as a pangenome graph. We define individual or small sets of suitable therapeutic oligonucleotides by their ability to cover all paths in a directed acyclic graph within a bounded edit distance <= k. Edit distance is used as an accepted proxy to the commonly used binding affinity. We formalize the resulting computational problem and provide complexity results: NP-hardness of identifying such minimal sets even for k =0, and coNP-completeness of verifying the validity of a given set of oligonucleotides. Further, we propose algorithmic approaches operating on a product graph of an automaton (an Aho-Corasick DFA or an Ukkonen DFA) and the pangenome graph, as well as a dynamic programming-based lossless filter. We evaluate the approaches on gene-specific subgraphs of human pangenome graphs and demonstrate favorable performance compared to naive brute-force computation. Our results show that candidate target sites with a threshold of k <= 3 can be identified even for large, complex graphs where the brute-force computation did not complete within 24h. We observe that the dynamic programming-based lossless filter outperforms both product-graph approaches as well as brute-force baselines while maintaining an average approximation ratio < 1.5 across more than a hundred evaluated subgraphs. We also present examples where a small set of oligonucleotides constitutes a feasible solution where no single oligonucleotide with a threshold of k <= 2 covers all paths.

bioinformatics↗

Evolutionarily Conserved Fragments reveal modular architecture and expand functional coverage in bacteriophage proteins

Bacteriophage proteins evolve through extensive modular exchange, yet the sequence units underlying this process remain poorly defined. Classical domains are plausible evolutionary modules, but they incompletely annotate phage proteins and may not always coincide with the regions conserved across protein families. Here, we constructed 13,035 Evolutionarily Conserved Fragments (ECFs), grouped into 3,167 families, through large-scale HMM-HMM comparisons of proteins from 5,396 RefSeq phage genomes, without imposing predefined domain boundaries. ECFs overlapped substantially with ECOD and Pfam annotations but formed a heterogeneous spectrum comprising subdomains, domain-equivalent units, composite regions and fragments with no counterpart in either resource. Their relationships were frequently nested, indicating that conserved modules occur at multiple organisational scales. ECFs annotated 50% of phage representative proteins (at least doubling the coverage of either database), with the largest gains in structural and infection-related functions, a pattern replicated in independent metagenomic data. ECF families also showed function-dependent patterns of diversity and spatial segregation and provided functional associations for 23,925 protein families lacking detectable Pfam or ECOD domains. In receptor-binding proteins, ECFs subdivided established domains, delineated previously unannotated structural elements and recovered homologous regions where structural similarity was ambiguous. These results show that the evolutionary building blocks of phage proteins do not always coincide with classical domains, highlighting that evolutionary processes act across multiple scales. ECFs provide a complementary, sequence-derived framework for investigating how complex viral proteins are assembled, diversified and functionally organised.

bioinformatics↗