Search bioRxiv⌕ Search

Biology subjects

Graves, S.

Publications and source records attributed to Graves, S..

7 recordsLinked to original sources

MillionTrees: A global benchmark for tree detection across geography, sensor, and annotation geometry

Airborne tree monitoring using remotely sensed data, combined with the growth of computer vision models for object detection and segmentation, can facilitate broad scale assessment of tree health, ecology and ecosystem function. However, datasets for airborne tree detection have been largely limited to a single geography, resolution, or annotation approach, making it difficult to develop general models and benchmark their utility for broad applications. We compile existing and newly published annotation datasets to create a comprehensive dataset for training and evaluating airborne tree detection in RGB imagery. The MillionTrees dataset has over a million individual trees from a broad range of forest types, tree species, and geographic locations. In addition, it has six million weakly supervised annotations from a range of sources including airborne LiDAR and photogrammetry, arborist surveys, and simulated landscapes. An evaluation standard is provided to facilitate rapid model development. We benchmark several existing tree detection algorithms and demonstrate that while current open-source models do not generalize across the diverse datasets in the benchmark, training on MillionTrees improves both within-domain and out-of-domain performance. Held-out validation datasets using ground truth derived from terrestrial LiDAR paired with overhead RGB show that overfitting to test data is common and hyperparameter tuning is an underappreciated challenge towards a global zero shot tree detection method. We discuss the limitations of the currently available data for airborne RGB tree detection, how to create more robust evaluation data and the need for better understanding of the uncertainty and utility of tree detection from airborne remote sensing.

ecology↗

Direct Counting of mRNA Copies Inside Individual Lipid Nanoparticles Using In Situ Lysis and Labeling

The optimization of mRNA-lipid nanoparticles (mRNA-LNPs) for therapeutic applications is limited in part by the inadequate characterization of mRNA payload heterogeneity. One current challenge is accurately measuring the number of mRNA copies within individual LNPs, where the standard method of intensity-based mRNA number determination is sensitive to fluorescent dye-dye interactions and heterogeneity of mRNA labeling. Here we present a single-particle microscopy method that combines direct counting of the mRNA copies per LNP with LNP size measurements. While confined in microwells, individual mRNA-LNPs are lysed to release their cargo and stained with a dye such that the number of mRNA molecules in each well can be directly counted using fluorescence microscopy. Since the method stains the mRNA cargo in situ, it enables characterization of LNPs formulated with therapeutic grade (e.g., unlabeled) mRNA. We applied this approach to two Onpattro(R)-based LNP formulations prepared using different formulation buffers, where the two formulations had different average mRNA copy number, particle size, and fraction of LNPs lacking mRNA. The ability to directly count the number of mRNA molecules in LNPs establishes a complimentary method to intensity-based mRNA number determination and supports the characterization and screening of clinically relevant LNP formulations.

biophysics↗

Comparative proteomics of biofilm development in Pseudoalteromonas tunicata discovers a distinct family of Ca2+-dependent adhesins

The marine bacterium, Pseudoalteromonas tunicata, is a useful model for studying mechanisms of biofilm development due to its ability to colonize and form biofilms on a variety of marine and eukaryotic host-associated surfaces. However, the pathways responsible for P. tunicata biofilm formation are still incompletely understood, in part due to a lack of functional information for a large proportion of its proteome. Here, we used comparative shotgun proteomics to examine P. tunicata biofilm development throughout the planktonic phase to three stages of biofilm development at 24, 48, and 72 h. Proteomic analysis identified 232 proteins that were up-regulated during different stages of biofilm development, including many hypothetical proteins as well as proteins known to be important for P. tunicata biofilm development such as the autocidal enzyme AlpP, violacein proteins, S-layer protein SLR4, and various pili proteins. We further investigated the top identified biofilm-associated protein (Bap), a previously uncharacterized 1600 amino acid protein (EAR30327), which we designated as "BapP". Based on AlphaFold modeling and genomic context analysis, we predicted BapP as a distinct Ca2+-dependent biofilm adhesin. Consistent with this prediction, a {Delta}bapP knockout mutant was defective in forming both pellicle and surface-associated biofilms, which was rescued by re-insertion of bapP into the genome. Similar to mechanisms of RTX adhesins, BapP-mediated biofilm formation was influenced by Ca2+ levels, and BapP is likely exported by a type 1 secretion system. Ultimately, our work not only provides a useful proteomic dataset for studying biofilm development in an ecologically relevant organism, but it also adds to our knowledge of bacterial adhesin diversity, emphasizing Bap-like proteins as widespread determinants of biofilm formation in bacteria.

microbiology↗

Capturing long-tailed individual tree diversity using an airborne multi-temporal hierarchical model

Measuring forest biodiversity using terrestrial surveys is expensive and can only capture common species abundance in large heterogeneous landscapes. In contrast, combining airborne imagery with computer vision can generate individual tree data at the scales of hundreds of thousands of trees. To train computer vision models, ground-based species labels are combined with airborne reflectance data. Due to the difficulty of finding rare species in a large landscape, the majority of classification models only include the most abundant species, leading to biased predictions at broad scales. Extending classification models to include rare species requires targeted data collection and algorithmic improvements to overcome large data imbalances between dominant and rare taxa. In addition, large landscapes often require multiple acquisition events, leading to significant within-species variation in reflectance spectra. Using a multi-temporal hierarchical model, we demonstrate the ability to include species predicted at less than 1% frequency in landscape without losing performance on the dominant species. The final model has over 75% accuracy for 14 species with improved rare species classification compared to a baseline deep learning model. After filtering out dead trees, we generate landscape species maps of individual crowns for over 670,000 individual trees at the Ordway Swisher Biological Station within the National Ecological Observatory Network. We estimate the relative abundance of the species within the landscape and provide three measures of uncertainty to generate a range of counts for each species. These maps provide the first estimates of canopy tree diversity within NEON sites to include rare species and provide a blueprint for capturing tree diversity using airborne computer vision at broad scales.

ecology↗

A benchmark dataset for individual tree crown delineation in co-registered airborne RGB, LiDAR and hyperspectral imagery from the National Ecological Observation Network

Broad scale remote sensing promises to build forest inventories at unprecedented scales. A crucial step in this process is designing individual tree segmentation algorithms to associate pixels into delineated tree crowns. While dozens of tree delineation algorithms have been proposed, their performance is typically not compared based on standard data or evaluation metrics, making it difficult to understand which algorithms perform best under what circumstances. There is a need for an open evaluation benchmark to minimize differences in reported results due to data quality, forest type and evaluation metrics, and to support evaluation of algorithms across a broad range of forest types. Combining RGB, LiDAR and hyperspectral sensor data from the National Ecological Observatory Networks Airborne Observation Platform with multiple types of evaluation data, we created a novel benchmark dataset to assess individual tree delineation methods. This benchmark dataset includes an R package to standardize evaluation metrics and simplify comparisons between methods. The benchmark dataset contains over 6,000 image-annotated crowns, 424 field-annotated crowns, and 3,777 overstory stem points from a wide range of forest types. In addition, we include over 10,000 training crowns for optional use. We discuss the different evaluation sources and assess the accuracy of the image-annotated crowns by comparing annotations among multiple annotators as well as to overlapping field-annotated crowns. We provide an example submission and score for an open-source baseline for future methods.

ecology↗

NEON Crowns: a remote sensing derived dataset of 100 million individual tree crowns

Forests provide essential biodiversity, ecosystem and economic services. Information on individual trees is important for understanding the state of forest ecosystems but obtaining individual-level data at broad scales is challenging due to the costs and logistics of data collection. While advances in remote sensing techniques allow surveys of individual trees at unprecedented extents, there remain significant technical and computational challenges in turning sensor data into tangible information. Using deep learning methods, we produced an open-source dataset of individual-level crown estimates for 100 million trees at 37 sites across the United States surveyed by the National Ecological Observatory Networks Airborne Observation Platform. Each canopy tree crown is represented by a rectangular bounding box and includes information on the height, crown area, and spatial location of the tree. Tree crowns identified using this technique correspond well with hand-labeled crowns, exhibiting both high levels of overlap and good correspondence in height estimates. These data have the potential to drive significant expansion of individual-level research on trees by facilitating both regional analyses at scales of ~10,000 ha and cross-region comparisons encompassing forest types from most of the United States.

ecology↗

Rethinking the fundamental unit of ecological remote sensing: Estimating individual level plant traits at scale

Functional ecology has increasingly focused on describing ecological communities based on their traits (measurable features affecting individuals fitness and performance). Analyzing trait distributions within and among forests could significantly improve understanding of community composition and ecosystem function. Historically, data on trait distributions are generated by (1) collecting a small number of leaves from a small number of trees, which suffers from limited sampling but produces information at the fundamental ecological unit (the individual); or (2) using remote sensing images to infer traits, producing information continuously across large regions, but as plots (containing multiple trees of different species) or pixels, not individuals. Remote sensing methods that identify individual trees and estimate their traits would provide the benefits of both approaches, producing continuous large-scale data linked to biological individuals. We used data from the National Ecological Observatory Network (NEON) to develop a method to scale up functional traits from 160 trees to the millions of trees within the spatial extent of two NEON sites. The pipeline consists of three stages: 1) image segmentation, to identify individual trees and estimate structural traits; 2) ensemble of models to infer leaf mass area (LMA), nitrogen, carbon, and phosphorus content using hyperspectral signatures, and DBH from allometry; and 3) predictions for segmented crowns for the full remote sensing footprint at the NEON sites. The R2 values on held out test data ranged from 0.41 to 0.75 on held out test data. The ensemble approach performed better than single partial least squares models. Carbon performed poorly compared to other traits (R2 of 0.41). The crown segmentation step contributed the most uncertainty in the pipeline, due to over-segmentation. The pipeline produced good estimates of DBH (R2 of 0.62 on held out data). Trait predictions for crowns performed significantly better than comparable predictions on pixels, resulting in improvement of R2 on test data of between to 0.26. We used the pipeline to produce individual level trait data for [~]5 million individual crowns, covering a total extent of [~]360 km2. This large dataset allows testing ecological questions on landscape scales, revealing that foliar traits are correlated with structural traits and environmental conditions.

ecology↗