Search bioRxiv⌕ Search

Biology subjects

Weinstein, B.

Publications and source records attributed to Weinstein, B..

13 recordsLinked to original sources

Oxidized protein states define metastatic fitness in lung cancer

AbstractReactive oxygen species (ROS) are a pervasive feature of human cancers, yet the protein targets through which ROS-regulated cell states shape tumor biology remains poorly understood. Here, using cysteine chemical proteomics, we define signatures of protein states under distinct cellular ROS environments that capture protein oxidation and conformational changes. Quantifying these signatures in primary lung tumors and brain metastases revealed a surprising enrichment of oxidative states in metastasis. To determine how these states support fitness, we performed genome-wide CRISPR screens and identified the mitochondrial Complex I subunit NDUFA10 as a key oxidation-dependent vulnerability. Oxidation of NDUFA10*Cys253 supports Complex I function through a previously unrecognized nucleotide kinase activity that maintains mitochondrial DNA levels. Enforcing a reduced conformation in NDUFA10 disrupts brain metastatic colonization in vivo. These findings establish ROS regulated protein states as a functional layer of tumor fitness, providing a framework for identifying redox-dependent mechanisms that support cancer progression.

Cancer Biology↗

Live longitudinal imaging of meningeal cerebrovascular injury and its sequelae in adult zebrafish

Nearly 1.4 million people in the United States sustain a traumatic brain injury (TBI) each year, with almost half of those hospitalized for TBI developing long-term disability. For many patients, prolonged bleeding and inflammation from damaged vessels in the meninges result in long-lasting sequelae. Although their injured blood vessels regrow, the site of injury is full of inflammatory immune cells that may influence vascular function. Adult zebrafish have a thin, translucent skull and a mammalian-like meninges that is easily imaged in living animals. We have established a novel adult zebrafish model to investigate vessel-immune cell interactions after meningeal cerebrovascular injury (mCVI). We use carefully calibrated sonication to rupture meningeal blood vessels without breaching the skull or causing damage to the underlying brain. By performing longitudinal live imaging of intubated adult fish we observe vascular regrowth and immune responses to mCVI over time in the same animal with unprecedented resolution allowing measurement of blood flow, dynamics of vessel regrowth, and interactions between individual immune and vascular cells. This newly developed zebrafish model provides a powerful tool for longitudinal live imaging of meningeal immune cell-vascular interactions after cerebrovascular injury, opening the door to new insights into chronic neuroinflammatory disease.

neuroscience↗

Using time-series remote sensing to identify and track individual bird nests at large scales

The challenges of monitoring wildlife often limits the scales and intensity of the data that can be collected. New technologies - such as remote sensing using unoccupied aircraft systems (UAS) - can collect information more quickly, over larger areas, and more frequently than is feasible using ground-based methods. While airborne imaging is increasingly used to produce data on the location and counts of individuals, its ability to produce individual-based demographic information is less explored. Repeat airborne imagery to generate an imagery time-series provides the potential to track individuals over time to collect information beyond one-off counts, but doing so necessitates automated approaches to handle the resulting high-frequency large-spatial scale imagery. We develop an automated time-series remote sensing approach to identifying wading bird nests in the Everglades ecosystem of Florida, USA to explore the feasibility and challenges of conducting time-series based remote sensing on mobile animals at large spatial scales. We combine a computer vision model for detecting birds in weekly UAS imagery of colonies with biology-informed algorithmic rules to generate an automated approach that identifies likely nests. Comparing the performance of these automated approaches to human assessment of the same imagery shows that our primary approach identifies nests with comparable performance to human photo assessment, and that a secondary approach designed to find quick-fail nests resulted in high false positive rates. We also assessed the ability of both human photo assessment and our primary algorithm to find ground-verified nests in UAS imagery and again found comparable performance, with the exception of nests that fail quickly. Our results show that automating nest detection, a key first step towards estimating nest success, is possible in complex environments like the Everglades and we discuss a number of challenges and possible uses for these types of approaches.

ecology↗

A probabilistic view of forbidden links: their prevalence and their consequences for the robustness of mutualistic networks

The presence in ecological communities of unfeasible species interactions, termed forbidden links, due to physiological or morphological exploitation barriers has been long debated, but little direct evidence has been found. Forbidden links are likely to make ecological communities less robust to species extinctions, stressing the need to assess their prevalence. Here, we used a dataset of plant-hummingbird interactions, coupled with a Bayesian hierarchical model, to assess the importance of exploitation barriers in determining species interactions. We found evidence for exploitation barriers between flowers and hummingbirds across the 32 studied communities, however, the proportion of forbidden links changed drastically among communities, because of changes in trait distributions. The higher the proportion of forbidden links, the more they decreased network robustness, because of constraints on interaction rewiring. Our results suggest that exploitation barriers are not rare in plant-hummingbird communities and have the potential to limit the rescue of species experiencing partner extinction.

ecology↗

Near real-time monitoring of long legged wading birds using uncrewed aircraft systems and computer vision

Wildlife population monitoring over large geographic areas is increasingly feasible due to developments in aerial survey methods coupled with the use of computer vision models for identifying and classifying individual organisms. However, aerial surveys still occur infrequently, and there are often long delays between the acquisition of airborne imagery and its conversion into population monitoring data. Near real-time monitoring is increasingly important for active management decisions and ecological forecasting. Accomplishing this over large scales requires a combination of airborne imagery, computer vision models to process imagery into information on individual organisms, and automated workflows to ensure that imagery is quickly processed into data following acquisition. Here we present our end-to-end workflow for conducting near real-time monitoring of wading birds in the Everglades, Florida, USA. Imagery is acquired as frequently as weekly using uncrewed aircraft systems (aka drones), processed into orthomosaics (using Agisoft metashape), converted into individual level species data using a Retinanet-50 object detector, post-processed, archived, and presented on a web-based visualization platform (using Shiny). The main components of the workflow are automated using Snakemake. The underlying computer vision model provides accurate object detection, species classification, and both total and species-level counts for five out of six target species (White Ibis, Great Egret, Great Blue Heron, Wood Stork, and Roseate Spoonbill). The model performed poorly for Snowy Egrets due to the small number of labels and difficulty distinguishing them from White Ibis (the most abundant species). By automating the post-survey processing, data on the populations of these species is available in near real-time (< 1 week from the date of the survey) providing information at the time-scales needed for ecological forecasting and active management.

ecology↗

Individual tree crown maps for the National Ecological Observatory Network

The ecology of forest ecosystems depends on the composition of trees. Capturing fine-grained information on individual trees at broad scales provides a unique perspective on forest ecosystems, forest restoration and responses to disturbance. Individual tree data at wide extents promises to increase the scale of forest analysis, biogeographic research, and ecosystem monitoring without losing details on individual species composition and abundance. Computer vision using deep neural networks can convert raw sensor data into predictions of individual canopy tree species through labeled data collected by field researchers. Using over 40,000 individual tree stems as training data, we create landscape-level species predictions for over 100 million individual trees across 24 sites in the National Ecological Observatory Network. Using hierarchical multi-temporal models fine-tuned for each geographic area, we produce open-source data available as 1 km2 shapefiles with individual tree species prediction, as well as crown location, crown area and height of 81 canopy tree species. Site-specific models had an average performance of 79% accuracy covering an average of six species per site, ranging from 3 to 15 species per site. All predictions are openly archived and have been uploaded to Google Earth Engine to benefit the ecology community and overlay with other remote sensing assets. We outline the potential utility and limitations of these data in ecology and computer vision research, as well as strategies for improving predictions using targeted data sampling.

ecology↗

Capturing long-tailed individual tree diversity using an airborne multi-temporal hierarchical model

Measuring forest biodiversity using terrestrial surveys is expensive and can only capture common species abundance in large heterogeneous landscapes. In contrast, combining airborne imagery with computer vision can generate individual tree data at the scales of hundreds of thousands of trees. To train computer vision models, ground-based species labels are combined with airborne reflectance data. Due to the difficulty of finding rare species in a large landscape, the majority of classification models only include the most abundant species, leading to biased predictions at broad scales. Extending classification models to include rare species requires targeted data collection and algorithmic improvements to overcome large data imbalances between dominant and rare taxa. In addition, large landscapes often require multiple acquisition events, leading to significant within-species variation in reflectance spectra. Using a multi-temporal hierarchical model, we demonstrate the ability to include species predicted at less than 1% frequency in landscape without losing performance on the dominant species. The final model has over 75% accuracy for 14 species with improved rare species classification compared to a baseline deep learning model. After filtering out dead trees, we generate landscape species maps of individual crowns for over 670,000 individual trees at the Ordway Swisher Biological Station within the National Ecological Observatory Network. We estimate the relative abundance of the species within the landscape and provide three measures of uncertainty to generate a range of counts for each species. These maps provide the first estimates of canopy tree diversity within NEON sites to include rare species and provide a blueprint for capturing tree diversity using airborne computer vision at broad scales.

ecology↗

A benchmark dataset for individual tree crown delineation in co-registered airborne RGB, LiDAR and hyperspectral imagery from the National Ecological Observation Network

Broad scale remote sensing promises to build forest inventories at unprecedented scales. A crucial step in this process is designing individual tree segmentation algorithms to associate pixels into delineated tree crowns. While dozens of tree delineation algorithms have been proposed, their performance is typically not compared based on standard data or evaluation metrics, making it difficult to understand which algorithms perform best under what circumstances. There is a need for an open evaluation benchmark to minimize differences in reported results due to data quality, forest type and evaluation metrics, and to support evaluation of algorithms across a broad range of forest types. Combining RGB, LiDAR and hyperspectral sensor data from the National Ecological Observatory Networks Airborne Observation Platform with multiple types of evaluation data, we created a novel benchmark dataset to assess individual tree delineation methods. This benchmark dataset includes an R package to standardize evaluation metrics and simplify comparisons between methods. The benchmark dataset contains over 6,000 image-annotated crowns, 424 field-annotated crowns, and 3,777 overstory stem points from a wide range of forest types. In addition, we include over 10,000 training crowns for optional use. We discuss the different evaluation sources and assess the accuracy of the image-annotated crowns by comparing annotations among multiple annotators as well as to overlapping field-annotated crowns. We provide an example submission and score for an open-source baseline for future methods.

ecology↗

NEON Crowns: a remote sensing derived dataset of 100 million individual tree crowns

Forests provide essential biodiversity, ecosystem and economic services. Information on individual trees is important for understanding the state of forest ecosystems but obtaining individual-level data at broad scales is challenging due to the costs and logistics of data collection. While advances in remote sensing techniques allow surveys of individual trees at unprecedented extents, there remain significant technical and computational challenges in turning sensor data into tangible information. Using deep learning methods, we produced an open-source dataset of individual-level crown estimates for 100 million trees at 37 sites across the United States surveyed by the National Ecological Observatory Networks Airborne Observation Platform. Each canopy tree crown is represented by a rectangular bounding box and includes information on the height, crown area, and spatial location of the tree. Tree crowns identified using this technique correspond well with hand-labeled crowns, exhibiting both high levels of overlap and good correspondence in height estimates. These data have the potential to drive significant expansion of individual-level research on trees by facilitating both regional analyses at scales of ~10,000 ha and cross-region comparisons encompassing forest types from most of the United States.

ecology↗

Geographic Generalization in Airborne RGB Deep Learning Tree Detection

Tree detection is a fundamental task in remote sensing for forestry and ecosystem ecology applications. While many individual tree segmentation algorithms have been proposed, the development and testing of these algorithms is typically site specific, with few methods evaluated against data from multiple forest types simultaneously. This makes it difficult to determine the generalization of proposed approaches, and limits tree detection at broad scales. Using data from the National Ecological Observatory Network we extend a recently developed semi-supervised deep learning algorithm to include data from a range of forest types, determine whether information from one forest can be used for tree detection in other forests, and explore the potential for building a universal tree detection algorithm. We find that the deep learning approach works well for overstory tree detection across forest conditions, outperforming conventional LIDAR-only methods in all forest types. Performance was best in open oak woodlands and worst in alpine forests. When models were fit to one forest type and used to predict another, performance generally decreased, with better performance when forests were more similar in structure. However, when models were pretrained on data from other sites and then fine-tuned using a small amount of hand-labeled data from the evaluation site, they performed similarly to local site models. Most importantly, a universal model fit to data from all sites simultaneously performed as well or better than individual models trained for each local site. This result suggests that RGB tree detection models that can be applied to a wide array of forest types at broad scales should be possible.

ecology↗

Rethinking the fundamental unit of ecological remote sensing: Estimating individual level plant traits at scale

Functional ecology has increasingly focused on describing ecological communities based on their traits (measurable features affecting individuals fitness and performance). Analyzing trait distributions within and among forests could significantly improve understanding of community composition and ecosystem function. Historically, data on trait distributions are generated by (1) collecting a small number of leaves from a small number of trees, which suffers from limited sampling but produces information at the fundamental ecological unit (the individual); or (2) using remote sensing images to infer traits, producing information continuously across large regions, but as plots (containing multiple trees of different species) or pixels, not individuals. Remote sensing methods that identify individual trees and estimate their traits would provide the benefits of both approaches, producing continuous large-scale data linked to biological individuals. We used data from the National Ecological Observatory Network (NEON) to develop a method to scale up functional traits from 160 trees to the millions of trees within the spatial extent of two NEON sites. The pipeline consists of three stages: 1) image segmentation, to identify individual trees and estimate structural traits; 2) ensemble of models to infer leaf mass area (LMA), nitrogen, carbon, and phosphorus content using hyperspectral signatures, and DBH from allometry; and 3) predictions for segmented crowns for the full remote sensing footprint at the NEON sites. The R2 values on held out test data ranged from 0.41 to 0.75 on held out test data. The ensemble approach performed better than single partial least squares models. Carbon performed poorly compared to other traits (R2 of 0.41). The crown segmentation step contributed the most uncertainty in the pipeline, due to over-segmentation. The pipeline produced good estimates of DBH (R2 of 0.62 on held out data). Trait predictions for crowns performed significantly better than comparable predictions on pixels, resulting in improvement of R2 on test data of between to 0.26. We used the pipeline to produce individual level trait data for [~]5 million individual crowns, covering a total extent of [~]360 km2. This large dataset allows testing ecological questions on landscape scales, revealing that foliar traits are correlated with structural traits and environmental conditions.

ecology↗

Individual tree-crown detection in RGB imagery using self-supervised deep learning neural networks

Remote sensing can transform the speed, scale, and cost of biodiversity and forestry surveys. Data acquisition currently outpaces the ability to identify individual organisms in high resolution imagery. We outline an approach for identifying tree-crowns in RGB imagery while using a semi-supervised deep learning detection network. Individual crown delineation has been a long-standing challenge in remote sensing and available algorithms produce mixed results. We show that deep learning models can leverage existing Light Detection and Ranging (LIDAR)-based unsupervised delineation to generate trees that are used for training an initial RGB crown detection model. Despite limitations in the original unsupervised detection approach, this noisy training data may contain information from which the neural network can learn initial tree features. We then refine the initial model using a small number of higher-quality hand-annotated RGB images. We validate our proposed approach while using an open-canopy site in the National Ecological Observation Network. Our results show that a model using 434,551 self-generated trees with the addition of 2848 hand-annotated trees yields accurate predictions in natural landscapes. Using an intersection-over-union threshold of 0.5, the full model had an average tree crown recall of 0.69, with a precision of 0.61 for the visually-annotated data. The model had an average tree detection rate of 0.82 for the field collected stems. The addition of a small number of hand-annotated trees improved the performance over the initial self-supervised model. This semi-supervised deep learning approach demonstrates that remote sensing can overcome a lack of labeled training data by generating noisy data for initial training using unsupervised methods and retraining the resulting models with high quality labeled data.

ecology↗

An epigenetic mechanism for cavefish eye degeneration

Coding and non-coding mutations in DNA contribute significantly to phenotypic variability during evolution. However, less is known about the role of epigenetics in this process. Although previous studies have identified eye development genes associated with the loss of eyes phenotype in the Pachon blind cave morph of the Mexican tetra Astyanax mexicanus1-6, no inactivating mutations have been found in any of these genes2,3,7-10. Here we show that excess DNA methylation-based epigenetic silencing promotes eye degeneration in blind cave Astyanax mexicanus. By performing parallel analyses in Astyanax mexicanus cave and surface morphs and in the zebrafish Danio rerio, we have discovered that DNA methylation mediates eye-specific gene repression and globally regulates early eye development. The most significantly hypermethylated and down-regulated genes in the cave morph are also linked to human eye disorders, suggesting the function of these genes is conserved across the vertebrates. Our results show that changes in DNA methylation-based gene repression can serve as an important molecular mechanism generating phenotypic diversity during development and evolution.

evolutionary biology↗