Search bioRxiv⌕ Search

Biology subjects

Alison, J.

Publications and source records attributed to Alison, J..

4 recordsLinked to original sources

Deep learning to extract the meteorological by-catch of wildlife cameras

Microclimate - proximal climatic variation at scales of meters and minutes - can exacerbate or mitigate the impacts of climate change on biodiversity. However, most microclimate studies are temperature-centric, and do not consider meteorological factors such as sunshine, hail and snow. Meanwhile, remote cameras have become a primary tool to monitor wild plants and animals, even at micro-scales, with deep learning tools to rapidly convert images into ecological data. However, deep learning applications for wildlife imagery have focused exclusively on living subjects. Here, we identify an overlooked opportunity to extract latent, yet ecologically relevant, meteorological information. We produce an annotated image dataset of micrometeorological conditions across 49 wildlife cameras in South Africas Maloti-Drakensberg and the Swiss Alps. We train ensemble deep learning models to classify conditions as overcast, sunshine, hail or snow. Our best model achieves 91.7% accuracy on test cameras not seen during training. Furthermore, we show how effective accuracy is raised to 96% by disregarding 14.1% of classifications where ensemble member models did not reach a consensus. Unlike previous studies we test model performance in remote and novel locations, distinguishing overcast and sunny conditions in Svalbard, Norway with 79.3% accuracy (93.9% consensus accuracy). Our model rapidly classifies sunshine, snow and hail in almost 2 million unlabeled images. Resulting micrometeorological data illustrated common seasonal patterns of summer hailstorms and autumn snowfalls across mountains in the northern and southern hemispheres. However, daily patterns of sunshine and shade diverged between sites, impacting daily temperature cycles. Crucially, we leverage micrometeorological data to demonstrate that (1) experimental warming using open-top chambers shortens early snow events in autumn, and (2) image-derived sunshine marginally outperforms sensor-derived temperature when predicting bumblebee foraging. These methods generate novel micrometeorological variables in synchrony with biological recordings, enabling new insights from an increasingly global network of wildlife cameras.

ecology↗

Hierarchical Classification of Insects with Multitask Learning and Anomaly Detection

Cameras and computer vision are revolutionising the study of insects, creating new research opportunities within agriculture, epidemiology, evolution, ecology and monitoring of biodiversity. However, a major challenge is the diversity of insects and close resemblances of many species combined with computer vision are often not sufficient to classify large numbers of insect species, which sometimes cannot be identified at the species level. Here, we present an algorithm to hierarchically classify insects from images, leveraging a simple taxonomy to (1) classify specimens across multiple taxonomic ranks simultaneously, and (2) highlight the lowest rank at which a reliable classification can be reached. Specifically, we propose multitask learning, a loss function incorporating class dependency at each taxonomic rank, and anomaly detection based on outlier analysis for quantification of uncertainty. First, we compile a dataset of 41,731 images of insects, combining images from time-lapse monitoring of floral scenes with images from the Global Biodiversity Information Facility (GBIF). Second, we adapt state-of-the-art convolutional neural networks, ResNet and EfficientNet, for the hierarchical classification of insects belonging to three orders, five families and nine species. Third, we assess model generalization for 11 species unseen by the trained models. Here, anomaly detection is used to predict the higher rank of the species not present in the training set. We found that incorporating a simple taxonomy into our model increased accuracy at higher taxonomic ranks. As expected, our algorithm correctly classified new insect species at higher taxonomic ranks, while classification was uncertain at lower taxonomic ranks. Anomaly detection can effectively flag novel taxa that are visually distinct from species in the training data. However, five novel taxa were consistently mistaken for visually similar species in the training data. Above all, we have demonstrated a practical approach to hierarchical classification based on species taxonomy and uncertainty during automated in situ monitoring of live insects. Our method is simple and versatile and could be implemented to classify a wide range of insects as well as other organisms.

ecology↗

A diversity of diversities: evaluating the relationships between below and aboveground biodiversity

O_LITo predict how biodiversity will respond to global change, it is crucial to understand the relative roles of abiotic drivers and biotic interactions in driving associations between the biodiversity of disparate taxa. It is particularly challenging to understand diversity-diversity links across domains and habitats, because data are rarely available for multiple above- and below-ground taxa across multiple sites. C_LIO_LIHere we analyse data from a unique biodiversity dataset gathered across a variety of oceanic temperate terrestrial habitats in Wales, comprising 300 sites with co-located soil microbial, plant, bird, and pollinator surveys along with climate and soil physicochemical information. Soil groups are analysed using metabarcoding of the 16S, ITS1 and 18S DNA regions, allowing in depth characterisation of microbial and soil animal biodiversity. C_LIO_LIWe explore biodiversity relationships along three aspects of community composition: First, we assess correlation between the alpha diversity of different groups. Second, we assess whether biotic turnover between sites is correlated across different groups. Finally, we investigate the co-occurrence of individual taxa across sites. In each analysis, we assess the contribution of linear or non-linear environmental effects. C_LIO_LIWe find that a positive correlation between alpha diversity of plants, soil bacteria, soil fungi, soil heterotrophic protists, bees and butterflies is in fact driven by complex non-linear responses to abiotic drivers. In contrast, environmental variation did not account for positive associations between the diversity of plants and both birds and AM fungi, suggesting a role for biotic interactions. C_LIO_LIBoth the diversity and taxon-level associations between the differing soil groups remained even after accounting for non-linear environmental gradients. Aboveground, spatial factors played larger roles in driving biotic communities, while linear environmental gradients were sufficient to explain many group- and taxon-level relationships. C_LIO_LISynthesis. Our results show how non-linear responses to environmental gradients drive many of the relationships between plant biodiversity and the biodiversity of above- and belowground biological communities. Our work shows how different aspects of biodiversity might respond non-linearly to changing environments and identifies cases where management-induced changes in one community could either influence other taxa or lead to loss of apparent biological associations. C_LI

ecology↗

Accurate detection and identification of insects from camera trap images with deep learning

Reported insect declines have dramatically increased the global demand for standardized insect monitoring data. Image-based monitoring can generate such data cost-efficiently and non-invasively. However, extracting ecological data from images is more challenging for insects than for vertebrates because of their small size and great diversity. Deep learning facilitates fast and accurate insect detection and identification, but the lack of training data for coveted deep learning models is a major obstacle for their application. We present a large annotated image dataset of functionally important insect taxa. The primary dataset consists of 29,960 annotated insects representing nine taxa including bees, hoverflies, butterflies and beetles across more than two million images recorded with ten time-lapse cameras mounted over flowers during the summer of 2019. The insect image dataset was extracted using an iterative approach: First, a preliminary detection model identified candidate insects. Second, candidate insects were manually screened by users of an online citizen science platform. Finally, all annotations were quality checked by experts. We used the dataset to train and compare the performance of selected You Only Look Once (YOLO) deep learning algorithms. We show that these models detect and classify small insects in complex scenes with unprecedented accuracy. The best performing YOLOv5 model consistently identifies nine dominant insect species that play important roles in pollination and pest control across Europe. The model reached an average precision of 92.7% and recall of 93.8 % in detection and classification across species. Importantly, when presented with uncommon or unclear insects not seen during training, our model detects 80% of individuals and usually interprets them as closely related species. This is a useful property to (1) detect rare insects for which training data are absent, and (2) generate new training data to correctly identify those insects in future. Our camera system, dataset and deep learning framework show promising results in non-destructive monitoring of insects. Furthermore, resulting data are useful to quantify phenology, abundance, and foraging behaviour of flower-visiting insects. Above all, this dataset represents a critical first benchmark for future development and evaluation of deep learning models for insect detection and identification.

ecology↗