Search bioRxiv⌕ Search

Biology subjects

Loh, L. Y.

Publications and source records attributed to Loh, L. Y..

2 recordsLinked to original sources

LizardLens: A Two-Stage Deep Learning Pipeline for Detecting and Classifying Similar Species in Visually Complex Environments

Community science platforms like iNaturalist generate unprecedented volumes of biodiversity data, but their scientific utility depends critically on accurate species identification--a persistent challenge when contributors often lack taxonomic expertise. We developed "LizardLens", a two-stage machine learning pipeline that decouples object detection from species classification to enable fine-grained identification of morphologically similar organisms in visually complex field photographs. Using 10,000 verified iNaturalist images of five Anolis lizard species in Florida, we trained specialized YOLO-based detection and Swin Transformer classification models and compared performance against state-of-the-art single-stage architectures. Our two-stage pipeline achieved 83.0% Top-1 accuracy and a macro-averaged F1-score of 89.0%, indicating strong precision-recall performance across species and outperforming single-stage YOLOv8 and YOLOv12 models across all evaluation metrics for all species, with relative improvements ranging from 10.5% to 13.2%. Gradient-weighted Class Activation Mapping (Grad-CAM) indicated that the models predictions were consistently associated with regions corresponding to diagnostic morphological (e.g., head shape, feet, and limb lengths) and pattern features (e.g., ocular rings and body patterning), providing evidence that LizardLens leverages biologically relevant visual cues consistent with those used by expert taxonomists. Error analysis identified partial occlusion and multiple proximate individuals as primary sources of missed detections, while spurious detections of lizard-like environmental features (e.g., sticks, bark) represented the dominant false positive error mode. We deployed LizardLens as an accessible web application featuring interactive bounding box correction, ranked species predictions with confidence scores, directly supporting the "Lizards on the Loose" middle school community science initiative. By combining technical advances in fine-grained visual classification with user-centered design, LizardLens demonstrates how machine learning can simultaneously enhance data quality for biodiversity monitoring and provide authentic scientific experiences for student participants. Our approach is generalizable to other small-bodied organisms in complex habitats and provides a framework for translating computer vision advances into practical tools for community science and conservation.

ecology↗

LizardMorph: A generalizable machine learning framework for automated anatomical landmark detection in digital images

Morphological measurements underpin a wide range of ecological and evolutionary research, yet the manual landmarking workflows on which most morphometric studies depend remain a persistent bottleneck that limits both the pace and scale of biological research. Machine learning offers compelling solutions, but most automated landmarking tools require substantial computational expertise, creating a gap between technical capability and practical adoption by biologists. Here, we present LizardMorph, an integrated machine learning pipeline and web-based interface for semi-automated anatomical landmark detection on biological images. LizardMorph couples a fine-tuned ML-Morph shape predictor with an accessible, browser-based interface that enables researchers to upload images, review automated landmark predictions, interactively correct outliers through point-and-click editing, and export results in standard morphometric formats--all without programming expertise or local software installation. Using dorsal X-ray radiographs of Anolis lizards with 34 anatomical landmarks as a proof-of-concept, we show that the ML-Morph model achieves high predictive accuracy, with landmarks on well-defined skeletal structures predicted with 100% accuracy within a 1 mm tolerance threshold. A controlled user study comparing LizardMorph against traditional manual landmarking (TpsDig2) demonstrated significant efficiency gains: experienced annotators completed LizardMorph landmark verification 37.5% faster than manual annotation. Extrapolated to batch processing 1,000 lizards, LizardMorph saves experienced researchers approximately 6.5 hours of manual processing time. Critically, LizardMorph implements a human-in-the-loop design in which automated predictions serve as editable starting points, preserving researcher oversight and enabling correction of the occasional large-error outliers that would be unacceptable in fully automated workflows. LizardMorph is freely available as an open-source tool and provides a replicable framework for developing ML-assisted annotation tools that can democratize access to high-quality morphometric analysis across diverse biological research communities.

evolutionary biology↗