Automated and accurate segmentation of leaf venation networks via deep learning

Abstract

O_LILeaf vein network geometry can predict levels of resource transport, defence, and mechanical support that operate at different spatial scales. However, it is challenging to quantify network architecture across scales, due to the difficulties both in segmenting networks from images, and in extracting multi-scale statistics from subsequent network graph representations. C_LIO_LIHere we develop deep learning algorithms using convolutional neural networks (CNNs) to automatically segment leaf vein networks. Thirty-eight CNNs were trained on subsets of manually-defined ground-truth regions from >700 leaves representing 50 southeast Asian plant families. Ensembles of 6 independently trained CNNs were used to segment networks from larger leaf regions (~100 mm2). Segmented networks were analysed using hierarchical loop decomposition to extract a range of statistics describing scale transitions in vein and areole geometry. C_LIO_LIThe CNN approach gave a precision-recall harmonic mean of 94.5% {+/-} 6%, outperforming other current network extraction methods, and accurately described the widths, angles, and connectivity of veins. Multi-scale statistics then enabled identification of previously-undescribed variation in network architecture across species. C_LIO_LIWe provide a LeafVeinCNN software package to enable multi-scale quantification of leaf vein networks, facilitating comparison across species and exploration of the functional significance of different leaf vein architectures. C_LI