Search bioRxiv⌕ Search

Biology subjects

Baret, F.

Publications and source records attributed to Baret, F..

3 recordsLinked to original sources

SegVeg: Segmenting RGB images into green and senescent vegetation by combining deep and shallow methods

The pixels segmentation of high resolution RGB images into background, green vegetation and senescent vegetation classes is a first step often required before estimating key traits of interest including the vegetation fraction, the green area index, or to characterize the sanitary state of the crop. We developed the SegVeg model for semantic segmentation of RGB images into the three classes of interest. It is based on a U-net model that separates the vegetation from the background. It was trained over a very large and diverse dataset. The vegetation pixels are then classified using a SVM shallow machine learning technique trained over pixels extracted from grids applied to images. The performances of the SegVeg model are then compared to a three classes U-net model trained using weak supervision over RGB images with predicted pixels by SegVeg as groundtruth masks. Results show that the SegVeg model allows to segment accurately the three classes, with however some confusion mainly between the background and the senescent vegetation, particularly over the dark and bright parts of the images. The U-net model achieves similar performances, with some slight degradation observed for the green vegetation: the SVM pixel-based approach provides more precise delineation of the green and senescent patches as compared to the convolutional nature of U-net. The use of the components of several color spaces allows to better classify the vegetation pixels into green and senescent ones. Finally, the models are used to predict the fraction of the three classes over the grids pixels or the whole images. Results show that the green fraction is very well estimated (R2=0.94) by the SegVeg model, while the senescent and background fractions show slightly degraded performances (R2=0.70 and 0.73, respectively). We made SegVeg publicly available as a ready-to-use script, as well as the entire dataset, rendering segmentation accessible to a broad audience by requiring neither manual annotation nor knowledge, or at least, offering a pre-trained model to more specific use.

plant biology↗

Plant detection and counting from high-resolution RGB images acquired from UAVs: comparison between deep-learning and handcrafted methods with application to maize, sugar beet, and sunflower crops

Progresses in agronomy rely on accurate measurement of the experimentations conducted to improve the yield component. Measurement of the plant density is required for a number of applications since it drives part of the crop fate. The standard manual measurements in the field could be efficiently replaced by high-throughput techniques based on high-spatial resolution images taken from UAVs. This study compares several automated detection of individual plants in the images from which the plant density can be estimated. It is based on a large dataset of high resolution Red/Green/Blue (RGB) images acquired from Unmanned Aerial Vehicules (UAVs) during several years and experiments over maize, sugar beet and sunflower crops at early stages. A total of 16247 plants have been labelled interactively on the images. Performances of handcrafted method (HC) were compared to those of deep learning (DL). The HC method consists in segmenting the image into green and background pixels, identifying rows, then objects corresponding to plants thanks to knowledge of the sowing pattern as prior information. The DL method is based on the Faster Region with Convolutional Neural Network (Faster RCNN) model trained over 2/3 of the images selected to represent a good balance between plant development stage and sessions. One model is trained for each crop. Results show that simple DL methods generally outperforms simple HC, particularly for maize and sunflower crops. A significant level of variability of plant detection performances is observed between the several experiments. This was explained by the variability of image acquisition conditions including illumination, plant development stage, background complexity and weed infestation. The image quality determines part of the performances for HC methods which makes the segmentation step more difficult. Performances of DL methods are limited mainly by the presence of weeds. A hybrid method (HY) was proposed to eliminate weeds between the rows using the rules developed for the HC method. HY improves slightly DL performances in the case of high weed infestation. When few images corresponding to the conditions of the testing dataset were complementing the training dataset for DL, a drastic increase of performances for all the crops is observed, with relative RMSE below 5% for the estimation of the plant density.

plant biology↗

Leaf rolling in maize crops: from leaf scoring to canopy level measurements for phenotyping

Leaf rolling in maize crops is one of the main plant reactions to water stress that may be visually scored in the field. However, the leaf scoring did not reach the high-throughput desired by breeders for efficient phenotyping. This study investigates the relationship between leaf rolling score and the induced canopy structure changes that may be accessed by high-throughput remote sensing techniques.\n\nResults gathered over a field phenotyping platform run in 2015 and 2016 show that leaf starts to roll for the water stressed conditions around 9:00 and reaches its maximum around 15:00. Conversely, genotypes conducted under well watered conditions do not show any significant rolling during the same day. Leaf level rolling was very strongly correlated to canopy structure changes as described by the fraction of intercepted radiation fIPARWS derived from digital hemispherical photography. The changes in fIPARWS were stronly correlated (R2=0.86, n=50) to the leaf level rolling visual score. Further, a very good consistency of the genotype ranking of the fIPARWS changes during the day was found ({rho}=0.62). This study demonstrating the strong coordination between leaf level rolling and its impact on canopy structure changes poses the basis for new high-throughput remote sensing methods to quantify this water stress trait.\n\nHighlighThe diurnal dynamics of leaf rolling scored visually is strongly related to canopy structure changes that can be documented using Digital hemispherical photography. Consequences for high-throughput field phenotyping are discussed

plant biology↗