A powerful image synthesis and semi-supervised learning pipeline for site-specific weed detection

Precise and efficient weed detection in agricultural fields is the key for robotic weed control. Recent developments in convolutional neural networks (CNNs) have achieved significant success in this regard. CNNs that simultaneously localize and classify objects in images are the predominant forms that have been widely used to detect crops and weeds. However, the use of CNNs in agriculture, particularly for weed detection, has been impeded by a lack of large training dataset with ground truth annotations. Cut-and-paste image synthesis approach and semi-supervised learning are popular methods to alleviate the training data deficiency problem. In this paper, we propose a novel image synthesis and semi-supervised learning pipeline to train site-specific weed detection models without the need for manually labeled images. The CNN models trained by this pipeline achieve performance levels close to that of the supervised models. We investigated the behavior of the proposed pipeline by varying several key components and showed that color match between the training and testing images, training-time color augmentation, and iterative semi-supervised learning largely improve the model performance. These promising results can be used to guide the construction of a weed image database applicable to different weed detection scenarios.

Automated summary

The study proposed a novel image synthesis and semi-supervised learning pipeline for training weed detection models without the need for manually labeled images, achieving performance levels close to that of supervised models. The results showed that color match, training-time color augmentation, and iterative semi-supervised learning significantly improved model performance.