Automated Rice Phenology Stage Mapping Using UAV Images and Deep Learning

Accurate monitoring of rice phenology is critical for crop management, cultivars breeding, and yield estimating. Previously, research for phenology detection relied on time-series data and orthomosaic and manually plotted regions, which are difficult to automate. This study presented a novel approach for extracting and mapping phenological traits directly from the unmanned aerial vehicle (UAV) photograph sequence. First, a multi-stage rice field segmentation dataset containing four growth stages and 2600 images, namely PaddySeg, was built. Moreover, an efficient Ghost Bilateral Network (GBiNet) was proposed to generate trait masks. To locate the trait of each pixel, we introduced direct geo-locating (DGL) and incremental sparse sampling (ISS) techniques to eliminate redundant computation. According to the results on PaddySeg, the proposed GBiNet with 91.50% mean-Intersection-over-Union (mIoU) and 41 frames-per-second (FPS) speed outperformed the baseline model (90.95%, 36 FPS), while the fastest GBiNet_t reached 62 FPS which was 1.7 times faster than the baseline model, BiSeNetV2. Additionally, the measured average DGL deviation was less than 1% of the relative height. Finally, the mapping of rice phenology was achieved by interpolation on trait value-location pairs. The proposed approach demonstrated great potential for automatic rice phenology stage surveying and mapping.

Automated summary

This study presents a novel approach to extract and map phenological traits of rice directly from unmanned aerial vehicle (UAV) photographs. A multi-stage rice field segmentation dataset named PaddySeg was built, and an efficient Ghost Bilateral Network (GBiNet) was proposed to generate trait masks. The mapping of rice phenology was achieved by interpolation on trait value-location pairs.