A novel vision-based weakly supervised framework for autonomous yield estimation in agricultural applications

Autonomous systems have been established as a ground-breaking technology in agriculture, particularly for resource optimization and labor savings. However, even those solutions that are limited to monitoring activities, such as yield estimation, rely on costly robotic platforms equipped with a series of range devices (e.g., LIDAR and GPS-RTK). Recently, vision-based strategies have gained considerable attention as a less expensive and more efficient alternative, capable to be on par with or even surpass approaches that benefit from range sensors. Nonetheless, they exploit deep learning methodologies, which require burdensome labeling procedures to perform training. To address these shortcomings, we present a novel approach that performs yield estimation requiring only a monocular camera and needs a limited amount of supervision information. It detects, locates and maps fruits and tree canopies to estimate the total yield of a specific crop. To keep the image labeling effort to a minimum, we propose a weakly-supervision paradigm that only requires a simple binary label encoding the presence or the absence of fruits in the training images. Our approach does not make any assumptions on the underlying platform, i.e., it can be used by collecting images either with a hand-held camera or with an autonomous robot. Therefore, we are able to considerably reduce the deployment time, the energy and the cost of the overall yield estimation system. At the same time, we keep the performance comparable to both vision-based fully supervised baselines (which require costly labeling operations) and classical systems that rely on more expensive and power-demanding sensors.

Automated summary

Autonomous systems have revolutionized agriculture with their resource optimization and labor-saving capabilities. However, existing solutions for monitoring activities in agriculture, such as yield estimation, rely on expensive robotic platforms equipped with range devices. This paper proposes a novel approach that uses vision-based strategies and a weakly-supervised paradigm to perform yield estimation using only a monocular camera and limited supervision information. The proposed approach reduces deployment time, energy consumption, and cost, while maintaining performance comparable to fully supervised baselines and classical sensor-based systems.