Journal
COMPUTERS AND ELECTRONICS IN AGRICULTURE
Volume 198, Issue -, Pages -Publisher
ELSEVIER SCI LTD
DOI: 10.1016/j.compag.2022.107081
Keywords
Deep learning; Deep regression; Yield estimation; Proximal sensing; Vineyard variability
Funding
- USDA AI Institute for Next Generation Food Systems (AIFS) [2020-67021-32855]
- NSF [1934568]
- American Society for Enology and Viticulture Michael Vail Scholarship
- Direct For Computer & Info Scie & Enginr [1934568] Funding Source: National Science Foundation
- Division of Computing and Communication Foundations [1934568] Funding Source: National Science Foundation
Ask authors/readers for more resources
This study demonstrates the applicability of nondestructive proximal imaging combined with deep learning for yield estimation in vineyards. The results show that the end-to-end modeling approach can perform comparably to the object detection approach while eliminating the need for hand-labeling.
Yield estimation prior to harvest is a powerful tool in vineyard management, as it allows growers to fine-tune management practices to optimize yield and quality. However, yield estimation is currently performed using manual sampling, which is time-consuming and imprecise. This study demonstrates the applicability of nondestructive proximal imaging combined with deep learning for yield estimation in vineyards. Continuous image data collection using a vehicle-mounted sensing kit combined with collection of ground truth yield data at harvest using a commercial yield monitor allowed for the generation of a large dataset of 23,581 yield points and 107,933 images. Moreover, this study was conducted in a commercial vineyard which was mechanically managed, representing a challenging environment for image analysis but a common set of conditions in the California Central Valley. Three model architectures were tested: object detection, CNN regression, and transformer models. The object detection model was trained on hand-labeled images to localize grape bunches, and detections were either counted or their pixel count was summed to obtain a metric which was correlated to grape yield. Conversely, regression models were trained end-to-end to directly predict grape yield from image data without the need for hand labeling. Results demonstrated that both a transformer model as well as the object detection model with pixel area processing performed comparably, with a mean absolute percent error of 18% and 18.5%, respectively on a representative holdout dataset. Saliency mapping was used to demonstrate the attention of the CNN regression model was localized near the predicted location of grape bunches, as well as on the top of the grapevine canopy. Overall, the study demonstrated the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale. Additionally, the end-to-end modeling approach was able to perform comparably to the object detection approach while eliminating the need for hand-labeling.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available