4.7 Review

Towards autonomous selective harvesting: A review of robot perception, robot design, motion planning and control

Related references

Note: Only part of the references are listed.
Article Robotics

Modular autonomous strawberry picking robotic system

Soran Parsa et al.

Summary: Challenges in strawberry picking have led to a high demand for selective harvesting robotic technology. Most available solutions are limited to specific picking scenarios, but our developed system can handle complex scenarios like dense clusters. We have designed a modular system with a patented picking head that can remove occlusions and harvest strawberries without damaging them. In addition, our novel perception system can accurately detect and determine the ripeness of strawberries.

JOURNAL OF FIELD ROBOTICS (2023)

Article Agriculture, Multidisciplinary

Geometry-aware fruit grasping estimation for robotic harvesting in apple orchards

Xing Wang et al.

Summary: Field robotic harvesting is a promising technique in agricultural industry. This study proposes a geometry-aware network, A3N, and a global-to-local scanning strategy to enable robots to accurately recognize and retrieve fruits in complex field environments.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2022)

Article Agriculture, Multidisciplinary

Far-near combined positioning of picking-point based on depth data features for horizontal-trellis cultivated grape

Yucheng Jin et al.

Summary: This paper proposes a novel method for accurate positioning of picking-point in table grape clusters using a combination of far-view and near-view depth data features. The method achieves high success rate through a combination strategy and a special eye-under-finger structure.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2022)

Proceedings Paper Automation & Control Systems

Strawberry picking point localization ripeness and weight estimation

Alessandra Tafuro et al.

Summary: Labor shortage and difficulties in labor management have led to the emergence of robotic systems for selective strawberry harvesting. Accurate fruit picking perception is a crucial component of such systems. Researchers have developed two novel datasets annotated with information on picking points, key points, and the weight and size of strawberries. They also propose a new baseline model for weight estimation that outperforms existing deep networks.

2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022) (2022)

Proceedings Paper Automation & Control Systems

dPMP-Deep Probabilistic Motion Planning: A use case in Strawberry Picking Robot

Alessandra Tafuro et al.

Summary: This paper presents a novel probabilistic approach to deep robot learning from demonstrations (LfD) and extends deep movement primitives (DMPs) with a deep probabilistic model. Experimental results demonstrate a significant improvement in model prediction performance.

2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2022)

Proceedings Paper Automation & Control Systems

Environment-aware Interactive Movement Primitives for Object Reaching in Clutter

Sariah Mghames et al.

Summary: Most motion planning strategies are developed for 2D space, while fewer works have focused on the problem of reaching a target in 3D cluttered space. This study proposes a constrained multi-objective optimization framework to address this problem and tests its performance on soft fruits grown in clusters.

2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE) (2022)

Article Agriculture, Multidisciplinary

A method for litchi picking points calculation in natural environment based on main fruit bearing branch detection

Zhuo Zhong et al.

Summary: The accurate identification of picking points is crucial for the intelligent operation of a litchi picking robot. This paper proposed a method of locating picking points based on detecting the litchi's main fruit bearing branch (MFBB) using the YOLACT model, achieving a high precision of 89.7% and an F1 score of 83.8%. The method significantly improved the recall rate of MFBB and provided technical support for the visual recognition of the litchi picking robot.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2021)

Article Agriculture, Multidisciplinary

An improved obstacle separation method using deep learning for object detection and tracking in a hybrid visual control loop for fruit picking in clusters

Ya Xiong et al.

Summary: This study improved the active obstacle separation method for strawberry picking in clusters by increasing the speed and accuracy of the vision system. The obstacles were successfully separated from the target in three stages, with a hybrid vision-based control method used to enhance the success rate of the harvesting process.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2021)

Proceedings Paper Computer Science, Interdisciplinary Applications

Evaluation of mapping and path planning for non-holonomic mobile robot navigation in narrow pathway for agricultural application

Anupam Choudhary et al.

Summary: This paper evaluates mapping and path planning methods for mobile robots with non-holonomic constraints in narrow pathways, emphasizing the importance of sensor selection and presenting an experimental evaluation of laser-based and vision-based mapping algorithms. These methods are crucial for transferring agricultural products in greenhouses.

2021 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII) (2021)

Article Food Science & Technology

Food systems are responsible for a third of global anthropogenic GHG emissions

M. Crippa et al.

Summary: Data on GHG emissions from the global food system are often scattered and unavailable, but EDGAR-FOOD provides a consistent database from 1990 to 2015. The largest contributions to food-system emissions come from agriculture and supply chain activities, representing 34% of total global GHG emissions.

NATURE FOOD (2021)

Article Computer Science, Information Systems

Towards an Efficient Tomato Harvesting Robot: 3D Perception, Manipulation, and End-Effector

Jongpyo Jun et al.

Summary: This study proposes an efficient tomato harvesting robot design that combines the principles of 3D perception, manipulation, and an end-effector. The robot detects tomatoes based on deep learning and controls the manipulator's motion based on 3D coordination. Additionally, a suction pad with a kirigami pattern and a scissor-shaped cutting module were developed for gripping and cutting tomatoes effectively.

IEEE ACCESS (2021)

Article Agriculture, Multidisciplinary

Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry

Jordi Gene-Mola et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2020)

Article Robotics

Development of a sweet pepper harvesting robot

Boaz Arad et al.

JOURNAL OF FIELD ROBOTICS (2020)

Article Agronomy

Detection and classification of bruises of pears based on thermal images

Xiangyu Zeng et al.

POSTHARVEST BIOLOGY AND TECHNOLOGY (2020)

Review Plant Sciences

Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review

Yunchao Tang et al.

FRONTIERS IN PLANT SCIENCE (2020)

Article Agriculture, Multidisciplinary

An obstacle separation method for robotic picking of fruits in clusters

Ya Xiong et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2020)

Article Agricultural Engineering

Symmetry-based 3D shape completion for fruit localisation for harvesting robots

Yuanyue Ge et al.

BIOSYSTEMS ENGINEERING (2020)

Proceedings Paper Automation & Control Systems

Context Dependant Iterative Parameter Optimisation for Robust Robot Navigation

Adam Binch et al.

2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2020)

Proceedings Paper Automation & Control Systems

Interactive Movement Primitives: Planning to Push Occluding Pieces for Fruit Picking

Sariah Mghames et al.

2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2020)

Article Agriculture, Multidisciplinary

A fast and accurate deep learning method for strawberry instance segmentation

Isaac Perez-Borrero et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2020)

Article Computer Science, Information Systems

Robotic Aubergine Harvesting Using Dual-Arm Manipulation

Delia Sepulveda et al.

IEEE ACCESS (2020)

Article Computer Science, Information Systems

Real-Time Visual Localization of the Picking Points for a Ridge-Planting Strawberry Harvesting Robot

Yang Yu et al.

IEEE ACCESS (2020)

Article Computer Science, Artificial Intelligence

Evaluation of approach strategies for harvesting robots: Case study of sweet pepper harvesting: Category: (5)

Ola Ringdahl et al.

JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS (2019)

Article Agriculture, Multidisciplinary

Apple detection during different growth stages in orchards using the improved YOLO-V3 model

Yunong Tian et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2019)

Article Agriculture, Multidisciplinary

Development and field evaluation of a strawberry harvesting robot with a cable-driven gripper

Ya Xiong et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2019)

Article Automation & Control Systems

Dual-arm cooperation and implementing for robotic harvesting tomato using binocular vision

Xiao Ling et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2019)

Article Agriculture, Multidisciplinary

Multi-modal deep learning for Fuji apple detection using RGB-D cameras and their radiometric capabilities

Jordi Gene-Mola et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2019)

Article Agriculture, Multidisciplinary

Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN

Yang Yu et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2019)

Article Agricultural Engineering

Fruit detection in an apple orchard using a mobile terrestrial laser scanner

Jordi Gene-Mola et al.

BIOSYSTEMS ENGINEERING (2019)

Article Green & Sustainable Science & Technology

Soft Robotics as an Enabling Technology for Agroforestry Practice and Research

Girish Chowdhary et al.

SUSTAINABILITY (2019)

Article Computer Science, Information Systems

Cucumber Fruits Detection in Greenhouses Based on Instance Segmentation

Xiaoyang Liu et al.

IEEE ACCESS (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Improving Local Trajectory Optimisation using Probabilistic Movement Primitives

R. B. Ashith Shyam et al.

2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2019)

Article Computer Science, Information Systems

Fruit Localization and Environment Perception for Strawberry Harvesting Robots

Yuanyue Ge et al.

IEEE ACCESS (2019)

Review Automation & Control Systems

Survey of optimal motion planning

Yajue Yang et al.

IET CYBER-SYSTEMS AND ROBOTICS (2019)

Proceedings Paper Automation & Control Systems

Deep Orange: Mask R-CNN based Orange Detection and Segmentation

P. Ganesh et al.

IFAC PAPERSONLINE (2019)

Proceedings Paper Automation & Control Systems

Instance Segmentation and Localization of Strawberries in Farm Conditions for Automatic Fruit Harvesting

Yuanyue Ge et al.

IFAC PAPERSONLINE (2019)

Proceedings Paper Computer Science, Theory & Methods

Automatic prediction of brix and acidity in stages of ripeness of strawberries using image processing techniques

Wanhyun Cho et al.

2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019) (2019)

Article Agricultural Engineering

A simple and efficient method for automatic strawberry shape and size estimation and classification

Lin Mar Oo et al.

BIOSYSTEMS ENGINEERING (2018)

Article Agriculture, Multidisciplinary

Visual positioning technology of picking robots for dynamic litchi clusters with disturbance

Juntao Xiong et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2018)

Article Automation & Control Systems

Robot learning from demonstrations: Emulation learning in environments with moving obstacles

Amir M. E. Ghalamzan et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2018)

Article Agricultural Engineering

Design and test of robotic harvesting system for cherry tomato

Qingchun Feng et al.

INTERNATIONAL JOURNAL OF AGRICULTURAL AND BIOLOGICAL ENGINEERING (2018)

Article Computer Science, Artificial Intelligence

Using probabilistic movement primitives in robotics

Alexandros Paraschos et al.

AUTONOMOUS ROBOTS (2018)

Article Computer Science, Information Systems

Deep Learning Based Improved Classification System for Designing Tomato Harvesting Robot

Li Zhang et al.

IEEE ACCESS (2018)

Article Robotics

Performance Evaluation of a Harvesting Robot for Sweet Pepper

C. Wouter Bac et al.

JOURNAL OF FIELD ROBOTICS (2017)

Article Robotics

Design, integration, and field evaluation of a robotic apple harvester

Abhisesh Silwal et al.

JOURNAL OF FIELD ROBOTICS (2017)

Article Chemistry, Analytical

On-Tree Mango Fruit Size Estimation Using RGB-D Images

Zhenglin Wang et al.

SENSORS (2017)

Article Chemistry, Analytical

Deep Count: Fruit Counting Based on Deep Simulated Learning

Maryam Rahnemoonfar et al.

SENSORS (2017)

Article Agricultural Engineering

Development of a tomato harvesting robot used in greenhouse

Wang Lili et al.

INTERNATIONAL JOURNAL OF AGRICULTURAL AND BIOLOGICAL ENGINEERING (2017)

Article Agriculture, Multidisciplinary

Real-time segmentation of strawberry flesh and calyx from images of singulated strawberries during postharvest processing

A. Durand-Petiteville et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2017)

Article Agriculture, Multidisciplinary

Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking

Tao Yongting et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2017)

Article Computer Science, Theory & Methods

Imitation Learning: A Survey of Learning Methods

Ahmed Hussein et al.

ACM COMPUTING SURVEYS (2017)

Article Robotics

Autonomous Sweet Pepper Harvesting for Protected Cropping Systems

Christopher Lehnert et al.

IEEE ROBOTICS AND AUTOMATION LETTERS (2017)

Proceedings Paper Automation & Control Systems

Towards Automated Strawberry Harvesting: Identifying the Picking Point

Zhuoling Huang et al.

TOWARDS AUTONOMOUS ROBOTIC SYSTEMS (TAROS 2017) (2017)

Article Agricultural Engineering

Analysis of a motion planning problem for sweet-pepper harvesting in a dense obstacle environment

C. Wouter Bac et al.

BIOSYSTEMS ENGINEERING (2016)

Article Agricultural Engineering

Localisation of litchi in an unstructured environment using binocular stereo vision

Chenglin Wang et al.

BIOSYSTEMS ENGINEERING (2016)

Review Agriculture, Multidisciplinary

A review of key techniques of vision-based control for harvesting robot

Yuanshen Zhao et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2016)

Article Engineering, Chemical

Hyperspectral imaging analysis for ripeness evaluation of strawberry with support vector machine

Chu Zhang et al.

JOURNAL OF FOOD ENGINEERING (2016)

Article Chemistry, Analytical

DeepFruits: A Fruit Detection System Using Deep Neural Networks

Inkyu Sa et al.

SENSORS (2016)

Proceedings Paper Automation & Control Systems

Dual-arm Robot Design and Testing for Harvesting Tomato in Greenhouse

Yuanshen Zhao et al.

IFAC PAPERSONLINE (2016)

Proceedings Paper Behavioral Sciences

The effect of manual harvesting of fruit on the health of workers and the quality of the obtained produce

Malgorzata Mlotek et al.

6TH INTERNATIONAL CONFERENCE ON APPLIED HUMAN FACTORS AND ERGONOMICS (AHFE 2015) AND THE AFFILIATED CONFERENCES, AHFE 2015 (2015)

Article Robotics

Motion planning with sequential convex optimization and convex collision checking

John Schulman et al.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2014)

Review Agriculture, Multidisciplinary

Development of a Stationary Robotic Strawberry Harvester with a Picking Mechanism that Approaches the Target Fruit from Below

Satoshi Yamamoto et al.

JARQ-JAPAN AGRICULTURAL RESEARCH QUARTERLY (2014)

Article Agriculture, Multidisciplinary

Field Operation of a Movable Strawberry-harvesting Robot using a Travel Platform

Shigehiko Hayashi et al.

JARQ-JAPAN AGRICULTURAL RESEARCH QUARTERLY (2014)

Review Computer Science, Information Systems

Sampling-Based Robot Motion Planning: A Review

Mohamed Elbanhawi et al.

IEEE ACCESS (2014)

Article Agriculture, Multidisciplinary

Robust pixel-based classification of obstacles for robotic harvesting of sweet-pepper

C. W. Bac et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2013)

Article Chemistry, Analytical

Study on Cartesian-Type Strawberry-Harvesting Robot

Y. Cui et al.

SENSOR LETTERS (2013)

Article Computer Science, Artificial Intelligence

A Planning Framework for Non-Prehensile Manipulation under Clutter and Uncertainty

Mehmet R. Dogar et al.

AUTONOMOUS ROBOTS (2012)

Article Computer Science, Artificial Intelligence

Virtual manipulator-based binocular stereo vision positioning system and errors modelling

Xiangjun Zou et al.

MACHINE VISION AND APPLICATIONS (2012)

Article Robotics

Fruit Detachment and Classification Method for Strawberry Harvesting Robot

Guo Feng et al.

International Journal of Advanced Robotic Systems (2012)

Article Agricultural Engineering

Design and control of an apple harvesting robot

Zhao De-An et al.

BIOSYSTEMS ENGINEERING (2011)

Article Agricultural Engineering

Evaluation of a strawberry-harvesting robot in a field test

Shigehiko Hayashi et al.

BIOSYSTEMS ENGINEERING (2010)

Article Agriculture, Multidisciplinary

Automated strawberry grading system based on image processing

Xu Liming et al.

COMPUTERS AND ELECTRONICS IN AGRICULTURE (2010)

Article Engineering, Industrial

A prototype of an orange picking robot: past history, the new robot and experimental results

G Muscato et al.

INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION (2005)

Article Agricultural Engineering

Collision-free motion planning for a cucumber picking robot

EJ Van Henten et al.

BIOSYSTEMS ENGINEERING (2003)

Article Agricultural Engineering

Field test of an autonomous cucumber picking robot

EJ Van Henten et al.

BIOSYSTEMS ENGINEERING (2003)

Article Computer Science, Artificial Intelligence

An autonomous robot for harvesting cucumbers in greenhouses

EJ van Henten et al.

AUTONOMOUS ROBOTS (2002)

Article Agriculture, Multidisciplinary

Robotic harvesting system for eggplants

S Hayashi et al.

JARQ-JAPAN AGRICULTURAL RESEARCH QUARTERLY (2002)

Article Computer Science, Artificial Intelligence

Localization of spherical fruits for robotic harvesting

A Plebe et al.

MACHINE VISION AND APPLICATIONS (2001)

Article Agricultural Engineering

Automatic mushroom harvester development

JN Reed et al.

JOURNAL OF AGRICULTURAL ENGINEERING RESEARCH (2001)