An Autonomous Fruit and Vegetable Harvester with a Low-Cost Gripper Using a 3D Sensor

• Main Authors: Tan Zhang, Zhenhai Huang, Weijie You, Jiatao Lin, Xiaolong Tang, Hui Huang
• Format: Article
• Language: English
• Published: MDPI AG 2019-12-01
• Series: Sensors
• Subjects: harvesting robot; gripper; segmentation; cutting point detection
• Online Access: https://www.mdpi.com/1424-8220/20/1/93
• ISSN: 1424-8220

Reliable and robust systems to detect and harvest fruits and vegetables in unstructured environments are crucial for harvesting robots. In this paper, we propose an autonomous system that harvests most types of crops with peduncles. A geometric approach is first applied to obtain the cutting points of the peduncle based on the fruit bounding box, for which we have adapted the model of the state-of-the-art object detector named Mask Region-based Convolutional Neural Network (Mask R-CNN). We designed a novel gripper that simultaneously clamps and cuts the peduncles of crops without contacting the flesh. We have conducted experiments with a robotic manipulator to evaluate the effectiveness of the proposed harvesting system in being able to efficiently harvest most crops in real laboratory environments.