Detection of Key Organs in Tomato Based on Deep Migration Learning in a Complex Background

• Main Authors: Jun Sun, Xiaofei He, Xiao Ge, Xiaohong Wu, Jifeng Shen, Yingying Song
• Format: Article
• Language: English
• Published: MDPI AG 2018-12-01
• Series: Agriculture
• Subjects: object detection; tomato organ; K-means clustering; Soft-NMS; migration learning; convolutional neural network; deep learning
• Online Access: https://www.mdpi.com/2077-0472/8/12/196

In the current natural environment, due to the complexity of the background and the high similarity of the color between immature green tomatoes and the plant, the occlusion of the key organs (flower and fruit) by the leaves and stems will lead to low recognition rates and poor generalizations of the detection model. Therefore, an improved tomato organ detection method based on convolutional neural network (CNN) has been proposed in this paper. Based on the original Faster R-CNN algorithm, Resnet-50 with residual blocks was used to replace the traditional vgg16 feature extraction network, and a K-means clustering method was used to adjust more appropriate anchor sizes than manual setting, to improve detection accuracy. The test results showed that the mean average precision (mAP) was significantly improved compared with the traditional Faster R-CNN model. The training model can be transplanted to the embedded system, which lays a theoretical foundation for the development of a precise targeting pesticide application system and an automatic picking device.