Deep Learning for Mango (<i>Mangifera indica</i>) Panicle Stage Classification

Automated assessment of the number of panicles by developmental stage can provide information on the time spread of flowering and thus inform farm management. A pixel-based segmentation method for the estimation of flowering level from tree images was confounded by the developmental stage. Therefore...

Full description

Bibliographic Details
Main Authors: Anand Koirala, Kerry B. Walsh, Zhenglin Wang, Nicholas Anderson
Format: Article
Language:English
Published: MDPI AG 2020-01-01
Series:Agronomy
Subjects:
Online Access:https://www.mdpi.com/2073-4395/10/1/143
Description
Summary:Automated assessment of the number of panicles by developmental stage can provide information on the time spread of flowering and thus inform farm management. A pixel-based segmentation method for the estimation of flowering level from tree images was confounded by the developmental stage. Therefore, the use of a single and a two-stage deep learning framework (YOLO and <i>R</i><sup>2</sup>CNN) was considered, using either upright or rotated bounding boxes. For a validation image set and for a total panicle count, the models MangoYOLO(-upright), MangoYOLO-rotated, YOLOv3-rotated, <i>R</i><sup>2</sup>CNN(-rotated) and <i>R</i><sup>2</sup>CNN-upright achieved weighted <i>F1</i> scores of 76.5, 76.1, 74.9, 74.0 and 82.0, respectively. For a test set of the images of another cultivar and using a different camera, the <i>R</i><sup>2</sup> for machine vision to human count of panicles per tree was 0.86, 0.80, 0.83, 0.81 and 0.76 for the same models, respectively. Thus, there was no consistent benefit from the use of rotated over the use of upright bounding boxes. The YOLOv3-rotated model was superior in terms of total panicle count, and the <i>R</i><sup>2</sup>CNN-upright model was more accurate for panicle stage classification. To demonstrate practical application, panicle counts were made weekly for an orchard of 994 trees, with a peak detection routine applied to document multiple flowering events.
ISSN:2073-4395