ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images

Locusts are agricultural pests found in many parts of the world. Developing efficient and accurate locust information acquisition techniques helps in understanding the relation between locust distribution density and structural changes in locust communities. It also helps in understanding the hydrot...

Full description

Bibliographic Details
Main Authors: Sijing Ye, Shuhan Lu, Xuesong Bai, Jinfeng Gu
Format: Article
Language:English
Published: MDPI AG 2020-07-01
Series:Insects
Subjects:
CNN
Online Access:https://www.mdpi.com/2075-4450/11/8/458
id doaj-9d535f089f7943fd99f9c410d92c1daa
record_format Article
spelling doaj-9d535f089f7943fd99f9c410d92c1daa2020-11-25T03:02:15ZengMDPI AGInsects2075-44502020-07-011145845810.3390/insects11080458ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB ImagesSijing Ye0Shuhan Lu1Xuesong Bai2Jinfeng Gu3State Key Laboratory of Earth Surface Processes and Resource Ecology, Beijing Normal University, Beijing 100875, ChinaMaster of Health Informatics, School of Information, University of Michigan, Ann Arbor, MI 48109, USAKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Agricultural Land Quality (Beijing) Ministry of Land and Resources, China Agricultural University, Beijing 100083, ChinaLocusts are agricultural pests found in many parts of the world. Developing efficient and accurate locust information acquisition techniques helps in understanding the relation between locust distribution density and structural changes in locust communities. It also helps in understanding the hydrothermal and vegetation growth conditions that affect locusts in their habitats in various parts of the world as well as in providing rapid and accurate warnings on locust plague outbreak. This study is a preliminary attempt to explore whether the batch normalization-based convolutional neural network (CNN) model can be applied used to perform automatic classification of East Asian migratory locust (AM locust), <i>Oxya chinensis</i> (rice locusts), and cotton locusts. In this paper, we present a way of applying the CNN technique to identify species and instars of locusts using the proposed ResNet-Locust-BN model. This model is based on the ResNet architecture and involves introduction of a BatchNorm function before each convolution layer to improve the network’s stability, convergence speed, and classification accuracy. Subsequently, locust image data collected in the field were used as input to train the model. By performing comparison experiments of the activation function, initial learning rate, and batch size, we selected ReLU as the preferred activation function. The initial learning rate and batch size were set to 0.1 and 32, respectively. Experiments performed to evaluate the accuracy of the proposed ResNet-Locust-BN model show that the model can effectively distinguish AM locust from rice locusts (93.60% accuracy) and cotton locusts (97.80% accuracy). The model also performed well in identifying the growth status information of AM locusts (third-instar (77.20% accuracy), fifth-instar (88.40% accuracy), and adult (93.80% accuracy)) with an overall accuracy of 90.16%. This is higher than the accuracy scores obtained by using other typical models: AlexNet (73.68%), GoogLeNet (69.12%), ResNet 18 (67.60%), ResNet 50 (80.84%), and VggNet (81.70%). Further, the model has good robustness and fast convergence rate.https://www.mdpi.com/2075-4450/11/8/458locustgrasshoppermonitoring and forecastingimage processingdeep learningCNN
collection DOAJ
language English
format Article
sources DOAJ
author Sijing Ye
Shuhan Lu
Xuesong Bai
Jinfeng Gu
spellingShingle Sijing Ye
Shuhan Lu
Xuesong Bai
Jinfeng Gu
ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images
Insects
locust
grasshopper
monitoring and forecasting
image processing
deep learning
CNN
author_facet Sijing Ye
Shuhan Lu
Xuesong Bai
Jinfeng Gu
author_sort Sijing Ye
title ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images
title_short ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images
title_full ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images
title_fullStr ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images
title_full_unstemmed ResNet-Locust-BN Network-Based Automatic Identification of East Asian Migratory Locust Species and Instars from RGB Images
title_sort resnet-locust-bn network-based automatic identification of east asian migratory locust species and instars from rgb images
publisher MDPI AG
series Insects
issn 2075-4450
publishDate 2020-07-01
description Locusts are agricultural pests found in many parts of the world. Developing efficient and accurate locust information acquisition techniques helps in understanding the relation between locust distribution density and structural changes in locust communities. It also helps in understanding the hydrothermal and vegetation growth conditions that affect locusts in their habitats in various parts of the world as well as in providing rapid and accurate warnings on locust plague outbreak. This study is a preliminary attempt to explore whether the batch normalization-based convolutional neural network (CNN) model can be applied used to perform automatic classification of East Asian migratory locust (AM locust), <i>Oxya chinensis</i> (rice locusts), and cotton locusts. In this paper, we present a way of applying the CNN technique to identify species and instars of locusts using the proposed ResNet-Locust-BN model. This model is based on the ResNet architecture and involves introduction of a BatchNorm function before each convolution layer to improve the network’s stability, convergence speed, and classification accuracy. Subsequently, locust image data collected in the field were used as input to train the model. By performing comparison experiments of the activation function, initial learning rate, and batch size, we selected ReLU as the preferred activation function. The initial learning rate and batch size were set to 0.1 and 32, respectively. Experiments performed to evaluate the accuracy of the proposed ResNet-Locust-BN model show that the model can effectively distinguish AM locust from rice locusts (93.60% accuracy) and cotton locusts (97.80% accuracy). The model also performed well in identifying the growth status information of AM locusts (third-instar (77.20% accuracy), fifth-instar (88.40% accuracy), and adult (93.80% accuracy)) with an overall accuracy of 90.16%. This is higher than the accuracy scores obtained by using other typical models: AlexNet (73.68%), GoogLeNet (69.12%), ResNet 18 (67.60%), ResNet 50 (80.84%), and VggNet (81.70%). Further, the model has good robustness and fast convergence rate.
topic locust
grasshopper
monitoring and forecasting
image processing
deep learning
CNN
url https://www.mdpi.com/2075-4450/11/8/458
work_keys_str_mv AT sijingye resnetlocustbnnetworkbasedautomaticidentificationofeastasianmigratorylocustspeciesandinstarsfromrgbimages
AT shuhanlu resnetlocustbnnetworkbasedautomaticidentificationofeastasianmigratorylocustspeciesandinstarsfromrgbimages
AT xuesongbai resnetlocustbnnetworkbasedautomaticidentificationofeastasianmigratorylocustspeciesandinstarsfromrgbimages
AT jinfenggu resnetlocustbnnetworkbasedautomaticidentificationofeastasianmigratorylocustspeciesandinstarsfromrgbimages
_version_ 1724690644939571200