Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices

Wheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat var...

Full description

Bibliographic Details
Main Authors: Zhiwen Mi, Xudong Zhang, Jinya Su, Dejun Han, Baofeng Su
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-09-01
Series:Frontiers in Plant Science
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpls.2020.558126/full
id doaj-8826f711cbe143d98993638b76b549fa
record_format Article
spelling doaj-8826f711cbe143d98993638b76b549fa2020-11-25T03:46:46ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2020-09-011110.3389/fpls.2020.558126558126Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile DevicesZhiwen Mi0Zhiwen Mi1Zhiwen Mi2Xudong Zhang3Xudong Zhang4Xudong Zhang5Jinya Su6Dejun Han7Baofeng Su8Baofeng Su9Baofeng Su10College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, ChinaKey Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, ChinaShaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, ChinaCollege of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, ChinaKey Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, ChinaShaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, ChinaSchool of Computer Science and Electronic Engineering, University of Essex, Colchester, United KingdomState Key Laboratory of Crop Stress Biology for Arid Areas and College of Plant Protection, Northwest A&F University, Yangling, ChinaCollege of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, ChinaKey Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, ChinaShaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, ChinaWheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat varieties. Manual inspection is time-consuming, labor-intensive and prone to human errors, therefore, there is a clearly urgent need to develop more effective and efficient disease grading strategy by using automated approaches. However, the differences between wheat leaves of different levels of stripe rust infection are usually tiny and subtle, and, as a result, ordinary deep learning networks fail to achieve satisfying performance. By formulating this challenge as a fine-grained image classification problem, this study proposes a novel deep learning network C-DenseNet which embeds Convolutional Block Attention Module (CBAM) in the densely connected convolutional network (DenseNet). The performance of C-DenseNet and its variants is demonstrated via a newly collected wheat stripe rust grading dataset (WSRgrading dataset) at Northwest A&F University, Shaanxi Province, China, which contains a total of 5,242 wheat leaf images with 6 levels of stripe rust infection. The dataset was collected by using various mobile devices in the natural field condition. Comparative experiments show that C-DenseNet with a test accuracy of 97.99% outperforms the classical DenseNet (92.53%) and ResNet (73.43%). GradCAM++ network visualization also shows that C-DenseNet is able to pay more attention to the key areas in making the decision. It is concluded that C-DenseNet with an attention mechanism is suitable for wheat stripe rust disease grading in field conditions.https://www.frontiersin.org/article/10.3389/fpls.2020.558126/fullwheat stripe rustdisease gradingCBAM moduleC-DenseNetattention mechanism
collection DOAJ
language English
format Article
sources DOAJ
author Zhiwen Mi
Zhiwen Mi
Zhiwen Mi
Xudong Zhang
Xudong Zhang
Xudong Zhang
Jinya Su
Dejun Han
Baofeng Su
Baofeng Su
Baofeng Su
spellingShingle Zhiwen Mi
Zhiwen Mi
Zhiwen Mi
Xudong Zhang
Xudong Zhang
Xudong Zhang
Jinya Su
Dejun Han
Baofeng Su
Baofeng Su
Baofeng Su
Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
Frontiers in Plant Science
wheat stripe rust
disease grading
CBAM module
C-DenseNet
attention mechanism
author_facet Zhiwen Mi
Zhiwen Mi
Zhiwen Mi
Xudong Zhang
Xudong Zhang
Xudong Zhang
Jinya Su
Dejun Han
Baofeng Su
Baofeng Su
Baofeng Su
author_sort Zhiwen Mi
title Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
title_short Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
title_full Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
title_fullStr Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
title_full_unstemmed Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
title_sort wheat stripe rust grading by deep learning with attention mechanism and images from mobile devices
publisher Frontiers Media S.A.
series Frontiers in Plant Science
issn 1664-462X
publishDate 2020-09-01
description Wheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat varieties. Manual inspection is time-consuming, labor-intensive and prone to human errors, therefore, there is a clearly urgent need to develop more effective and efficient disease grading strategy by using automated approaches. However, the differences between wheat leaves of different levels of stripe rust infection are usually tiny and subtle, and, as a result, ordinary deep learning networks fail to achieve satisfying performance. By formulating this challenge as a fine-grained image classification problem, this study proposes a novel deep learning network C-DenseNet which embeds Convolutional Block Attention Module (CBAM) in the densely connected convolutional network (DenseNet). The performance of C-DenseNet and its variants is demonstrated via a newly collected wheat stripe rust grading dataset (WSRgrading dataset) at Northwest A&F University, Shaanxi Province, China, which contains a total of 5,242 wheat leaf images with 6 levels of stripe rust infection. The dataset was collected by using various mobile devices in the natural field condition. Comparative experiments show that C-DenseNet with a test accuracy of 97.99% outperforms the classical DenseNet (92.53%) and ResNet (73.43%). GradCAM++ network visualization also shows that C-DenseNet is able to pay more attention to the key areas in making the decision. It is concluded that C-DenseNet with an attention mechanism is suitable for wheat stripe rust disease grading in field conditions.
topic wheat stripe rust
disease grading
CBAM module
C-DenseNet
attention mechanism
url https://www.frontiersin.org/article/10.3389/fpls.2020.558126/full
work_keys_str_mv AT zhiwenmi wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT zhiwenmi wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT zhiwenmi wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT xudongzhang wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT xudongzhang wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT xudongzhang wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT jinyasu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT dejunhan wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT baofengsu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT baofengsu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
AT baofengsu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices
_version_ 1724504301903020032