Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices
Wheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat var...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-09-01
|
Series: | Frontiers in Plant Science |
Subjects: | |
Online Access: | https://www.frontiersin.org/article/10.3389/fpls.2020.558126/full |
id |
doaj-8826f711cbe143d98993638b76b549fa |
---|---|
record_format |
Article |
spelling |
doaj-8826f711cbe143d98993638b76b549fa2020-11-25T03:46:46ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2020-09-011110.3389/fpls.2020.558126558126Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile DevicesZhiwen Mi0Zhiwen Mi1Zhiwen Mi2Xudong Zhang3Xudong Zhang4Xudong Zhang5Jinya Su6Dejun Han7Baofeng Su8Baofeng Su9Baofeng Su10College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, ChinaKey Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, ChinaShaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, ChinaCollege of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, ChinaKey Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, ChinaShaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, ChinaSchool of Computer Science and Electronic Engineering, University of Essex, Colchester, United KingdomState Key Laboratory of Crop Stress Biology for Arid Areas and College of Plant Protection, Northwest A&F University, Yangling, ChinaCollege of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, ChinaKey Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, ChinaShaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, ChinaWheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat varieties. Manual inspection is time-consuming, labor-intensive and prone to human errors, therefore, there is a clearly urgent need to develop more effective and efficient disease grading strategy by using automated approaches. However, the differences between wheat leaves of different levels of stripe rust infection are usually tiny and subtle, and, as a result, ordinary deep learning networks fail to achieve satisfying performance. By formulating this challenge as a fine-grained image classification problem, this study proposes a novel deep learning network C-DenseNet which embeds Convolutional Block Attention Module (CBAM) in the densely connected convolutional network (DenseNet). The performance of C-DenseNet and its variants is demonstrated via a newly collected wheat stripe rust grading dataset (WSRgrading dataset) at Northwest A&F University, Shaanxi Province, China, which contains a total of 5,242 wheat leaf images with 6 levels of stripe rust infection. The dataset was collected by using various mobile devices in the natural field condition. Comparative experiments show that C-DenseNet with a test accuracy of 97.99% outperforms the classical DenseNet (92.53%) and ResNet (73.43%). GradCAM++ network visualization also shows that C-DenseNet is able to pay more attention to the key areas in making the decision. It is concluded that C-DenseNet with an attention mechanism is suitable for wheat stripe rust disease grading in field conditions.https://www.frontiersin.org/article/10.3389/fpls.2020.558126/fullwheat stripe rustdisease gradingCBAM moduleC-DenseNetattention mechanism |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zhiwen Mi Zhiwen Mi Zhiwen Mi Xudong Zhang Xudong Zhang Xudong Zhang Jinya Su Dejun Han Baofeng Su Baofeng Su Baofeng Su |
spellingShingle |
Zhiwen Mi Zhiwen Mi Zhiwen Mi Xudong Zhang Xudong Zhang Xudong Zhang Jinya Su Dejun Han Baofeng Su Baofeng Su Baofeng Su Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices Frontiers in Plant Science wheat stripe rust disease grading CBAM module C-DenseNet attention mechanism |
author_facet |
Zhiwen Mi Zhiwen Mi Zhiwen Mi Xudong Zhang Xudong Zhang Xudong Zhang Jinya Su Dejun Han Baofeng Su Baofeng Su Baofeng Su |
author_sort |
Zhiwen Mi |
title |
Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices |
title_short |
Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices |
title_full |
Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices |
title_fullStr |
Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices |
title_full_unstemmed |
Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices |
title_sort |
wheat stripe rust grading by deep learning with attention mechanism and images from mobile devices |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Plant Science |
issn |
1664-462X |
publishDate |
2020-09-01 |
description |
Wheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat varieties. Manual inspection is time-consuming, labor-intensive and prone to human errors, therefore, there is a clearly urgent need to develop more effective and efficient disease grading strategy by using automated approaches. However, the differences between wheat leaves of different levels of stripe rust infection are usually tiny and subtle, and, as a result, ordinary deep learning networks fail to achieve satisfying performance. By formulating this challenge as a fine-grained image classification problem, this study proposes a novel deep learning network C-DenseNet which embeds Convolutional Block Attention Module (CBAM) in the densely connected convolutional network (DenseNet). The performance of C-DenseNet and its variants is demonstrated via a newly collected wheat stripe rust grading dataset (WSRgrading dataset) at Northwest A&F University, Shaanxi Province, China, which contains a total of 5,242 wheat leaf images with 6 levels of stripe rust infection. The dataset was collected by using various mobile devices in the natural field condition. Comparative experiments show that C-DenseNet with a test accuracy of 97.99% outperforms the classical DenseNet (92.53%) and ResNet (73.43%). GradCAM++ network visualization also shows that C-DenseNet is able to pay more attention to the key areas in making the decision. It is concluded that C-DenseNet with an attention mechanism is suitable for wheat stripe rust disease grading in field conditions. |
topic |
wheat stripe rust disease grading CBAM module C-DenseNet attention mechanism |
url |
https://www.frontiersin.org/article/10.3389/fpls.2020.558126/full |
work_keys_str_mv |
AT zhiwenmi wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT zhiwenmi wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT zhiwenmi wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT xudongzhang wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT xudongzhang wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT xudongzhang wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT jinyasu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT dejunhan wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT baofengsu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT baofengsu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices AT baofengsu wheatstriperustgradingbydeeplearningwithattentionmechanismandimagesfrommobiledevices |
_version_ |
1724504301903020032 |