An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
The capsule network (Caps) is a novel type of neural network that has great potential for the classification of hyperspectral remote sensing. However, the Caps suffers from the issue of gradient vanishing. To solve this problem, a powered activation regularization based adaptive capsule network (PAR...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-06-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | https://www.mdpi.com/2072-4292/13/13/2445 |
id |
doaj-aae52da871ab4532a95c07d4a86c7408 |
---|---|
record_format |
Article |
spelling |
doaj-aae52da871ab4532a95c07d4a86c74082021-07-15T15:44:05ZengMDPI AGRemote Sensing2072-42922021-06-01132445244510.3390/rs13132445An Adaptive Capsule Network for Hyperspectral Remote Sensing ClassificationXiaohui Ding0Yong Li1Ji Yang2Huapeng Li3Lingjia Liu4Yangxiaoyue Liu5Ce Zhang6Guangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaGuangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaGuangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaNortheast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun 130102, ChinaSchool of Geography and Environment, Jiangxi Normal University, Nanchang 330027, ChinaGuangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaLancaster Environment Centre, Lancaster University, Lancaster LA1 4YQ, UKThe capsule network (Caps) is a novel type of neural network that has great potential for the classification of hyperspectral remote sensing. However, the Caps suffers from the issue of gradient vanishing. To solve this problem, a powered activation regularization based adaptive capsule network (PAR-ACaps) was proposed for hyperspectral remote sensing classification, in which an adaptive routing algorithm without iteration was applied to amplify the gradient, and the powered activation regularization method was used to learn the sparser and more discriminative representation. The classification performance of PAR-ACaps was evaluated using two public hyperspectral remote sensing datasets, i.e., the Pavia University (PU) and Salinas (SA) datasets. The average overall classification accuracy (OA) of PAR-ACaps with shallower architecture was measured and compared with those of the benchmarks, including random forest (RF), support vector machine (SVM), 1-dimensional convolutional neural network (1DCNN), two-dimensional convolutional neural network (CNN), three-dimensional convolutional neural network (3DCNN), Caps, and the original adaptive capsule network (ACaps) with comparable network architectures. The OA of PAR-ACaps for PU and SA datasets was 99.51% and 94.52%, respectively, which was higher than those of benchmarks. Moreover, the classification performance of PAR-ACaps with relatively deeper neural architecture (four and six convolutional layers in the feature extraction stage) was also evaluated to demonstrate the effectiveness of gradient amplification. As shown in the experimental results, the classification performance of PAR-ACaps with relatively deeper neural architecture for PU and SA datasets was also superior to 1DCNN, CNN, 3DCNN, Caps, and ACaps with comparable neural architectures. Additionally, the training time consumed by PAR-ACaps was significantly lower than that of Caps. The proposed PAR-ACaps is, therefore, recommended as an effective alternative for hyperspectral remote sensing classification.https://www.mdpi.com/2072-4292/13/13/2445capsule networkhyperspectral remote sensingadaptive routing algorithmdeep learning |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Xiaohui Ding Yong Li Ji Yang Huapeng Li Lingjia Liu Yangxiaoyue Liu Ce Zhang |
spellingShingle |
Xiaohui Ding Yong Li Ji Yang Huapeng Li Lingjia Liu Yangxiaoyue Liu Ce Zhang An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification Remote Sensing capsule network hyperspectral remote sensing adaptive routing algorithm deep learning |
author_facet |
Xiaohui Ding Yong Li Ji Yang Huapeng Li Lingjia Liu Yangxiaoyue Liu Ce Zhang |
author_sort |
Xiaohui Ding |
title |
An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification |
title_short |
An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification |
title_full |
An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification |
title_fullStr |
An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification |
title_full_unstemmed |
An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification |
title_sort |
adaptive capsule network for hyperspectral remote sensing classification |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2021-06-01 |
description |
The capsule network (Caps) is a novel type of neural network that has great potential for the classification of hyperspectral remote sensing. However, the Caps suffers from the issue of gradient vanishing. To solve this problem, a powered activation regularization based adaptive capsule network (PAR-ACaps) was proposed for hyperspectral remote sensing classification, in which an adaptive routing algorithm without iteration was applied to amplify the gradient, and the powered activation regularization method was used to learn the sparser and more discriminative representation. The classification performance of PAR-ACaps was evaluated using two public hyperspectral remote sensing datasets, i.e., the Pavia University (PU) and Salinas (SA) datasets. The average overall classification accuracy (OA) of PAR-ACaps with shallower architecture was measured and compared with those of the benchmarks, including random forest (RF), support vector machine (SVM), 1-dimensional convolutional neural network (1DCNN), two-dimensional convolutional neural network (CNN), three-dimensional convolutional neural network (3DCNN), Caps, and the original adaptive capsule network (ACaps) with comparable network architectures. The OA of PAR-ACaps for PU and SA datasets was 99.51% and 94.52%, respectively, which was higher than those of benchmarks. Moreover, the classification performance of PAR-ACaps with relatively deeper neural architecture (four and six convolutional layers in the feature extraction stage) was also evaluated to demonstrate the effectiveness of gradient amplification. As shown in the experimental results, the classification performance of PAR-ACaps with relatively deeper neural architecture for PU and SA datasets was also superior to 1DCNN, CNN, 3DCNN, Caps, and ACaps with comparable neural architectures. Additionally, the training time consumed by PAR-ACaps was significantly lower than that of Caps. The proposed PAR-ACaps is, therefore, recommended as an effective alternative for hyperspectral remote sensing classification. |
topic |
capsule network hyperspectral remote sensing adaptive routing algorithm deep learning |
url |
https://www.mdpi.com/2072-4292/13/13/2445 |
work_keys_str_mv |
AT xiaohuiding anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT yongli anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT jiyang anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT huapengli anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT lingjialiu anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT yangxiaoyueliu anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT cezhang anadaptivecapsulenetworkforhyperspectralremotesensingclassification AT xiaohuiding adaptivecapsulenetworkforhyperspectralremotesensingclassification AT yongli adaptivecapsulenetworkforhyperspectralremotesensingclassification AT jiyang adaptivecapsulenetworkforhyperspectralremotesensingclassification AT huapengli adaptivecapsulenetworkforhyperspectralremotesensingclassification AT lingjialiu adaptivecapsulenetworkforhyperspectralremotesensingclassification AT yangxiaoyueliu adaptivecapsulenetworkforhyperspectralremotesensingclassification AT cezhang adaptivecapsulenetworkforhyperspectralremotesensingclassification |
_version_ |
1721298668223463424 |