An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification

The capsule network (Caps) is a novel type of neural network that has great potential for the classification of hyperspectral remote sensing. However, the Caps suffers from the issue of gradient vanishing. To solve this problem, a powered activation regularization based adaptive capsule network (PAR...

Full description

Bibliographic Details
Main Authors: Xiaohui Ding, Yong Li, Ji Yang, Huapeng Li, Lingjia Liu, Yangxiaoyue Liu, Ce Zhang
Format: Article
Language:English
Published: MDPI AG 2021-06-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/13/2445
id doaj-aae52da871ab4532a95c07d4a86c7408
record_format Article
spelling doaj-aae52da871ab4532a95c07d4a86c74082021-07-15T15:44:05ZengMDPI AGRemote Sensing2072-42922021-06-01132445244510.3390/rs13132445An Adaptive Capsule Network for Hyperspectral Remote Sensing ClassificationXiaohui Ding0Yong Li1Ji Yang2Huapeng Li3Lingjia Liu4Yangxiaoyue Liu5Ce Zhang6Guangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaGuangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaGuangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaNortheast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun 130102, ChinaSchool of Geography and Environment, Jiangxi Normal University, Nanchang 330027, ChinaGuangzhou Institute of Geography, Guangdong Academy of Sciences, Guangzhou 510070, ChinaLancaster Environment Centre, Lancaster University, Lancaster LA1 4YQ, UKThe capsule network (Caps) is a novel type of neural network that has great potential for the classification of hyperspectral remote sensing. However, the Caps suffers from the issue of gradient vanishing. To solve this problem, a powered activation regularization based adaptive capsule network (PAR-ACaps) was proposed for hyperspectral remote sensing classification, in which an adaptive routing algorithm without iteration was applied to amplify the gradient, and the powered activation regularization method was used to learn the sparser and more discriminative representation. The classification performance of PAR-ACaps was evaluated using two public hyperspectral remote sensing datasets, i.e., the Pavia University (PU) and Salinas (SA) datasets. The average overall classification accuracy (OA) of PAR-ACaps with shallower architecture was measured and compared with those of the benchmarks, including random forest (RF), support vector machine (SVM), 1-dimensional convolutional neural network (1DCNN), two-dimensional convolutional neural network (CNN), three-dimensional convolutional neural network (3DCNN), Caps, and the original adaptive capsule network (ACaps) with comparable network architectures. The OA of PAR-ACaps for PU and SA datasets was 99.51% and 94.52%, respectively, which was higher than those of benchmarks. Moreover, the classification performance of PAR-ACaps with relatively deeper neural architecture (four and six convolutional layers in the feature extraction stage) was also evaluated to demonstrate the effectiveness of gradient amplification. As shown in the experimental results, the classification performance of PAR-ACaps with relatively deeper neural architecture for PU and SA datasets was also superior to 1DCNN, CNN, 3DCNN, Caps, and ACaps with comparable neural architectures. Additionally, the training time consumed by PAR-ACaps was significantly lower than that of Caps. The proposed PAR-ACaps is, therefore, recommended as an effective alternative for hyperspectral remote sensing classification.https://www.mdpi.com/2072-4292/13/13/2445capsule networkhyperspectral remote sensingadaptive routing algorithmdeep learning
collection DOAJ
language English
format Article
sources DOAJ
author Xiaohui Ding
Yong Li
Ji Yang
Huapeng Li
Lingjia Liu
Yangxiaoyue Liu
Ce Zhang
spellingShingle Xiaohui Ding
Yong Li
Ji Yang
Huapeng Li
Lingjia Liu
Yangxiaoyue Liu
Ce Zhang
An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
Remote Sensing
capsule network
hyperspectral remote sensing
adaptive routing algorithm
deep learning
author_facet Xiaohui Ding
Yong Li
Ji Yang
Huapeng Li
Lingjia Liu
Yangxiaoyue Liu
Ce Zhang
author_sort Xiaohui Ding
title An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
title_short An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
title_full An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
title_fullStr An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
title_full_unstemmed An Adaptive Capsule Network for Hyperspectral Remote Sensing Classification
title_sort adaptive capsule network for hyperspectral remote sensing classification
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2021-06-01
description The capsule network (Caps) is a novel type of neural network that has great potential for the classification of hyperspectral remote sensing. However, the Caps suffers from the issue of gradient vanishing. To solve this problem, a powered activation regularization based adaptive capsule network (PAR-ACaps) was proposed for hyperspectral remote sensing classification, in which an adaptive routing algorithm without iteration was applied to amplify the gradient, and the powered activation regularization method was used to learn the sparser and more discriminative representation. The classification performance of PAR-ACaps was evaluated using two public hyperspectral remote sensing datasets, i.e., the Pavia University (PU) and Salinas (SA) datasets. The average overall classification accuracy (OA) of PAR-ACaps with shallower architecture was measured and compared with those of the benchmarks, including random forest (RF), support vector machine (SVM), 1-dimensional convolutional neural network (1DCNN), two-dimensional convolutional neural network (CNN), three-dimensional convolutional neural network (3DCNN), Caps, and the original adaptive capsule network (ACaps) with comparable network architectures. The OA of PAR-ACaps for PU and SA datasets was 99.51% and 94.52%, respectively, which was higher than those of benchmarks. Moreover, the classification performance of PAR-ACaps with relatively deeper neural architecture (four and six convolutional layers in the feature extraction stage) was also evaluated to demonstrate the effectiveness of gradient amplification. As shown in the experimental results, the classification performance of PAR-ACaps with relatively deeper neural architecture for PU and SA datasets was also superior to 1DCNN, CNN, 3DCNN, Caps, and ACaps with comparable neural architectures. Additionally, the training time consumed by PAR-ACaps was significantly lower than that of Caps. The proposed PAR-ACaps is, therefore, recommended as an effective alternative for hyperspectral remote sensing classification.
topic capsule network
hyperspectral remote sensing
adaptive routing algorithm
deep learning
url https://www.mdpi.com/2072-4292/13/13/2445
work_keys_str_mv AT xiaohuiding anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT yongli anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT jiyang anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT huapengli anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT lingjialiu anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT yangxiaoyueliu anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT cezhang anadaptivecapsulenetworkforhyperspectralremotesensingclassification
AT xiaohuiding adaptivecapsulenetworkforhyperspectralremotesensingclassification
AT yongli adaptivecapsulenetworkforhyperspectralremotesensingclassification
AT jiyang adaptivecapsulenetworkforhyperspectralremotesensingclassification
AT huapengli adaptivecapsulenetworkforhyperspectralremotesensingclassification
AT lingjialiu adaptivecapsulenetworkforhyperspectralremotesensingclassification
AT yangxiaoyueliu adaptivecapsulenetworkforhyperspectralremotesensingclassification
AT cezhang adaptivecapsulenetworkforhyperspectralremotesensingclassification
_version_ 1721298668223463424