SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA

In recent years, hyperspectral imaging, also known as imaging spectroscopy, has been paid an increasing interest in geoscience and remote sensing community. Hyperspectral imagery is characterized by very rich spectral information, which enables us to recognize the materials of interest lying on the...

Full description

Bibliographic Details
Main Authors: D. Hong, J. Yao, X. Wu, J. Chanussot, X. Zhu
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B3-2020/423/2020/isprs-archives-XLIII-B3-2020-423-2020.pdf
id doaj-9ef0f2b32721450fb2bf85f11b47a937
record_format Article
spelling doaj-9ef0f2b32721450fb2bf85f11b47a9372020-11-25T03:31:22ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B3-202042342810.5194/isprs-archives-XLIII-B3-2020-423-2020SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATAD. Hong0D. Hong1J. Yao2J. Yao3J. Yao4X. Wu5J. Chanussot6X. Zhu7X. Zhu8Remote Sensing Technology Institute (IMF), German Aerospace Center (DLR), 82234 Wessling, GermanyUniv. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, 38000 Grenoble, FranceRemote Sensing Technology Institute (IMF), German Aerospace Center (DLR), 82234 Wessling, GermanySignal Processing in Earth Observation (SiPEO), Technical University of Munich (TUM), 80333 Munich, GermanySchool of Mathematics and Statistics, Xi’an Jiaotong University, 710049 Xi’an, ChinaSchool of Information and Electronics, Beijing Institute of Technology (BIT), 100081 Beijing, ChinaUniv. Grenoble Alpes, INRIA, CNRS, Grenoble INP, GIPSA-lab, 38000 Grenoble, FranceRemote Sensing Technology Institute (IMF), German Aerospace Center (DLR), 82234 Wessling, GermanySignal Processing in Earth Observation (SiPEO), Technical University of Munich (TUM), 80333 Munich, GermanyIn recent years, hyperspectral imaging, also known as imaging spectroscopy, has been paid an increasing interest in geoscience and remote sensing community. Hyperspectral imagery is characterized by very rich spectral information, which enables us to recognize the materials of interest lying on the surface of the Earth more easier. We have to admit, however, that high spectral dimension inevitably brings some drawbacks, such as expensive data storage and transmission, information redundancy, etc. Therefore, to reduce the spectral dimensionality effectively and learn more discriminative spectral low-dimensional embedding, in this paper we propose a novel hyperspectral embedding approach by simultaneously considering spatial and spectral information, called spatial-spectral manifold embedding (SSME). Beyond the pixel-wise spectral embedding approaches, SSME models the spatial and spectral information jointly in a patch-based fashion. SSME not only learns the spectral embedding by using the adjacency matrix obtained by similarity measurement between spectral signatures, but also models the spatial neighbours of a target pixel in hyperspectral scene by sharing the same weights (or edges) in the process of learning embedding. Classification is explored as a potential strategy to quantitatively evaluate the performance of learned embedding representations. Classification is explored as a potential application for quantitatively evaluating the performance of these hyperspectral embedding algorithms. Extensive experiments conducted on the widely-used hyperspectral datasets demonstrate the superiority and effectiveness of the proposed SSME as compared to several state-of-the-art embedding methods.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B3-2020/423/2020/isprs-archives-XLIII-B3-2020-423-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author D. Hong
D. Hong
J. Yao
J. Yao
J. Yao
X. Wu
J. Chanussot
X. Zhu
X. Zhu
spellingShingle D. Hong
D. Hong
J. Yao
J. Yao
J. Yao
X. Wu
J. Chanussot
X. Zhu
X. Zhu
SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet D. Hong
D. Hong
J. Yao
J. Yao
J. Yao
X. Wu
J. Chanussot
X. Zhu
X. Zhu
author_sort D. Hong
title SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA
title_short SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA
title_full SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA
title_fullStr SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA
title_full_unstemmed SPATIAL-SPECTRAL MANIFOLD EMBEDDING OF HYPERSPECTRAL DATA
title_sort spatial-spectral manifold embedding of hyperspectral data
publisher Copernicus Publications
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 1682-1750
2194-9034
publishDate 2020-08-01
description In recent years, hyperspectral imaging, also known as imaging spectroscopy, has been paid an increasing interest in geoscience and remote sensing community. Hyperspectral imagery is characterized by very rich spectral information, which enables us to recognize the materials of interest lying on the surface of the Earth more easier. We have to admit, however, that high spectral dimension inevitably brings some drawbacks, such as expensive data storage and transmission, information redundancy, etc. Therefore, to reduce the spectral dimensionality effectively and learn more discriminative spectral low-dimensional embedding, in this paper we propose a novel hyperspectral embedding approach by simultaneously considering spatial and spectral information, called spatial-spectral manifold embedding (SSME). Beyond the pixel-wise spectral embedding approaches, SSME models the spatial and spectral information jointly in a patch-based fashion. SSME not only learns the spectral embedding by using the adjacency matrix obtained by similarity measurement between spectral signatures, but also models the spatial neighbours of a target pixel in hyperspectral scene by sharing the same weights (or edges) in the process of learning embedding. Classification is explored as a potential strategy to quantitatively evaluate the performance of learned embedding representations. Classification is explored as a potential application for quantitatively evaluating the performance of these hyperspectral embedding algorithms. Extensive experiments conducted on the widely-used hyperspectral datasets demonstrate the superiority and effectiveness of the proposed SSME as compared to several state-of-the-art embedding methods.
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B3-2020/423/2020/isprs-archives-XLIII-B3-2020-423-2020.pdf
work_keys_str_mv AT dhong spatialspectralmanifoldembeddingofhyperspectraldata
AT dhong spatialspectralmanifoldembeddingofhyperspectraldata
AT jyao spatialspectralmanifoldembeddingofhyperspectraldata
AT jyao spatialspectralmanifoldembeddingofhyperspectraldata
AT jyao spatialspectralmanifoldembeddingofhyperspectraldata
AT xwu spatialspectralmanifoldembeddingofhyperspectraldata
AT jchanussot spatialspectralmanifoldembeddingofhyperspectraldata
AT xzhu spatialspectralmanifoldembeddingofhyperspectraldata
AT xzhu spatialspectralmanifoldembeddingofhyperspectraldata
_version_ 1724572017393401856