Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization

Fusion of hyperspectral and multispectral imagery data is utilized to reconstruct a super-resolution image with high spectral and spatial resolution, which plays a significant role in remote sensing image processing. Conversely, hyperspectral and multispectral data can be modeled as two low-dimensio...

Full description

Bibliographic Details
Main Authors: Feixia Yang, Ziliang Ping, Fei Ma, Yanwei Wang
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8937525/
id doaj-0803a6b9557847068494f6d3042d3fad
record_format Article
spelling doaj-0803a6b9557847068494f6d3042d3fad2021-03-29T23:14:36ZengIEEEIEEE Access2169-35362019-01-01718635218636310.1109/ACCESS.2019.29612408937525Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal RegularizationFeixia Yang0https://orcid.org/0000-0001-9400-7833Ziliang Ping1https://orcid.org/0000-0001-9511-5772Fei Ma2https://orcid.org/0000-0003-1280-034XYanwei Wang3https://orcid.org/0000-0002-0184-3179School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing, ChinaSchool of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing, ChinaSchool of Electronic and Information Engineering, Liaoning Technical University, Huludao, ChinaSchool of Electronic and Information Engineering, Liaoning Technical University, Huludao, ChinaFusion of hyperspectral and multispectral imagery data is utilized to reconstruct a super-resolution image with high spectral and spatial resolution, which plays a significant role in remote sensing image processing. Conversely, hyperspectral and multispectral data can be modeled as two low-dimensional subspaces by respectively spatially and spectrally degrading the desired image. A representative method is called coupled non-negative matrix factorization (CNMF) based on a Gaussian observation model, but it is an ill-posed inverse problem. In addition, from the perspective of matrix factorization, the matrixing process of hyperspectral and multispectral cube data generally results in the loss of structural information and performance degradation. To address these issues, this article proposes a proximal minimum-volume expression to regularize the convex simplex, enclosing all reconstructed image pixels instead of low-dimensional subspace data. Then, we incorporate sparse and proximal regularizers into the original CNMF to reformulate the fusion problem as a dynamical system via proximal alternating optimization. Finally, the alternating direction method of multipliers is adopted to split the variables for the closed-form solutions that are further reduced in computational complexity. The experimental results show that the proposed algorithm in this paper performs better than the state-of-the-art fusion methods in most cases, which verifies the effectiveness and efficiency of this proposed algorithm in yielding high-fidelity reconstructed images.https://ieeexplore.ieee.org/document/8937525/Proximal regularizationcoupled non-negative matrix factorizationdata fusionminimum volumealternating optimization
collection DOAJ
language English
format Article
sources DOAJ
author Feixia Yang
Ziliang Ping
Fei Ma
Yanwei Wang
spellingShingle Feixia Yang
Ziliang Ping
Fei Ma
Yanwei Wang
Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization
IEEE Access
Proximal regularization
coupled non-negative matrix factorization
data fusion
minimum volume
alternating optimization
author_facet Feixia Yang
Ziliang Ping
Fei Ma
Yanwei Wang
author_sort Feixia Yang
title Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization
title_short Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization
title_full Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization
title_fullStr Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization
title_full_unstemmed Fusion of Hyperspectral and Multispectral Images With Sparse and Proximal Regularization
title_sort fusion of hyperspectral and multispectral images with sparse and proximal regularization
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description Fusion of hyperspectral and multispectral imagery data is utilized to reconstruct a super-resolution image with high spectral and spatial resolution, which plays a significant role in remote sensing image processing. Conversely, hyperspectral and multispectral data can be modeled as two low-dimensional subspaces by respectively spatially and spectrally degrading the desired image. A representative method is called coupled non-negative matrix factorization (CNMF) based on a Gaussian observation model, but it is an ill-posed inverse problem. In addition, from the perspective of matrix factorization, the matrixing process of hyperspectral and multispectral cube data generally results in the loss of structural information and performance degradation. To address these issues, this article proposes a proximal minimum-volume expression to regularize the convex simplex, enclosing all reconstructed image pixels instead of low-dimensional subspace data. Then, we incorporate sparse and proximal regularizers into the original CNMF to reformulate the fusion problem as a dynamical system via proximal alternating optimization. Finally, the alternating direction method of multipliers is adopted to split the variables for the closed-form solutions that are further reduced in computational complexity. The experimental results show that the proposed algorithm in this paper performs better than the state-of-the-art fusion methods in most cases, which verifies the effectiveness and efficiency of this proposed algorithm in yielding high-fidelity reconstructed images.
topic Proximal regularization
coupled non-negative matrix factorization
data fusion
minimum volume
alternating optimization
url https://ieeexplore.ieee.org/document/8937525/
work_keys_str_mv AT feixiayang fusionofhyperspectralandmultispectralimageswithsparseandproximalregularization
AT ziliangping fusionofhyperspectralandmultispectralimageswithsparseandproximalregularization
AT feima fusionofhyperspectralandmultispectralimageswithsparseandproximalregularization
AT yanweiwang fusionofhyperspectralandmultispectralimageswithsparseandproximalregularization
_version_ 1724189833197256704