Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module

With the advent of very-high-resolution remote sensing images, semantic change detection (SCD) based on deep learning has become a research hotspot in recent years. SCD aims to observe the change in the Earth’s land surface and plays a vital role in monitoring the ecological environment, land use an...

Full description

Bibliographic Details
Main Authors: Shao Xiang, Mi Wang, Xiaofan Jiang, Guangqi Xie, Zhiqi Zhang, Peng Tang
Format: Article
Language:English
Published: MDPI AG 2021-08-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/16/3336
id doaj-8987f11438c04360a5295f728a36be64
record_format Article
spelling doaj-8987f11438c04360a5295f728a36be642021-08-26T14:18:05ZengMDPI AGRemote Sensing2072-42922021-08-01133336333610.3390/rs13163336Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field ModuleShao Xiang0Mi Wang1Xiaofan Jiang2Guangqi Xie3Zhiqi Zhang4Peng Tang5State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaDepartment of Informatics, Technical University of Munich, 80333 Munchen, GermanyWith the advent of very-high-resolution remote sensing images, semantic change detection (SCD) based on deep learning has become a research hotspot in recent years. SCD aims to observe the change in the Earth’s land surface and plays a vital role in monitoring the ecological environment, land use and land cover. Existing research mainly focus on single-task semantic change detection; the problem they face is that existing methods are incapable of identifying which change type has occurred in each multi-temporal image. In addition, few methods use the binary change region to help train a deep SCD-based network. Hence, we propose a dual-task semantic change detection network (GCF-SCD-Net) by using the generative change field (GCF) module to locate and segment the change region; what is more, the proposed network is end-to-end trainable. In the meantime, because of the influence of the imbalance label, we propose a separable loss function to alleviate the over-fitting problem. Extensive experiments are conducted in this work to validate the performance of our method. Finally, our work achieves a 69.9% mIoU and 17.9 Sek on the SECOND dataset. Compared with traditional networks, GCF-SCD-Net achieves the best results and promising performances.https://www.mdpi.com/2072-4292/13/16/3336very-high-resolution remote sensing imagessemantic change detectiongenerative change fieldseparable loss
collection DOAJ
language English
format Article
sources DOAJ
author Shao Xiang
Mi Wang
Xiaofan Jiang
Guangqi Xie
Zhiqi Zhang
Peng Tang
spellingShingle Shao Xiang
Mi Wang
Xiaofan Jiang
Guangqi Xie
Zhiqi Zhang
Peng Tang
Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
Remote Sensing
very-high-resolution remote sensing images
semantic change detection
generative change field
separable loss
author_facet Shao Xiang
Mi Wang
Xiaofan Jiang
Guangqi Xie
Zhiqi Zhang
Peng Tang
author_sort Shao Xiang
title Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
title_short Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
title_full Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
title_fullStr Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
title_full_unstemmed Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
title_sort dual-task semantic change detection for remote sensing images using the generative change field module
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2021-08-01
description With the advent of very-high-resolution remote sensing images, semantic change detection (SCD) based on deep learning has become a research hotspot in recent years. SCD aims to observe the change in the Earth’s land surface and plays a vital role in monitoring the ecological environment, land use and land cover. Existing research mainly focus on single-task semantic change detection; the problem they face is that existing methods are incapable of identifying which change type has occurred in each multi-temporal image. In addition, few methods use the binary change region to help train a deep SCD-based network. Hence, we propose a dual-task semantic change detection network (GCF-SCD-Net) by using the generative change field (GCF) module to locate and segment the change region; what is more, the proposed network is end-to-end trainable. In the meantime, because of the influence of the imbalance label, we propose a separable loss function to alleviate the over-fitting problem. Extensive experiments are conducted in this work to validate the performance of our method. Finally, our work achieves a 69.9% mIoU and 17.9 Sek on the SECOND dataset. Compared with traditional networks, GCF-SCD-Net achieves the best results and promising performances.
topic very-high-resolution remote sensing images
semantic change detection
generative change field
separable loss
url https://www.mdpi.com/2072-4292/13/16/3336
work_keys_str_mv AT shaoxiang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule
AT miwang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule
AT xiaofanjiang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule
AT guangqixie dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule
AT zhiqizhang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule
AT pengtang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule
_version_ 1721190174148263936