Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module
With the advent of very-high-resolution remote sensing images, semantic change detection (SCD) based on deep learning has become a research hotspot in recent years. SCD aims to observe the change in the Earth’s land surface and plays a vital role in monitoring the ecological environment, land use an...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-08-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | https://www.mdpi.com/2072-4292/13/16/3336 |
id |
doaj-8987f11438c04360a5295f728a36be64 |
---|---|
record_format |
Article |
spelling |
doaj-8987f11438c04360a5295f728a36be642021-08-26T14:18:05ZengMDPI AGRemote Sensing2072-42922021-08-01133336333610.3390/rs13163336Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field ModuleShao Xiang0Mi Wang1Xiaofan Jiang2Guangqi Xie3Zhiqi Zhang4Peng Tang5State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, ChinaDepartment of Informatics, Technical University of Munich, 80333 Munchen, GermanyWith the advent of very-high-resolution remote sensing images, semantic change detection (SCD) based on deep learning has become a research hotspot in recent years. SCD aims to observe the change in the Earth’s land surface and plays a vital role in monitoring the ecological environment, land use and land cover. Existing research mainly focus on single-task semantic change detection; the problem they face is that existing methods are incapable of identifying which change type has occurred in each multi-temporal image. In addition, few methods use the binary change region to help train a deep SCD-based network. Hence, we propose a dual-task semantic change detection network (GCF-SCD-Net) by using the generative change field (GCF) module to locate and segment the change region; what is more, the proposed network is end-to-end trainable. In the meantime, because of the influence of the imbalance label, we propose a separable loss function to alleviate the over-fitting problem. Extensive experiments are conducted in this work to validate the performance of our method. Finally, our work achieves a 69.9% mIoU and 17.9 Sek on the SECOND dataset. Compared with traditional networks, GCF-SCD-Net achieves the best results and promising performances.https://www.mdpi.com/2072-4292/13/16/3336very-high-resolution remote sensing imagessemantic change detectiongenerative change fieldseparable loss |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Shao Xiang Mi Wang Xiaofan Jiang Guangqi Xie Zhiqi Zhang Peng Tang |
spellingShingle |
Shao Xiang Mi Wang Xiaofan Jiang Guangqi Xie Zhiqi Zhang Peng Tang Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module Remote Sensing very-high-resolution remote sensing images semantic change detection generative change field separable loss |
author_facet |
Shao Xiang Mi Wang Xiaofan Jiang Guangqi Xie Zhiqi Zhang Peng Tang |
author_sort |
Shao Xiang |
title |
Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module |
title_short |
Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module |
title_full |
Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module |
title_fullStr |
Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module |
title_full_unstemmed |
Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field Module |
title_sort |
dual-task semantic change detection for remote sensing images using the generative change field module |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2021-08-01 |
description |
With the advent of very-high-resolution remote sensing images, semantic change detection (SCD) based on deep learning has become a research hotspot in recent years. SCD aims to observe the change in the Earth’s land surface and plays a vital role in monitoring the ecological environment, land use and land cover. Existing research mainly focus on single-task semantic change detection; the problem they face is that existing methods are incapable of identifying which change type has occurred in each multi-temporal image. In addition, few methods use the binary change region to help train a deep SCD-based network. Hence, we propose a dual-task semantic change detection network (GCF-SCD-Net) by using the generative change field (GCF) module to locate and segment the change region; what is more, the proposed network is end-to-end trainable. In the meantime, because of the influence of the imbalance label, we propose a separable loss function to alleviate the over-fitting problem. Extensive experiments are conducted in this work to validate the performance of our method. Finally, our work achieves a 69.9% mIoU and 17.9 Sek on the SECOND dataset. Compared with traditional networks, GCF-SCD-Net achieves the best results and promising performances. |
topic |
very-high-resolution remote sensing images semantic change detection generative change field separable loss |
url |
https://www.mdpi.com/2072-4292/13/16/3336 |
work_keys_str_mv |
AT shaoxiang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule AT miwang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule AT xiaofanjiang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule AT guangqixie dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule AT zhiqizhang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule AT pengtang dualtasksemanticchangedetectionforremotesensingimagesusingthegenerativechangefieldmodule |
_version_ |
1721190174148263936 |