URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
Change detection is a very important problem for the remote sensing community. Among the several approaches proposed during recent years, deep learning provides methods and tools that achieve state of the art performances. In this paper, we tackle the problem of urban change detection by constructin...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2020-08-01
|
Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/541/2020/isprs-annals-V-2-2020-541-2020.pdf |
id |
doaj-0803f21dc12343289036857e1db2acd9 |
---|---|
record_format |
Article |
spelling |
doaj-0803f21dc12343289036857e1db2acd92020-11-25T03:29:42ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502020-08-01V-2-202054154710.5194/isprs-annals-V-2-2020-541-2020URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKSM. Papadomanolaki0M. Papadomanolaki1M. Vakalopoulou2M. Vakalopoulou3K. Karantzalos4Remote Sensing Laboratory, National Technical University of Athens, Zographos, GreeceUniversité Paris-Saclay, CentraleSupélec, MICS Laboratory, Gif-sur-Yvette, FranceUniversité Paris-Saclay, CentraleSupélec, MICS Laboratory, Gif-sur-Yvette, FranceUniversité Paris-Saclay, CentraleSupélec, Inria, Gif-sur-Yvette, FranceRemote Sensing Laboratory, National Technical University of Athens, Zographos, GreeceChange detection is a very important problem for the remote sensing community. Among the several approaches proposed during recent years, deep learning provides methods and tools that achieve state of the art performances. In this paper, we tackle the problem of urban change detection by constructing a fully convolutional multi-task deep architecture. We present a framework based on the UNet model, with fully convolutional LSTM blocks integrated on top of every encoding level capturing in this way the temporal dynamics of spatial feature representations at different resolution levels. The proposed network is modular due to shared weights which allow the exploitation of multiple (more than two) dates simultaneously. Moreover, our framework provides building segmentation maps by employing a multi-task scheme which extracts additional feature attributes that can reduce the number of false positive pixels. We performed extensive experiments comparing our method with other state of the art approaches using very high resolution images of urban areas. Quantitative and qualitative results reveal the great potential of the proposed scheme, with F1 score outperforming the other compared methods by almost 2.2%.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/541/2020/isprs-annals-V-2-2020-541-2020.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
M. Papadomanolaki M. Papadomanolaki M. Vakalopoulou M. Vakalopoulou K. Karantzalos |
spellingShingle |
M. Papadomanolaki M. Papadomanolaki M. Vakalopoulou M. Vakalopoulou K. Karantzalos URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
author_facet |
M. Papadomanolaki M. Papadomanolaki M. Vakalopoulou M. Vakalopoulou K. Karantzalos |
author_sort |
M. Papadomanolaki |
title |
URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS |
title_short |
URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS |
title_full |
URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS |
title_fullStr |
URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS |
title_full_unstemmed |
URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS |
title_sort |
urban change detection based on semantic segmentation and fully convolutional lstm networks |
publisher |
Copernicus Publications |
series |
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
issn |
2194-9042 2194-9050 |
publishDate |
2020-08-01 |
description |
Change detection is a very important problem for the remote sensing community. Among the several approaches proposed during recent years, deep learning provides methods and tools that achieve state of the art performances. In this paper, we tackle the problem of urban change detection by constructing a fully convolutional multi-task deep architecture. We present a framework based on the UNet model, with fully convolutional LSTM blocks integrated on top of every encoding level capturing in this way the temporal dynamics of spatial feature representations at different resolution levels. The proposed network is modular due to shared weights which allow the exploitation of multiple (more than two) dates simultaneously. Moreover, our framework provides building segmentation maps by employing a multi-task scheme which extracts additional feature attributes that can reduce the number of false positive pixels. We performed extensive experiments comparing our method with other state of the art approaches using very high resolution images of urban areas. Quantitative and qualitative results reveal the great potential of the proposed scheme, with F1 score outperforming the other compared methods by almost 2.2%. |
url |
https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/541/2020/isprs-annals-V-2-2020-541-2020.pdf |
work_keys_str_mv |
AT mpapadomanolaki urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks AT mpapadomanolaki urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks AT mvakalopoulou urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks AT mvakalopoulou urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks AT kkarantzalos urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks |
_version_ |
1724577598209523712 |