URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS

Change detection is a very important problem for the remote sensing community. Among the several approaches proposed during recent years, deep learning provides methods and tools that achieve state of the art performances. In this paper, we tackle the problem of urban change detection by constructin...

Full description

Bibliographic Details
Main Authors: M. Papadomanolaki, M. Vakalopoulou, K. Karantzalos
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/541/2020/isprs-annals-V-2-2020-541-2020.pdf
id doaj-0803f21dc12343289036857e1db2acd9
record_format Article
spelling doaj-0803f21dc12343289036857e1db2acd92020-11-25T03:29:42ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502020-08-01V-2-202054154710.5194/isprs-annals-V-2-2020-541-2020URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKSM. Papadomanolaki0M. Papadomanolaki1M. Vakalopoulou2M. Vakalopoulou3K. Karantzalos4Remote Sensing Laboratory, National Technical University of Athens, Zographos, GreeceUniversité Paris-Saclay, CentraleSupélec, MICS Laboratory, Gif-sur-Yvette, FranceUniversité Paris-Saclay, CentraleSupélec, MICS Laboratory, Gif-sur-Yvette, FranceUniversité Paris-Saclay, CentraleSupélec, Inria, Gif-sur-Yvette, FranceRemote Sensing Laboratory, National Technical University of Athens, Zographos, GreeceChange detection is a very important problem for the remote sensing community. Among the several approaches proposed during recent years, deep learning provides methods and tools that achieve state of the art performances. In this paper, we tackle the problem of urban change detection by constructing a fully convolutional multi-task deep architecture. We present a framework based on the UNet model, with fully convolutional LSTM blocks integrated on top of every encoding level capturing in this way the temporal dynamics of spatial feature representations at different resolution levels. The proposed network is modular due to shared weights which allow the exploitation of multiple (more than two) dates simultaneously. Moreover, our framework provides building segmentation maps by employing a multi-task scheme which extracts additional feature attributes that can reduce the number of false positive pixels. We performed extensive experiments comparing our method with other state of the art approaches using very high resolution images of urban areas. Quantitative and qualitative results reveal the great potential of the proposed scheme, with F1 score outperforming the other compared methods by almost 2.2%.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/541/2020/isprs-annals-V-2-2020-541-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author M. Papadomanolaki
M. Papadomanolaki
M. Vakalopoulou
M. Vakalopoulou
K. Karantzalos
spellingShingle M. Papadomanolaki
M. Papadomanolaki
M. Vakalopoulou
M. Vakalopoulou
K. Karantzalos
URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet M. Papadomanolaki
M. Papadomanolaki
M. Vakalopoulou
M. Vakalopoulou
K. Karantzalos
author_sort M. Papadomanolaki
title URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
title_short URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
title_full URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
title_fullStr URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
title_full_unstemmed URBAN CHANGE DETECTION BASED ON SEMANTIC SEGMENTATION AND FULLY CONVOLUTIONAL LSTM NETWORKS
title_sort urban change detection based on semantic segmentation and fully convolutional lstm networks
publisher Copernicus Publications
series ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 2194-9042
2194-9050
publishDate 2020-08-01
description Change detection is a very important problem for the remote sensing community. Among the several approaches proposed during recent years, deep learning provides methods and tools that achieve state of the art performances. In this paper, we tackle the problem of urban change detection by constructing a fully convolutional multi-task deep architecture. We present a framework based on the UNet model, with fully convolutional LSTM blocks integrated on top of every encoding level capturing in this way the temporal dynamics of spatial feature representations at different resolution levels. The proposed network is modular due to shared weights which allow the exploitation of multiple (more than two) dates simultaneously. Moreover, our framework provides building segmentation maps by employing a multi-task scheme which extracts additional feature attributes that can reduce the number of false positive pixels. We performed extensive experiments comparing our method with other state of the art approaches using very high resolution images of urban areas. Quantitative and qualitative results reveal the great potential of the proposed scheme, with F1 score outperforming the other compared methods by almost 2.2%.
url https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/V-2-2020/541/2020/isprs-annals-V-2-2020-541-2020.pdf
work_keys_str_mv AT mpapadomanolaki urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks
AT mpapadomanolaki urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks
AT mvakalopoulou urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks
AT mvakalopoulou urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks
AT kkarantzalos urbanchangedetectionbasedonsemanticsegmentationandfullyconvolutionallstmnetworks
_version_ 1724577598209523712