AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION

Transfer learning methods reuse a deep learning model developed for a task on another task. Such methods have been remarkably successful in a wide range of image processing applications. Following the trend, few transfer learning based methods have been proposed for unsupervised multi-temporal image...

Full description

Bibliographic Details
Main Authors: L. Bergamasco, S. Saha, F. Bovolo, L. Bruzzone
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/1513/2020/isprs-archives-XLIII-B2-2020-1513-2020.pdf
id doaj-7d42064d3765469cb264daf26fd27c69
record_format Article
spelling doaj-7d42064d3765469cb264daf26fd27c692020-11-25T04:01:39ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-20201513151910.5194/isprs-archives-XLIII-B2-2020-1513-2020AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTIONL. Bergamasco0L. Bergamasco1S. Saha2S. Saha3F. Bovolo4L. Bruzzone5Fondazione Bruno Kessler, Trento, ItalyUniversity of Trento, Trento, ItalyFondazione Bruno Kessler, Trento, ItalyUniversity of Trento, Trento, ItalyFondazione Bruno Kessler, Trento, ItalyUniversity of Trento, Trento, ItalyTransfer learning methods reuse a deep learning model developed for a task on another task. Such methods have been remarkably successful in a wide range of image processing applications. Following the trend, few transfer learning based methods have been proposed for unsupervised multi-temporal image analysis and change detection (CD). Inspite of their success, the transfer learning based CD methods suffer from limited explainability. In this paper, we propose an explainable convolutional autoencoder model for CD. The model is trained in: 1) an unsupervised way using, as the bi-temporal images, patches extracted from the same geographic location; 2) a greedy fashion, one encoder and decoder layer pair at a time. A number of features relevant for CD is chosen from the encoder layer. To build an explainable model, only selected features from the encoder layer is retained and the rest is discarded. Following this, another encoder and decoder layer pair is added to the model in similar fashion until convergence. We further visualize the features to better interpret the learned features. We validated the proposed method on a Landsat-8 dataset obtained in Spain. Using a set of experiments, we demonstrate the explainability and effectiveness of the proposed model.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/1513/2020/isprs-archives-XLIII-B2-2020-1513-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author L. Bergamasco
L. Bergamasco
S. Saha
S. Saha
F. Bovolo
L. Bruzzone
spellingShingle L. Bergamasco
L. Bergamasco
S. Saha
S. Saha
F. Bovolo
L. Bruzzone
AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet L. Bergamasco
L. Bergamasco
S. Saha
S. Saha
F. Bovolo
L. Bruzzone
author_sort L. Bergamasco
title AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
title_short AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
title_full AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
title_fullStr AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
title_full_unstemmed AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
title_sort explainable convolutional autoencoder model for unsupervised change detection
publisher Copernicus Publications
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 1682-1750
2194-9034
publishDate 2020-08-01
description Transfer learning methods reuse a deep learning model developed for a task on another task. Such methods have been remarkably successful in a wide range of image processing applications. Following the trend, few transfer learning based methods have been proposed for unsupervised multi-temporal image analysis and change detection (CD). Inspite of their success, the transfer learning based CD methods suffer from limited explainability. In this paper, we propose an explainable convolutional autoencoder model for CD. The model is trained in: 1) an unsupervised way using, as the bi-temporal images, patches extracted from the same geographic location; 2) a greedy fashion, one encoder and decoder layer pair at a time. A number of features relevant for CD is chosen from the encoder layer. To build an explainable model, only selected features from the encoder layer is retained and the rest is discarded. Following this, another encoder and decoder layer pair is added to the model in similar fashion until convergence. We further visualize the features to better interpret the learned features. We validated the proposed method on a Landsat-8 dataset obtained in Spain. Using a set of experiments, we demonstrate the explainability and effectiveness of the proposed model.
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/1513/2020/isprs-archives-XLIII-B2-2020-1513-2020.pdf
work_keys_str_mv AT lbergamasco anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT lbergamasco anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT ssaha anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT ssaha anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT fbovolo anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT lbruzzone anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT lbergamasco explainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT lbergamasco explainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT ssaha explainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT ssaha explainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT fbovolo explainableconvolutionalautoencodermodelforunsupervisedchangedetection
AT lbruzzone explainableconvolutionalautoencodermodelforunsupervisedchangedetection
_version_ 1724445932490063872