AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION
Transfer learning methods reuse a deep learning model developed for a task on another task. Such methods have been remarkably successful in a wide range of image processing applications. Following the trend, few transfer learning based methods have been proposed for unsupervised multi-temporal image...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2020-08-01
|
Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/1513/2020/isprs-archives-XLIII-B2-2020-1513-2020.pdf |
id |
doaj-7d42064d3765469cb264daf26fd27c69 |
---|---|
record_format |
Article |
spelling |
doaj-7d42064d3765469cb264daf26fd27c692020-11-25T04:01:39ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-20201513151910.5194/isprs-archives-XLIII-B2-2020-1513-2020AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTIONL. Bergamasco0L. Bergamasco1S. Saha2S. Saha3F. Bovolo4L. Bruzzone5Fondazione Bruno Kessler, Trento, ItalyUniversity of Trento, Trento, ItalyFondazione Bruno Kessler, Trento, ItalyUniversity of Trento, Trento, ItalyFondazione Bruno Kessler, Trento, ItalyUniversity of Trento, Trento, ItalyTransfer learning methods reuse a deep learning model developed for a task on another task. Such methods have been remarkably successful in a wide range of image processing applications. Following the trend, few transfer learning based methods have been proposed for unsupervised multi-temporal image analysis and change detection (CD). Inspite of their success, the transfer learning based CD methods suffer from limited explainability. In this paper, we propose an explainable convolutional autoencoder model for CD. The model is trained in: 1) an unsupervised way using, as the bi-temporal images, patches extracted from the same geographic location; 2) a greedy fashion, one encoder and decoder layer pair at a time. A number of features relevant for CD is chosen from the encoder layer. To build an explainable model, only selected features from the encoder layer is retained and the rest is discarded. Following this, another encoder and decoder layer pair is added to the model in similar fashion until convergence. We further visualize the features to better interpret the learned features. We validated the proposed method on a Landsat-8 dataset obtained in Spain. Using a set of experiments, we demonstrate the explainability and effectiveness of the proposed model.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/1513/2020/isprs-archives-XLIII-B2-2020-1513-2020.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
L. Bergamasco L. Bergamasco S. Saha S. Saha F. Bovolo L. Bruzzone |
spellingShingle |
L. Bergamasco L. Bergamasco S. Saha S. Saha F. Bovolo L. Bruzzone AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
author_facet |
L. Bergamasco L. Bergamasco S. Saha S. Saha F. Bovolo L. Bruzzone |
author_sort |
L. Bergamasco |
title |
AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION |
title_short |
AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION |
title_full |
AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION |
title_fullStr |
AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION |
title_full_unstemmed |
AN EXPLAINABLE CONVOLUTIONAL AUTOENCODER MODEL FOR UNSUPERVISED CHANGE DETECTION |
title_sort |
explainable convolutional autoencoder model for unsupervised change detection |
publisher |
Copernicus Publications |
series |
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
issn |
1682-1750 2194-9034 |
publishDate |
2020-08-01 |
description |
Transfer learning methods reuse a deep learning model developed for a task on another task. Such methods have been remarkably successful in a wide range of image processing applications. Following the trend, few transfer learning based methods have been proposed for unsupervised multi-temporal image analysis and change detection (CD). Inspite of their success, the transfer learning based CD methods suffer from limited explainability. In this paper, we propose an explainable convolutional autoencoder model for CD. The model is trained in: 1) an unsupervised way using, as the bi-temporal images, patches extracted from the same geographic location; 2) a greedy fashion, one encoder and decoder layer pair at a time. A number of features relevant for CD is chosen from the encoder layer. To build an explainable model, only selected features from the encoder layer is retained and the rest is discarded. Following this, another encoder and decoder layer pair is added to the model in similar fashion until convergence. We further visualize the features to better interpret the learned features. We validated the proposed method on a Landsat-8 dataset obtained in Spain. Using a set of experiments, we demonstrate the explainability and effectiveness of the proposed model. |
url |
https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/1513/2020/isprs-archives-XLIII-B2-2020-1513-2020.pdf |
work_keys_str_mv |
AT lbergamasco anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection AT lbergamasco anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection AT ssaha anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection AT ssaha anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection AT fbovolo anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection AT lbruzzone anexplainableconvolutionalautoencodermodelforunsupervisedchangedetection AT lbergamasco explainableconvolutionalautoencodermodelforunsupervisedchangedetection AT lbergamasco explainableconvolutionalautoencodermodelforunsupervisedchangedetection AT ssaha explainableconvolutionalautoencodermodelforunsupervisedchangedetection AT ssaha explainableconvolutionalautoencodermodelforunsupervisedchangedetection AT fbovolo explainableconvolutionalautoencodermodelforunsupervisedchangedetection AT lbruzzone explainableconvolutionalautoencodermodelforunsupervisedchangedetection |
_version_ |
1724445932490063872 |