Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches

Nowadays, huge volume of satellite images, via the different Earth Observation missions, are constantly acquired and they constitute a valuable source of information for the analysis of spatiotemporal phenomena. However, it can be challenging to obtain reference data associated to such images to dea...

Full description

Bibliographic Details
Main Authors: Ekaterina Kalinicheva, Dino Ienco, Jeremie Sublime, Maria Trocan
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9050903/
id doaj-f4894437db9d47b5aabfcf951a9f8f0e
record_format Article
spelling doaj-f4894437db9d47b5aabfcf951a9f8f0e2021-06-03T23:01:43ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352020-01-01131450146610.1109/JSTARS.2020.29826319050903Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based ApproachesEkaterina Kalinicheva0https://orcid.org/0000-0001-8332-2491Dino Ienco1https://orcid.org/0000-0002-8736-3132Jeremie Sublime2https://orcid.org/0000-0003-0508-8550Maria Trocan3https://orcid.org/0000-0001-6241-0126ISEP—LISITE laboratory, DaSSIP team, Issy-Les-Moulineaux, FranceINRAE—UMR TETIS, University of Montpellier, Montpellier Cedex 5, FranceISEP—LISITE laboratory, DaSSIP team, Issy-Les-Moulineaux, FranceISEP—LISITE laboratory, DaSSIP team, Issy-Les-Moulineaux, FranceNowadays, huge volume of satellite images, via the different Earth Observation missions, are constantly acquired and they constitute a valuable source of information for the analysis of spatiotemporal phenomena. However, it can be challenging to obtain reference data associated to such images to deal with land use or land cover changes as often the nature of the phenomena under study is not known a priori. With the aim to deal with satellite image analysis, considering a real-world scenario, where reference data cannot be available, in this article, we present a novel end-to-end unsupervised approach for change detection and clustering for satellite image time series (SITS). In the proposed framework, we first create bitemporal change masks for every couple of consecutive images using neural network autoencoders (AEs). Then, we associate the extracted changes to different spatial objects. The objects sharing the same geographical location are combined in spatiotemporal evolution graphs that are finally clustered accordingly to the type of change process with gated recurrent unit (GRU) AE-based model. The proposed approach was assessed on two real-world SITS data supplying promising results.https://ieeexplore.ieee.org/document/9050903/Autoencoder (AE)change detectiongated recurrent unit (GRU)object-oriented image analysispattern recognitionsatellite image time series (SITS)
collection DOAJ
language English
format Article
sources DOAJ
author Ekaterina Kalinicheva
Dino Ienco
Jeremie Sublime
Maria Trocan
spellingShingle Ekaterina Kalinicheva
Dino Ienco
Jeremie Sublime
Maria Trocan
Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Autoencoder (AE)
change detection
gated recurrent unit (GRU)
object-oriented image analysis
pattern recognition
satellite image time series (SITS)
author_facet Ekaterina Kalinicheva
Dino Ienco
Jeremie Sublime
Maria Trocan
author_sort Ekaterina Kalinicheva
title Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches
title_short Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches
title_full Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches
title_fullStr Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches
title_full_unstemmed Unsupervised Change Detection Analysis in Satellite Image Time Series Using Deep Learning Combined With Graph-Based Approaches
title_sort unsupervised change detection analysis in satellite image time series using deep learning combined with graph-based approaches
publisher IEEE
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
issn 2151-1535
publishDate 2020-01-01
description Nowadays, huge volume of satellite images, via the different Earth Observation missions, are constantly acquired and they constitute a valuable source of information for the analysis of spatiotemporal phenomena. However, it can be challenging to obtain reference data associated to such images to deal with land use or land cover changes as often the nature of the phenomena under study is not known a priori. With the aim to deal with satellite image analysis, considering a real-world scenario, where reference data cannot be available, in this article, we present a novel end-to-end unsupervised approach for change detection and clustering for satellite image time series (SITS). In the proposed framework, we first create bitemporal change masks for every couple of consecutive images using neural network autoencoders (AEs). Then, we associate the extracted changes to different spatial objects. The objects sharing the same geographical location are combined in spatiotemporal evolution graphs that are finally clustered accordingly to the type of change process with gated recurrent unit (GRU) AE-based model. The proposed approach was assessed on two real-world SITS data supplying promising results.
topic Autoencoder (AE)
change detection
gated recurrent unit (GRU)
object-oriented image analysis
pattern recognition
satellite image time series (SITS)
url https://ieeexplore.ieee.org/document/9050903/
work_keys_str_mv AT ekaterinakalinicheva unsupervisedchangedetectionanalysisinsatelliteimagetimeseriesusingdeeplearningcombinedwithgraphbasedapproaches
AT dinoienco unsupervisedchangedetectionanalysisinsatelliteimagetimeseriesusingdeeplearningcombinedwithgraphbasedapproaches
AT jeremiesublime unsupervisedchangedetectionanalysisinsatelliteimagetimeseriesusingdeeplearningcombinedwithgraphbasedapproaches
AT mariatrocan unsupervisedchangedetectionanalysisinsatelliteimagetimeseriesusingdeeplearningcombinedwithgraphbasedapproaches
_version_ 1721398848826376192