Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning

Searching for characteristic patterns in time series is a topic addressed for decades by the research community. Conventional subsequence matching techniques usually rely on the definition of a target template pattern and a searching method for detecting similar patterns. However, the intrinsic vari...

Full description

Bibliographic Details
Main Authors: Pedro Matias, Duarte Folgado, Hugo Gamboa, André Carreiro
Format: Article
Language:English
Published: MDPI AG 2021-07-01
Series:Electronics
Subjects:
ECG
Online Access:https://www.mdpi.com/2079-9292/10/15/1805
id doaj-46b7afbc8ec24fce8c22da04bb8f1954
record_format Article
spelling doaj-46b7afbc8ec24fce8c22da04bb8f19542021-08-06T15:21:11ZengMDPI AGElectronics2079-92922021-07-01101805180510.3390/electronics10151805Time Series Segmentation Using Neural Networks with Cross-Domain Transfer LearningPedro Matias0Duarte Folgado1Hugo Gamboa2André Carreiro3Associação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, PortugalAssociação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, PortugalAssociação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, PortugalAssociação Fraunhofer Portugal Research, Rua Alfredo Allen 455/461, 4200-135 Porto, PortugalSearching for characteristic patterns in time series is a topic addressed for decades by the research community. Conventional subsequence matching techniques usually rely on the definition of a target template pattern and a searching method for detecting similar patterns. However, the intrinsic variability of time series introduces changes in patterns, either morphologically and temporally, making such techniques not as accurate as desired. Intending to improve segmentation performances, in this paper, we proposed a Mask-based Neural Network (NN) which is capable of extracting desired patterns of interest from long time series, without using any predefined template. The proposed NN has been validated, alongside a subsequence matching algorithm, in two datasets: clinical (electrocardiogram) and human activity (inertial sensors). Moreover, the reduced dimension of the data in the latter dataset led to the application of transfer learning and data augmentation techniques to reach model convergence. The results have shown the proposed model achieved better segmentation performances than the baseline one, in both domains, reaching average Precision and Recall scores of 99.0% and 97.5% (clinical domain), along with 77.0% and 71.4% (human activity domain), introducing Neural Networks and Transfer Learning as promising alternatives for pattern searching in time series.https://www.mdpi.com/2079-9292/10/15/1805time seriespattern segmentationdeep learningtransfer learningdata augmentationECG
collection DOAJ
language English
format Article
sources DOAJ
author Pedro Matias
Duarte Folgado
Hugo Gamboa
André Carreiro
spellingShingle Pedro Matias
Duarte Folgado
Hugo Gamboa
André Carreiro
Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
Electronics
time series
pattern segmentation
deep learning
transfer learning
data augmentation
ECG
author_facet Pedro Matias
Duarte Folgado
Hugo Gamboa
André Carreiro
author_sort Pedro Matias
title Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
title_short Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
title_full Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
title_fullStr Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
title_full_unstemmed Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
title_sort time series segmentation using neural networks with cross-domain transfer learning
publisher MDPI AG
series Electronics
issn 2079-9292
publishDate 2021-07-01
description Searching for characteristic patterns in time series is a topic addressed for decades by the research community. Conventional subsequence matching techniques usually rely on the definition of a target template pattern and a searching method for detecting similar patterns. However, the intrinsic variability of time series introduces changes in patterns, either morphologically and temporally, making such techniques not as accurate as desired. Intending to improve segmentation performances, in this paper, we proposed a Mask-based Neural Network (NN) which is capable of extracting desired patterns of interest from long time series, without using any predefined template. The proposed NN has been validated, alongside a subsequence matching algorithm, in two datasets: clinical (electrocardiogram) and human activity (inertial sensors). Moreover, the reduced dimension of the data in the latter dataset led to the application of transfer learning and data augmentation techniques to reach model convergence. The results have shown the proposed model achieved better segmentation performances than the baseline one, in both domains, reaching average Precision and Recall scores of 99.0% and 97.5% (clinical domain), along with 77.0% and 71.4% (human activity domain), introducing Neural Networks and Transfer Learning as promising alternatives for pattern searching in time series.
topic time series
pattern segmentation
deep learning
transfer learning
data augmentation
ECG
url https://www.mdpi.com/2079-9292/10/15/1805
work_keys_str_mv AT pedromatias timeseriessegmentationusingneuralnetworkswithcrossdomaintransferlearning
AT duartefolgado timeseriessegmentationusingneuralnetworkswithcrossdomaintransferlearning
AT hugogamboa timeseriessegmentationusingneuralnetworkswithcrossdomaintransferlearning
AT andrecarreiro timeseriessegmentationusingneuralnetworkswithcrossdomaintransferlearning
_version_ 1721218692146003968