High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks

Machine learning (ML) algorithms have gained prominence in time series prediction problems. Depending on the nature of the time series data, it can be difficult to build an accurate ML model with the proper structure and hyperparameters. In this study, we propose a predictive error compensation wave...

Full description

Bibliographic Details
Main Authors: Burak Berk Ustundag, Ajla Kulaglic
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9269330/
id doaj-03e87eaa6fc840d18b1363fc3b20dc26
record_format Article
spelling doaj-03e87eaa6fc840d18b1363fc3b20dc262021-03-30T04:55:08ZengIEEEIEEE Access2169-35362020-01-01821053221054110.1109/ACCESS.2020.30387249269330High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural NetworksBurak Berk Ustundag0https://orcid.org/0000-0001-8143-9434Ajla Kulaglic1https://orcid.org/0000-0003-3410-7079Computer Engineering Department, Istanbul Technical University, Istanbul, TurkeyGraduate School of Science Engineering and Technology, Istanbul Technical University, Istanbul, TurkeyMachine learning (ML) algorithms have gained prominence in time series prediction problems. Depending on the nature of the time series data, it can be difficult to build an accurate ML model with the proper structure and hyperparameters. In this study, we propose a predictive error compensation wavelet neural network model (PEC-WNN) for improving the prediction accuracy of chaotic and stochastic time series data. In the proposed model, an additional network is used for the prediction of the main network error to compensate the overall prediction error. The main network takes as inputs the time series data through moving frames in multiple-scales. The same structure and hyperparameter sets are applied for quite distinct four types of problems for verification of the robustness and accuracy of the proposed model. Specifically, the Mackey-Glass, Box-Jenkins, and Lorenz Attractor benchmark problems, as well as drought forecasting are used to characterize the performance of the model for chaotic and stochastic data cases. The results show that the PEC-WNN provides significantly more accurate predictions for all compared benchmark problems with respect to conventional machine learning and time series prediction methods without changing any hyperparameter or the structure. In addition, the time and space complexity of the PEC-WNN model is less than all other compared ML methods, including long short-term memory (LSTM) and convolutional neural networks (CNNs).https://ieeexplore.ieee.org/document/9269330/Box-Jenkinsdiscrete wavelet transformdrought forecastingLorenz AttractorMackey-Glassneural networks
collection DOAJ
language English
format Article
sources DOAJ
author Burak Berk Ustundag
Ajla Kulaglic
spellingShingle Burak Berk Ustundag
Ajla Kulaglic
High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks
IEEE Access
Box-Jenkins
discrete wavelet transform
drought forecasting
Lorenz Attractor
Mackey-Glass
neural networks
author_facet Burak Berk Ustundag
Ajla Kulaglic
author_sort Burak Berk Ustundag
title High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks
title_short High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks
title_full High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks
title_fullStr High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks
title_full_unstemmed High-Performance Time Series Prediction With Predictive Error Compensated Wavelet Neural Networks
title_sort high-performance time series prediction with predictive error compensated wavelet neural networks
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Machine learning (ML) algorithms have gained prominence in time series prediction problems. Depending on the nature of the time series data, it can be difficult to build an accurate ML model with the proper structure and hyperparameters. In this study, we propose a predictive error compensation wavelet neural network model (PEC-WNN) for improving the prediction accuracy of chaotic and stochastic time series data. In the proposed model, an additional network is used for the prediction of the main network error to compensate the overall prediction error. The main network takes as inputs the time series data through moving frames in multiple-scales. The same structure and hyperparameter sets are applied for quite distinct four types of problems for verification of the robustness and accuracy of the proposed model. Specifically, the Mackey-Glass, Box-Jenkins, and Lorenz Attractor benchmark problems, as well as drought forecasting are used to characterize the performance of the model for chaotic and stochastic data cases. The results show that the PEC-WNN provides significantly more accurate predictions for all compared benchmark problems with respect to conventional machine learning and time series prediction methods without changing any hyperparameter or the structure. In addition, the time and space complexity of the PEC-WNN model is less than all other compared ML methods, including long short-term memory (LSTM) and convolutional neural networks (CNNs).
topic Box-Jenkins
discrete wavelet transform
drought forecasting
Lorenz Attractor
Mackey-Glass
neural networks
url https://ieeexplore.ieee.org/document/9269330/
work_keys_str_mv AT burakberkustundag highperformancetimeseriespredictionwithpredictiveerrorcompensatedwaveletneuralnetworks
AT ajlakulaglic highperformancetimeseriespredictionwithpredictiveerrorcompensatedwaveletneuralnetworks
_version_ 1724180974915289088