Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning

We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characte...

Full description

Bibliographic Details
Main Authors: Hye-Jin Kim, Sung Min Park, Byung Jin Choi, Seung-Hyun Moon, Yong-Hyuk Kim
Format: Article
Language:English
Published: Hindawi Limited 2020-01-01
Series:Computational Intelligence and Neuroscience
Online Access:http://dx.doi.org/10.1155/2020/7980434
id doaj-c961f68453dd410791b5cf89449ec842
record_format Article
spelling doaj-c961f68453dd410791b5cf89449ec8422020-11-25T02:58:40ZengHindawi LimitedComputational Intelligence and Neuroscience1687-52651687-52732020-01-01202010.1155/2020/79804347980434Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine LearningHye-Jin Kim0Sung Min Park1Byung Jin Choi2Seung-Hyun Moon3Yong-Hyuk Kim4Department of Computer Science, Kwangwoon University, 20 Kwangwoon-ro, Nowon-gu, Seoul 01897, Republic of KoreaR&D Center, Jubix Co., Ltd., B-808, Gunpo IT Valley, 17, Gosan-ro 148beon-gil, Gunpo-si, Gyeonggi-do 15850, Republic of KoreaR&D Center, Jubix Co., Ltd., B-808, Gunpo IT Valley, 17, Gosan-ro 148beon-gil, Gunpo-si, Gyeonggi-do 15850, Republic of KoreaDepartment of Computer Science & Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Republic of KoreaDepartment of Computer Science, Kwangwoon University, 20 Kwangwoon-ro, Nowon-gu, Seoul 01897, Republic of KoreaWe propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characteristics. We performed machine learning-based QC on each weather element of atmospheric data, such as temperature, acquired from seven types of IoT sensors and applied machine learning algorithms, such as support vector regression, on data with errors to make meaningful estimates from them. By using the root mean squared error (RMSE), we evaluated the performance of the proposed techniques. As a result, the QC done in conjunction with other weather elements had 0.14% lower RMSE on average than QC conducted with only a single weather element. In the case of QC with spatiotemporal characteristic considerations, the QC done via training with AWS data showed performance with 17% lower RMSE than QC done with only raw data.http://dx.doi.org/10.1155/2020/7980434
collection DOAJ
language English
format Article
sources DOAJ
author Hye-Jin Kim
Sung Min Park
Byung Jin Choi
Seung-Hyun Moon
Yong-Hyuk Kim
spellingShingle Hye-Jin Kim
Sung Min Park
Byung Jin Choi
Seung-Hyun Moon
Yong-Hyuk Kim
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
Computational Intelligence and Neuroscience
author_facet Hye-Jin Kim
Sung Min Park
Byung Jin Choi
Seung-Hyun Moon
Yong-Hyuk Kim
author_sort Hye-Jin Kim
title Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_short Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_full Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_fullStr Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_full_unstemmed Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_sort spatiotemporal approaches for quality control and error correction of atmospheric data through machine learning
publisher Hindawi Limited
series Computational Intelligence and Neuroscience
issn 1687-5265
1687-5273
publishDate 2020-01-01
description We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characteristics. We performed machine learning-based QC on each weather element of atmospheric data, such as temperature, acquired from seven types of IoT sensors and applied machine learning algorithms, such as support vector regression, on data with errors to make meaningful estimates from them. By using the root mean squared error (RMSE), we evaluated the performance of the proposed techniques. As a result, the QC done in conjunction with other weather elements had 0.14% lower RMSE on average than QC conducted with only a single weather element. In the case of QC with spatiotemporal characteristic considerations, the QC done via training with AWS data showed performance with 17% lower RMSE than QC done with only raw data.
url http://dx.doi.org/10.1155/2020/7980434
work_keys_str_mv AT hyejinkim spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT sungminpark spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT byungjinchoi spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT seunghyunmoon spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT yonghyukkim spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
_version_ 1715338275516841984