Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characte...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2020-01-01
|
Series: | Computational Intelligence and Neuroscience |
Online Access: | http://dx.doi.org/10.1155/2020/7980434 |
id |
doaj-c961f68453dd410791b5cf89449ec842 |
---|---|
record_format |
Article |
spelling |
doaj-c961f68453dd410791b5cf89449ec8422020-11-25T02:58:40ZengHindawi LimitedComputational Intelligence and Neuroscience1687-52651687-52732020-01-01202010.1155/2020/79804347980434Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine LearningHye-Jin Kim0Sung Min Park1Byung Jin Choi2Seung-Hyun Moon3Yong-Hyuk Kim4Department of Computer Science, Kwangwoon University, 20 Kwangwoon-ro, Nowon-gu, Seoul 01897, Republic of KoreaR&D Center, Jubix Co., Ltd., B-808, Gunpo IT Valley, 17, Gosan-ro 148beon-gil, Gunpo-si, Gyeonggi-do 15850, Republic of KoreaR&D Center, Jubix Co., Ltd., B-808, Gunpo IT Valley, 17, Gosan-ro 148beon-gil, Gunpo-si, Gyeonggi-do 15850, Republic of KoreaDepartment of Computer Science & Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Republic of KoreaDepartment of Computer Science, Kwangwoon University, 20 Kwangwoon-ro, Nowon-gu, Seoul 01897, Republic of KoreaWe propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characteristics. We performed machine learning-based QC on each weather element of atmospheric data, such as temperature, acquired from seven types of IoT sensors and applied machine learning algorithms, such as support vector regression, on data with errors to make meaningful estimates from them. By using the root mean squared error (RMSE), we evaluated the performance of the proposed techniques. As a result, the QC done in conjunction with other weather elements had 0.14% lower RMSE on average than QC conducted with only a single weather element. In the case of QC with spatiotemporal characteristic considerations, the QC done via training with AWS data showed performance with 17% lower RMSE than QC done with only raw data.http://dx.doi.org/10.1155/2020/7980434 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hye-Jin Kim Sung Min Park Byung Jin Choi Seung-Hyun Moon Yong-Hyuk Kim |
spellingShingle |
Hye-Jin Kim Sung Min Park Byung Jin Choi Seung-Hyun Moon Yong-Hyuk Kim Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning Computational Intelligence and Neuroscience |
author_facet |
Hye-Jin Kim Sung Min Park Byung Jin Choi Seung-Hyun Moon Yong-Hyuk Kim |
author_sort |
Hye-Jin Kim |
title |
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning |
title_short |
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning |
title_full |
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning |
title_fullStr |
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning |
title_full_unstemmed |
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning |
title_sort |
spatiotemporal approaches for quality control and error correction of atmospheric data through machine learning |
publisher |
Hindawi Limited |
series |
Computational Intelligence and Neuroscience |
issn |
1687-5265 1687-5273 |
publishDate |
2020-01-01 |
description |
We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characteristics. We performed machine learning-based QC on each weather element of atmospheric data, such as temperature, acquired from seven types of IoT sensors and applied machine learning algorithms, such as support vector regression, on data with errors to make meaningful estimates from them. By using the root mean squared error (RMSE), we evaluated the performance of the proposed techniques. As a result, the QC done in conjunction with other weather elements had 0.14% lower RMSE on average than QC conducted with only a single weather element. In the case of QC with spatiotemporal characteristic considerations, the QC done via training with AWS data showed performance with 17% lower RMSE than QC done with only raw data. |
url |
http://dx.doi.org/10.1155/2020/7980434 |
work_keys_str_mv |
AT hyejinkim spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning AT sungminpark spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning AT byungjinchoi spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning AT seunghyunmoon spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning AT yonghyukkim spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning |
_version_ |
1715338275516841984 |