Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods

<p>Particle sensing technology has shown great potential for monitoring particulate matter (PM) with very few temporal and spatial restrictions because of its low cost, compact size, and easy operation. However, the performance of low-cost sensors for PM monitoring in ambient conditions has no...

Full description

Bibliographic Details
Main Authors: M. Si, Y. Xiong, S. Du, K. Du
Format: Article
Language:English
Published: Copernicus Publications 2020-04-01
Series:Atmospheric Measurement Techniques
Online Access:https://www.atmos-meas-tech.net/13/1693/2020/amt-13-1693-2020.pdf
id doaj-7930b8f8b3484b93a83c3c14a8ef69bb
record_format Article
spelling doaj-7930b8f8b3484b93a83c3c14a8ef69bb2020-11-25T02:02:24ZengCopernicus PublicationsAtmospheric Measurement Techniques1867-13811867-85482020-04-01131693170710.5194/amt-13-1693-2020Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methodsM. Si0M. Si1Y. Xiong2S. Du3K. Du4Department of Mechanical and Manufacturing Engineering, University of Calgary, 2500 University Drive, T2N 1N4, NW, Calgary, AB, CanadaTetra Tech Canada Inc., 140 Quarry Park Blvd, T2C 3G3, Calgary, AB, CanadaDepartment of Mechanical and Manufacturing Engineering, University of Calgary, 2500 University Drive, T2N 1N4, NW, Calgary, AB, CanadaDepartment of Computer Science, Lakehead University, 955 Oliver Road, Thunder Bay, P7B 5E1, ON, Canada, Department of Mechanical and Manufacturing Engineering, University of Calgary, 2500 University Drive, T2N 1N4, NW, Calgary, AB, Canada<p>Particle sensing technology has shown great potential for monitoring particulate matter (PM) with very few temporal and spatial restrictions because of its low cost, compact size, and easy operation. However, the performance of low-cost sensors for PM monitoring in ambient conditions has not been thoroughly evaluated. Monitoring results by low-cost sensors are often questionable. In this study, a low-cost fine particle monitor (Plantower PMS 5003) was colocated with a reference instrument, the Synchronized Hybrid Ambient Real-time Particulate (SHARP) monitor, at the Calgary Varsity air monitoring station from December 2018 to April 2019. The study evaluated the performance of this low-cost PM sensor in ambient conditions and calibrated its readings using simple linear regression (SLR), multiple linear regression (MLR), and two more powerful machine-learning algorithms using random search techniques for the best model architectures. The two machine-learning algorithms are XGBoost and a feedforward neural network (NN). Field evaluation showed that the Pearson correlation (<span class="inline-formula"><i>r</i></span>) between the low-cost sensor and the SHARP instrument was 0.78. The Fligner and Killeen (F–K) test indicated a statistically significant difference between the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the low-cost sensor and the SHARP instrument. Large overestimations by the low-cost sensor before calibration were observed in the field and were believed to be caused by the variation of ambient relative humidity. The root mean square error (RMSE) was 9.93 when comparing the low-cost sensor with the SHARP instrument. The calibration by the feedforward NN had the smallest RMSE of 3.91 in the test dataset compared to the calibrations by SLR (4.91), MLR (4.65), and XGBoost (4.19). After calibrations, the F–K test using the test dataset showed that the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the NN, XGBoost, and the reference method were not statistically significantly different. From this study, we conclude that a feedforward NN is a promising method to address the poor performance of low-cost sensors for PM<span class="inline-formula"><sub>2.5</sub></span> monitoring. In addition, the random search method for hyperparameters was demonstrated to be an efficient approach for selecting the best model structure.</p>https://www.atmos-meas-tech.net/13/1693/2020/amt-13-1693-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author M. Si
M. Si
Y. Xiong
S. Du
K. Du
spellingShingle M. Si
M. Si
Y. Xiong
S. Du
K. Du
Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
Atmospheric Measurement Techniques
author_facet M. Si
M. Si
Y. Xiong
S. Du
K. Du
author_sort M. Si
title Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
title_short Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
title_full Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
title_fullStr Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
title_full_unstemmed Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
title_sort evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
publisher Copernicus Publications
series Atmospheric Measurement Techniques
issn 1867-1381
1867-8548
publishDate 2020-04-01
description <p>Particle sensing technology has shown great potential for monitoring particulate matter (PM) with very few temporal and spatial restrictions because of its low cost, compact size, and easy operation. However, the performance of low-cost sensors for PM monitoring in ambient conditions has not been thoroughly evaluated. Monitoring results by low-cost sensors are often questionable. In this study, a low-cost fine particle monitor (Plantower PMS 5003) was colocated with a reference instrument, the Synchronized Hybrid Ambient Real-time Particulate (SHARP) monitor, at the Calgary Varsity air monitoring station from December 2018 to April 2019. The study evaluated the performance of this low-cost PM sensor in ambient conditions and calibrated its readings using simple linear regression (SLR), multiple linear regression (MLR), and two more powerful machine-learning algorithms using random search techniques for the best model architectures. The two machine-learning algorithms are XGBoost and a feedforward neural network (NN). Field evaluation showed that the Pearson correlation (<span class="inline-formula"><i>r</i></span>) between the low-cost sensor and the SHARP instrument was 0.78. The Fligner and Killeen (F–K) test indicated a statistically significant difference between the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the low-cost sensor and the SHARP instrument. Large overestimations by the low-cost sensor before calibration were observed in the field and were believed to be caused by the variation of ambient relative humidity. The root mean square error (RMSE) was 9.93 when comparing the low-cost sensor with the SHARP instrument. The calibration by the feedforward NN had the smallest RMSE of 3.91 in the test dataset compared to the calibrations by SLR (4.91), MLR (4.65), and XGBoost (4.19). After calibrations, the F–K test using the test dataset showed that the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the NN, XGBoost, and the reference method were not statistically significantly different. From this study, we conclude that a feedforward NN is a promising method to address the poor performance of low-cost sensors for PM<span class="inline-formula"><sub>2.5</sub></span> monitoring. In addition, the random search method for hyperparameters was demonstrated to be an efficient approach for selecting the best model structure.</p>
url https://www.atmos-meas-tech.net/13/1693/2020/amt-13-1693-2020.pdf
work_keys_str_mv AT msi evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods
AT msi evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods
AT yxiong evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods
AT sdu evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods
AT kdu evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods
_version_ 1724953135612428288