Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods
<p>Particle sensing technology has shown great potential for monitoring particulate matter (PM) with very few temporal and spatial restrictions because of its low cost, compact size, and easy operation. However, the performance of low-cost sensors for PM monitoring in ambient conditions has no...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2020-04-01
|
Series: | Atmospheric Measurement Techniques |
Online Access: | https://www.atmos-meas-tech.net/13/1693/2020/amt-13-1693-2020.pdf |
id |
doaj-7930b8f8b3484b93a83c3c14a8ef69bb |
---|---|
record_format |
Article |
spelling |
doaj-7930b8f8b3484b93a83c3c14a8ef69bb2020-11-25T02:02:24ZengCopernicus PublicationsAtmospheric Measurement Techniques1867-13811867-85482020-04-01131693170710.5194/amt-13-1693-2020Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methodsM. Si0M. Si1Y. Xiong2S. Du3K. Du4Department of Mechanical and Manufacturing Engineering, University of Calgary, 2500 University Drive, T2N 1N4, NW, Calgary, AB, CanadaTetra Tech Canada Inc., 140 Quarry Park Blvd, T2C 3G3, Calgary, AB, CanadaDepartment of Mechanical and Manufacturing Engineering, University of Calgary, 2500 University Drive, T2N 1N4, NW, Calgary, AB, CanadaDepartment of Computer Science, Lakehead University, 955 Oliver Road, Thunder Bay, P7B 5E1, ON, Canada, Department of Mechanical and Manufacturing Engineering, University of Calgary, 2500 University Drive, T2N 1N4, NW, Calgary, AB, Canada<p>Particle sensing technology has shown great potential for monitoring particulate matter (PM) with very few temporal and spatial restrictions because of its low cost, compact size, and easy operation. However, the performance of low-cost sensors for PM monitoring in ambient conditions has not been thoroughly evaluated. Monitoring results by low-cost sensors are often questionable. In this study, a low-cost fine particle monitor (Plantower PMS 5003) was colocated with a reference instrument, the Synchronized Hybrid Ambient Real-time Particulate (SHARP) monitor, at the Calgary Varsity air monitoring station from December 2018 to April 2019. The study evaluated the performance of this low-cost PM sensor in ambient conditions and calibrated its readings using simple linear regression (SLR), multiple linear regression (MLR), and two more powerful machine-learning algorithms using random search techniques for the best model architectures. The two machine-learning algorithms are XGBoost and a feedforward neural network (NN). Field evaluation showed that the Pearson correlation (<span class="inline-formula"><i>r</i></span>) between the low-cost sensor and the SHARP instrument was 0.78. The Fligner and Killeen (F–K) test indicated a statistically significant difference between the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the low-cost sensor and the SHARP instrument. Large overestimations by the low-cost sensor before calibration were observed in the field and were believed to be caused by the variation of ambient relative humidity. The root mean square error (RMSE) was 9.93 when comparing the low-cost sensor with the SHARP instrument. The calibration by the feedforward NN had the smallest RMSE of 3.91 in the test dataset compared to the calibrations by SLR (4.91), MLR (4.65), and XGBoost (4.19). After calibrations, the F–K test using the test dataset showed that the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the NN, XGBoost, and the reference method were not statistically significantly different. From this study, we conclude that a feedforward NN is a promising method to address the poor performance of low-cost sensors for PM<span class="inline-formula"><sub>2.5</sub></span> monitoring. In addition, the random search method for hyperparameters was demonstrated to be an efficient approach for selecting the best model structure.</p>https://www.atmos-meas-tech.net/13/1693/2020/amt-13-1693-2020.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
M. Si M. Si Y. Xiong S. Du K. Du |
spellingShingle |
M. Si M. Si Y. Xiong S. Du K. Du Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods Atmospheric Measurement Techniques |
author_facet |
M. Si M. Si Y. Xiong S. Du K. Du |
author_sort |
M. Si |
title |
Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods |
title_short |
Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods |
title_full |
Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods |
title_fullStr |
Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods |
title_full_unstemmed |
Evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods |
title_sort |
evaluation and calibration of a low-cost particle sensor in ambient conditions using machine-learning methods |
publisher |
Copernicus Publications |
series |
Atmospheric Measurement Techniques |
issn |
1867-1381 1867-8548 |
publishDate |
2020-04-01 |
description |
<p>Particle sensing technology has shown great potential for
monitoring particulate matter (PM) with very few temporal and spatial
restrictions because of its low cost, compact size, and easy operation.
However, the performance of low-cost sensors for PM monitoring in ambient
conditions has not been thoroughly evaluated. Monitoring results by low-cost
sensors are often questionable. In this study, a low-cost fine particle
monitor (Plantower PMS 5003) was colocated with a reference instrument,
the Synchronized Hybrid Ambient Real-time Particulate (SHARP) monitor, at the
Calgary Varsity air monitoring station from December 2018 to April 2019. The
study evaluated the performance of this low-cost PM sensor in ambient
conditions and calibrated its readings using simple linear regression (SLR),
multiple linear regression (MLR), and two more powerful machine-learning
algorithms using random search techniques for the best model architectures.
The two machine-learning algorithms are XGBoost and a feedforward neural
network (NN). Field evaluation showed that the Pearson correlation (<span class="inline-formula"><i>r</i></span>) between the
low-cost sensor and the SHARP instrument was 0.78. The Fligner and Killeen (F–K)
test indicated a statistically significant difference between the variances
of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the low-cost sensor and the SHARP
instrument. Large overestimations by the low-cost sensor before calibration
were observed in the field and were believed to be caused by the variation
of ambient relative humidity. The root mean square error (RMSE) was 9.93
when comparing the low-cost sensor with the SHARP instrument. The
calibration by the feedforward NN had the smallest RMSE of 3.91 in the test
dataset compared to the calibrations by SLR (4.91), MLR (4.65), and XGBoost
(4.19). After calibrations, the F–K test using the test dataset showed that
the variances of the PM<span class="inline-formula"><sub>2.5</sub></span> values by the NN, XGBoost, and the
reference method were not statistically significantly different. From this
study, we conclude that a feedforward NN is a promising method to address the
poor performance of low-cost sensors for PM<span class="inline-formula"><sub>2.5</sub></span> monitoring. In
addition, the random search method for hyperparameters was demonstrated to
be an efficient approach for selecting the best model structure.</p> |
url |
https://www.atmos-meas-tech.net/13/1693/2020/amt-13-1693-2020.pdf |
work_keys_str_mv |
AT msi evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods AT msi evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods AT yxiong evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods AT sdu evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods AT kdu evaluationandcalibrationofalowcostparticlesensorinambientconditionsusingmachinelearningmethods |
_version_ |
1724953135612428288 |