Input-Adaptive Proxy for Black Carbon as a Virtual Sensor

Missing data has been a challenge in air quality measurement. In this study, we develop an input-adaptive proxy, which selects input variables of other air quality variables based on their correlation coefficients with the output variable. The proxy uses ordinary least squares regression model with...

Full description

Bibliographic Details
Main Authors: Pak Lun Fung, Martha A. Zaidan, Salla Sillanpää, Anu Kousa, Jarkko V. Niemi, Hilkka Timonen, Joel Kuula, Erkka Saukko, Krista Luoma, Tuukka Petäjä, Sasu Tarkoma, Markku Kulmala, Tareq Hussein
Format: Article
Language:English
Published: MDPI AG 2019-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/1/182
id doaj-7f1eed8279154bc3bd1ebd02b22328ee
record_format Article
spelling doaj-7f1eed8279154bc3bd1ebd02b22328ee2020-11-25T02:18:06ZengMDPI AGSensors1424-82202019-12-0120118210.3390/s20010182s20010182Input-Adaptive Proxy for Black Carbon as a Virtual SensorPak Lun Fung0Martha A. Zaidan1Salla Sillanpää2Anu Kousa3Jarkko V. Niemi4Hilkka Timonen5Joel Kuula6Erkka Saukko7Krista Luoma8Tuukka Petäjä9Sasu Tarkoma10Markku Kulmala11Tareq Hussein12Institute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandInstitute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandInstitute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandHelsinki Region Environmental Services Authority (HSY), P.O. Box 100, FI-00066 Helsinki, FinlandHelsinki Region Environmental Services Authority (HSY), P.O. Box 100, FI-00066 Helsinki, FinlandAtmospheric Composition Research, Finnish Meteorological Institute, FI-00560 Helsinki, FinlandAtmospheric Composition Research, Finnish Meteorological Institute, FI-00560 Helsinki, FinlandPegasor Oy, FI-33100 Tampere, FinlandInstitute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandInstitute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandDepartment of Computer Science, University of Helsinki, FI-00560 Helsinki, FinlandInstitute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandInstitute for Atmospheric and Earth System Research (INAR)/Physics, University of Helsinki, FI-00560 Helsinki, FinlandMissing data has been a challenge in air quality measurement. In this study, we develop an input-adaptive proxy, which selects input variables of other air quality variables based on their correlation coefficients with the output variable. The proxy uses ordinary least squares regression model with robust optimization and limits the input variables to a maximum of three to avoid overfitting. The adaptive proxy learns from the data set and generates the best model evaluated by adjusted coefficient of determination (adjR<sup>2</sup>). In case of missing data in the input variables, the proposed adaptive proxy then uses the second-best model until all the missing data gaps are filled up. We estimated black carbon (BC) concentration by using the input-adaptive proxy in two sites in Helsinki, which respectively represent street canyon and urban background scenario, as a case study. Accumulation mode, traffic counts, nitrogen dioxide and lung deposited surface area are found as input variables in models with the top rank. In contrast to traditional proxy, which gives 20&#8722;80% of data, the input-adaptive proxy manages to give full continuous BC estimation. The newly developed adaptive proxy also gives generally accurate BC (street canyon: adjR<sup>2</sup> = 0.86&#8722;0.94; urban background: adjR<sup>2</sup> = 0.74&#8722;0.91) depending on different seasons and day of the week. Due to its flexibility and reliability, the adaptive proxy can be further extend to estimate other air quality parameters. It can also act as an air quality virtual sensor in support with on-site measurements in the future.https://www.mdpi.com/1424-8220/20/1/182input-adaptive proxyblack carbonrobust linear regressionair qualitystreet canyonurban backgroundvirtual sensor
collection DOAJ
language English
format Article
sources DOAJ
author Pak Lun Fung
Martha A. Zaidan
Salla Sillanpää
Anu Kousa
Jarkko V. Niemi
Hilkka Timonen
Joel Kuula
Erkka Saukko
Krista Luoma
Tuukka Petäjä
Sasu Tarkoma
Markku Kulmala
Tareq Hussein
spellingShingle Pak Lun Fung
Martha A. Zaidan
Salla Sillanpää
Anu Kousa
Jarkko V. Niemi
Hilkka Timonen
Joel Kuula
Erkka Saukko
Krista Luoma
Tuukka Petäjä
Sasu Tarkoma
Markku Kulmala
Tareq Hussein
Input-Adaptive Proxy for Black Carbon as a Virtual Sensor
Sensors
input-adaptive proxy
black carbon
robust linear regression
air quality
street canyon
urban background
virtual sensor
author_facet Pak Lun Fung
Martha A. Zaidan
Salla Sillanpää
Anu Kousa
Jarkko V. Niemi
Hilkka Timonen
Joel Kuula
Erkka Saukko
Krista Luoma
Tuukka Petäjä
Sasu Tarkoma
Markku Kulmala
Tareq Hussein
author_sort Pak Lun Fung
title Input-Adaptive Proxy for Black Carbon as a Virtual Sensor
title_short Input-Adaptive Proxy for Black Carbon as a Virtual Sensor
title_full Input-Adaptive Proxy for Black Carbon as a Virtual Sensor
title_fullStr Input-Adaptive Proxy for Black Carbon as a Virtual Sensor
title_full_unstemmed Input-Adaptive Proxy for Black Carbon as a Virtual Sensor
title_sort input-adaptive proxy for black carbon as a virtual sensor
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2019-12-01
description Missing data has been a challenge in air quality measurement. In this study, we develop an input-adaptive proxy, which selects input variables of other air quality variables based on their correlation coefficients with the output variable. The proxy uses ordinary least squares regression model with robust optimization and limits the input variables to a maximum of three to avoid overfitting. The adaptive proxy learns from the data set and generates the best model evaluated by adjusted coefficient of determination (adjR<sup>2</sup>). In case of missing data in the input variables, the proposed adaptive proxy then uses the second-best model until all the missing data gaps are filled up. We estimated black carbon (BC) concentration by using the input-adaptive proxy in two sites in Helsinki, which respectively represent street canyon and urban background scenario, as a case study. Accumulation mode, traffic counts, nitrogen dioxide and lung deposited surface area are found as input variables in models with the top rank. In contrast to traditional proxy, which gives 20&#8722;80% of data, the input-adaptive proxy manages to give full continuous BC estimation. The newly developed adaptive proxy also gives generally accurate BC (street canyon: adjR<sup>2</sup> = 0.86&#8722;0.94; urban background: adjR<sup>2</sup> = 0.74&#8722;0.91) depending on different seasons and day of the week. Due to its flexibility and reliability, the adaptive proxy can be further extend to estimate other air quality parameters. It can also act as an air quality virtual sensor in support with on-site measurements in the future.
topic input-adaptive proxy
black carbon
robust linear regression
air quality
street canyon
urban background
virtual sensor
url https://www.mdpi.com/1424-8220/20/1/182
work_keys_str_mv AT paklunfung inputadaptiveproxyforblackcarbonasavirtualsensor
AT marthaazaidan inputadaptiveproxyforblackcarbonasavirtualsensor
AT sallasillanpaa inputadaptiveproxyforblackcarbonasavirtualsensor
AT anukousa inputadaptiveproxyforblackcarbonasavirtualsensor
AT jarkkovniemi inputadaptiveproxyforblackcarbonasavirtualsensor
AT hilkkatimonen inputadaptiveproxyforblackcarbonasavirtualsensor
AT joelkuula inputadaptiveproxyforblackcarbonasavirtualsensor
AT erkkasaukko inputadaptiveproxyforblackcarbonasavirtualsensor
AT kristaluoma inputadaptiveproxyforblackcarbonasavirtualsensor
AT tuukkapetaja inputadaptiveproxyforblackcarbonasavirtualsensor
AT sasutarkoma inputadaptiveproxyforblackcarbonasavirtualsensor
AT markkukulmala inputadaptiveproxyforblackcarbonasavirtualsensor
AT tareqhussein inputadaptiveproxyforblackcarbonasavirtualsensor
_version_ 1724883316539129856