Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.

In this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion...

Full description

Bibliographic Details
Main Authors: Susana Lopez-Aparicio, Henrik Grythe, Matthias Vogt, Matthew Pierce, Islen Vallejo
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2018-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC6047804?pdf=render
id doaj-4bcc5ffc32154e30800aadaabfb1d2f3
record_format Article
spelling doaj-4bcc5ffc32154e30800aadaabfb1d2f32020-11-25T01:46:30ZengPublic Library of Science (PLoS)PLoS ONE1932-62032018-01-01137e020065010.1371/journal.pone.0200650Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.Susana Lopez-AparicioHenrik GrytheMatthias VogtMatthew PierceIslen VallejoIn this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion (RWC). The first method is a webcrawler that extracts openly online available real estate data in a systematic way, and thereafter structures them for analysis. The webcrawler reads online Norwegian real estate advertisements and it collects the geo-position of the dwellings. Dwellings are classified according to the type (e.g., apartment, detached house) they belong to and the heating systems they are equipped with. The second method is a model trained for image recognition and classification based on machine learning techniques. The images from the real estate advertisements are collected and processed to identify wood burning installations, which are automatically classified according to the three classes used in official statistics, i.e., open fireplaces, stoves produced before 1998 and stoves produced after 1998. The model recognizes and classifies the wood appliances with a precision of 81%, 85% and 91% for open fireplaces, old stoves and new stoves, respectively. Emission factors are heavily dependent on technology and this information is therefore essential for determining accurate emissions. The collected data are compared with existing information from the statistical register at county and national level in Norway. The comparison shows good agreement for the proportion of residential heating systems between the webcrawled data and the official statistics. The high resolution and level of detail of the extracted data show the value of open data to improve emission inventories. With the increased amount and availability of data, the techniques presented here add significant value to emission accuracy and potential applications should also be considered across all emission sectors.http://europepmc.org/articles/PMC6047804?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author Susana Lopez-Aparicio
Henrik Grythe
Matthias Vogt
Matthew Pierce
Islen Vallejo
spellingShingle Susana Lopez-Aparicio
Henrik Grythe
Matthias Vogt
Matthew Pierce
Islen Vallejo
Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
PLoS ONE
author_facet Susana Lopez-Aparicio
Henrik Grythe
Matthias Vogt
Matthew Pierce
Islen Vallejo
author_sort Susana Lopez-Aparicio
title Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
title_short Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
title_full Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
title_fullStr Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
title_full_unstemmed Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
title_sort webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2018-01-01
description In this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion (RWC). The first method is a webcrawler that extracts openly online available real estate data in a systematic way, and thereafter structures them for analysis. The webcrawler reads online Norwegian real estate advertisements and it collects the geo-position of the dwellings. Dwellings are classified according to the type (e.g., apartment, detached house) they belong to and the heating systems they are equipped with. The second method is a model trained for image recognition and classification based on machine learning techniques. The images from the real estate advertisements are collected and processed to identify wood burning installations, which are automatically classified according to the three classes used in official statistics, i.e., open fireplaces, stoves produced before 1998 and stoves produced after 1998. The model recognizes and classifies the wood appliances with a precision of 81%, 85% and 91% for open fireplaces, old stoves and new stoves, respectively. Emission factors are heavily dependent on technology and this information is therefore essential for determining accurate emissions. The collected data are compared with existing information from the statistical register at county and national level in Norway. The comparison shows good agreement for the proportion of residential heating systems between the webcrawled data and the official statistics. The high resolution and level of detail of the extracted data show the value of open data to improve emission inventories. With the increased amount and availability of data, the techniques presented here add significant value to emission accuracy and potential applications should also be considered across all emission sectors.
url http://europepmc.org/articles/PMC6047804?pdf=render
work_keys_str_mv AT susanalopezaparicio webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions
AT henrikgrythe webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions
AT matthiasvogt webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions
AT matthewpierce webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions
AT islenvallejo webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions
_version_ 1725019071183847424