Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.
In this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2018-01-01
|
Series: | PLoS ONE |
Online Access: | http://europepmc.org/articles/PMC6047804?pdf=render |
id |
doaj-4bcc5ffc32154e30800aadaabfb1d2f3 |
---|---|
record_format |
Article |
spelling |
doaj-4bcc5ffc32154e30800aadaabfb1d2f32020-11-25T01:46:30ZengPublic Library of Science (PLoS)PLoS ONE1932-62032018-01-01137e020065010.1371/journal.pone.0200650Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions.Susana Lopez-AparicioHenrik GrytheMatthias VogtMatthew PierceIslen VallejoIn this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion (RWC). The first method is a webcrawler that extracts openly online available real estate data in a systematic way, and thereafter structures them for analysis. The webcrawler reads online Norwegian real estate advertisements and it collects the geo-position of the dwellings. Dwellings are classified according to the type (e.g., apartment, detached house) they belong to and the heating systems they are equipped with. The second method is a model trained for image recognition and classification based on machine learning techniques. The images from the real estate advertisements are collected and processed to identify wood burning installations, which are automatically classified according to the three classes used in official statistics, i.e., open fireplaces, stoves produced before 1998 and stoves produced after 1998. The model recognizes and classifies the wood appliances with a precision of 81%, 85% and 91% for open fireplaces, old stoves and new stoves, respectively. Emission factors are heavily dependent on technology and this information is therefore essential for determining accurate emissions. The collected data are compared with existing information from the statistical register at county and national level in Norway. The comparison shows good agreement for the proportion of residential heating systems between the webcrawled data and the official statistics. The high resolution and level of detail of the extracted data show the value of open data to improve emission inventories. With the increased amount and availability of data, the techniques presented here add significant value to emission accuracy and potential applications should also be considered across all emission sectors.http://europepmc.org/articles/PMC6047804?pdf=render |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Susana Lopez-Aparicio Henrik Grythe Matthias Vogt Matthew Pierce Islen Vallejo |
spellingShingle |
Susana Lopez-Aparicio Henrik Grythe Matthias Vogt Matthew Pierce Islen Vallejo Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. PLoS ONE |
author_facet |
Susana Lopez-Aparicio Henrik Grythe Matthias Vogt Matthew Pierce Islen Vallejo |
author_sort |
Susana Lopez-Aparicio |
title |
Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. |
title_short |
Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. |
title_full |
Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. |
title_fullStr |
Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. |
title_full_unstemmed |
Webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. |
title_sort |
webcrawling and machine learning as a new approach for the spatial distribution of atmospheric emissions. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2018-01-01 |
description |
In this study we apply two methods for data collection that are relatively new in the field of atmospheric science. The two developed methods are designed to collect essential geo-localized information to be used as input data for a high resolution emission inventory for residential wood combustion (RWC). The first method is a webcrawler that extracts openly online available real estate data in a systematic way, and thereafter structures them for analysis. The webcrawler reads online Norwegian real estate advertisements and it collects the geo-position of the dwellings. Dwellings are classified according to the type (e.g., apartment, detached house) they belong to and the heating systems they are equipped with. The second method is a model trained for image recognition and classification based on machine learning techniques. The images from the real estate advertisements are collected and processed to identify wood burning installations, which are automatically classified according to the three classes used in official statistics, i.e., open fireplaces, stoves produced before 1998 and stoves produced after 1998. The model recognizes and classifies the wood appliances with a precision of 81%, 85% and 91% for open fireplaces, old stoves and new stoves, respectively. Emission factors are heavily dependent on technology and this information is therefore essential for determining accurate emissions. The collected data are compared with existing information from the statistical register at county and national level in Norway. The comparison shows good agreement for the proportion of residential heating systems between the webcrawled data and the official statistics. The high resolution and level of detail of the extracted data show the value of open data to improve emission inventories. With the increased amount and availability of data, the techniques presented here add significant value to emission accuracy and potential applications should also be considered across all emission sectors. |
url |
http://europepmc.org/articles/PMC6047804?pdf=render |
work_keys_str_mv |
AT susanalopezaparicio webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions AT henrikgrythe webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions AT matthiasvogt webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions AT matthewpierce webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions AT islenvallejo webcrawlingandmachinelearningasanewapproachforthespatialdistributionofatmosphericemissions |
_version_ |
1725019071183847424 |