Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
The rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This article marks the first at...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9419720/ |
id |
doaj-d1c1717ef0a94b4eb3482e91da14c351 |
---|---|
record_format |
Article |
spelling |
doaj-d1c1717ef0a94b4eb3482e91da14c3512021-06-07T23:00:07ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352021-01-01145137515110.1109/JSTARS.2021.30766309419720Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic BiasesXiao Huang0https://orcid.org/0000-0002-4323-382XDi Zhu1Fan Zhang2Tao Liu3Xiao Li4https://orcid.org/0000-0002-6762-2475Lei Zou5Department of Geosciences, University of Arkansas, Fayetteville, AR, USADepartment of Geography, Environment, and Society, University of Minnesota, Minneapolis, MN, USADepartment of Urban Studies and Planning, Massachusetts Institute of Technology, Cambridge, MA, USACollege of Forest Resources and Environmental Science, Michigan Technological University, Houghton, MI, USATexas A&M Transportation Institute, Texas A&M University, College Station, TX, USADepartment of Geography, Texas A&M University, College Station, TX, USAThe rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This article marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images, investigate the contribution of neighboring effect, and explore the potential systematic population estimation biases. We conduct an end-to-end training of four popular deep learning architectures, i.e., VGG, ResNet, Xception, and DenseNet, by establishing a mapping between Sentinel-2 image patches and their corresponding population count from the LandScan population grid. The results reveal that DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. As for the neighboring effect, contradicting existing studies, our results suggest that the increase of neighboring sizes leads to reduced population estimation performance, which is found universal for all four selected models in all evaluating metrics. In addition, there exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes. The methodological, experimental, and contextual knowledge this article provides is expected to benefit a wide range of future studies that estimate population distribution via remote sensing imagery.https://ieeexplore.ieee.org/document/9419720/Deep learningend-to-end architecturepopulation estimationsatellite imagerysystematic biases |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Xiao Huang Di Zhu Fan Zhang Tao Liu Xiao Li Lei Zou |
spellingShingle |
Xiao Huang Di Zhu Fan Zhang Tao Liu Xiao Li Lei Zou Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Deep learning end-to-end architecture population estimation satellite imagery systematic biases |
author_facet |
Xiao Huang Di Zhu Fan Zhang Tao Liu Xiao Li Lei Zou |
author_sort |
Xiao Huang |
title |
Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases |
title_short |
Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases |
title_full |
Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases |
title_fullStr |
Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases |
title_full_unstemmed |
Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases |
title_sort |
sensing population distribution from satellite imagery via deep learning:model selection, neighboring effects, and systematic biases |
publisher |
IEEE |
series |
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
issn |
2151-1535 |
publishDate |
2021-01-01 |
description |
The rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This article marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images, investigate the contribution of neighboring effect, and explore the potential systematic population estimation biases. We conduct an end-to-end training of four popular deep learning architectures, i.e., VGG, ResNet, Xception, and DenseNet, by establishing a mapping between Sentinel-2 image patches and their corresponding population count from the LandScan population grid. The results reveal that DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. As for the neighboring effect, contradicting existing studies, our results suggest that the increase of neighboring sizes leads to reduced population estimation performance, which is found universal for all four selected models in all evaluating metrics. In addition, there exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes. The methodological, experimental, and contextual knowledge this article provides is expected to benefit a wide range of future studies that estimate population distribution via remote sensing imagery. |
topic |
Deep learning end-to-end architecture population estimation satellite imagery systematic biases |
url |
https://ieeexplore.ieee.org/document/9419720/ |
work_keys_str_mv |
AT xiaohuang sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases AT dizhu sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases AT fanzhang sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases AT taoliu sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases AT xiaoli sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases AT leizou sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases |
_version_ |
1721391182404124672 |