Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases

The rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This article marks the first at...

Full description

Bibliographic Details
Main Authors: Xiao Huang, Di Zhu, Fan Zhang, Tao Liu, Xiao Li, Lei Zou
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9419720/
id doaj-d1c1717ef0a94b4eb3482e91da14c351
record_format Article
spelling doaj-d1c1717ef0a94b4eb3482e91da14c3512021-06-07T23:00:07ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352021-01-01145137515110.1109/JSTARS.2021.30766309419720Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic BiasesXiao Huang0https://orcid.org/0000-0002-4323-382XDi Zhu1Fan Zhang2Tao Liu3Xiao Li4https://orcid.org/0000-0002-6762-2475Lei Zou5Department of Geosciences, University of Arkansas, Fayetteville, AR, USADepartment of Geography, Environment, and Society, University of Minnesota, Minneapolis, MN, USADepartment of Urban Studies and Planning, Massachusetts Institute of Technology, Cambridge, MA, USACollege of Forest Resources and Environmental Science, Michigan Technological University, Houghton, MI, USATexas A&M Transportation Institute, Texas A&M University, College Station, TX, USADepartment of Geography, Texas A&M University, College Station, TX, USAThe rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This article marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images, investigate the contribution of neighboring effect, and explore the potential systematic population estimation biases. We conduct an end-to-end training of four popular deep learning architectures, i.e., VGG, ResNet, Xception, and DenseNet, by establishing a mapping between Sentinel-2 image patches and their corresponding population count from the LandScan population grid. The results reveal that DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. As for the neighboring effect, contradicting existing studies, our results suggest that the increase of neighboring sizes leads to reduced population estimation performance, which is found universal for all four selected models in all evaluating metrics. In addition, there exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes. The methodological, experimental, and contextual knowledge this article provides is expected to benefit a wide range of future studies that estimate population distribution via remote sensing imagery.https://ieeexplore.ieee.org/document/9419720/Deep learningend-to-end architecturepopulation estimationsatellite imagerysystematic biases
collection DOAJ
language English
format Article
sources DOAJ
author Xiao Huang
Di Zhu
Fan Zhang
Tao Liu
Xiao Li
Lei Zou
spellingShingle Xiao Huang
Di Zhu
Fan Zhang
Tao Liu
Xiao Li
Lei Zou
Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Deep learning
end-to-end architecture
population estimation
satellite imagery
systematic biases
author_facet Xiao Huang
Di Zhu
Fan Zhang
Tao Liu
Xiao Li
Lei Zou
author_sort Xiao Huang
title Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
title_short Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
title_full Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
title_fullStr Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
title_full_unstemmed Sensing Population Distribution from Satellite Imagery Via Deep Learning:Model Selection, Neighboring Effects, and Systematic Biases
title_sort sensing population distribution from satellite imagery via deep learning:model selection, neighboring effects, and systematic biases
publisher IEEE
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
issn 2151-1535
publishDate 2021-01-01
description The rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This article marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images, investigate the contribution of neighboring effect, and explore the potential systematic population estimation biases. We conduct an end-to-end training of four popular deep learning architectures, i.e., VGG, ResNet, Xception, and DenseNet, by establishing a mapping between Sentinel-2 image patches and their corresponding population count from the LandScan population grid. The results reveal that DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. As for the neighboring effect, contradicting existing studies, our results suggest that the increase of neighboring sizes leads to reduced population estimation performance, which is found universal for all four selected models in all evaluating metrics. In addition, there exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes. The methodological, experimental, and contextual knowledge this article provides is expected to benefit a wide range of future studies that estimate population distribution via remote sensing imagery.
topic Deep learning
end-to-end architecture
population estimation
satellite imagery
systematic biases
url https://ieeexplore.ieee.org/document/9419720/
work_keys_str_mv AT xiaohuang sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases
AT dizhu sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases
AT fanzhang sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases
AT taoliu sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases
AT xiaoli sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases
AT leizou sensingpopulationdistributionfromsatelliteimageryviadeeplearningmodelselectionneighboringeffectsandsystematicbiases
_version_ 1721391182404124672