Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation

Urban sprawl related increase of built-in areas requires reliable monitoring methods and remote sensing can be an efficient technique. Aerial surveys, with high spatial resolution, provide detailed data for building monitoring, but archive images usually have only visible bands. We aimed to reveal t...

Full description

Bibliographic Details
Main Authors: Aletta Dóra Schlosser, Gergely Szabó, László Bertalan, Zsolt Varga, Péter Enyedi, Szilárd Szabó
Format: Article
Language:English
Published: MDPI AG 2020-07-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/12/15/2397
id doaj-f6b0c0366dda43bf8fa8335ab79ba41d
record_format Article
spelling doaj-f6b0c0366dda43bf8fa8335ab79ba41d2020-11-25T03:32:07ZengMDPI AGRemote Sensing2072-42922020-07-01122397239710.3390/rs12152397Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and SegmentationAletta Dóra Schlosser0Gergely Szabó1László Bertalan2Zsolt Varga3Péter Enyedi4Szilárd Szabó5Doctoral School of Earth Sciences, Department of Physical Geography and Geoinformation Systems, Faculty of Sciences and Technology, University of Debrecen, 4032 Debrecen, HungaryDepartment of Physical Geography and Geoinformation Systems, Faculty of Sciences and Technology, University of Debrecen, 4032 Debrecen, HungaryDepartment of Physical Geography and Geoinformation Systems, Faculty of Sciences and Technology, University of Debrecen, 4032 Debrecen, HungaryDepartment of Civil Engineering, Faculty of Engineering, University of Debrecen, 4028 Debrecen, HungaryEnvirosense Ltd., 4032 Debrecen, HungaryDepartment of Physical Geography and Geoinformation Systems, Faculty of Sciences and Technology, University of Debrecen, 4032 Debrecen, HungaryUrban sprawl related increase of built-in areas requires reliable monitoring methods and remote sensing can be an efficient technique. Aerial surveys, with high spatial resolution, provide detailed data for building monitoring, but archive images usually have only visible bands. We aimed to reveal the efficiency of visible orthophotographs and photogrammetric dense point clouds in building detection with segmentation-based machine learning (with five algorithms) using visible bands, texture information, and spectral and morphometric indices in different variable sets. Usually random forest (RF) had the best (99.8%) and partial least squares the worst overall accuracy (~60%). We found that >95% accuracy can be gained even in class level. Recursive feature elimination (RFE) was an efficient variable selection tool, its result with six variables was like when we applied all the available 31 variables. Morphometric indices had 82% producer’s and 85% user’s Accuracy (PA and UA, respectively) and combining them with spectral and texture indices, it had the largest contribution in the improvement. However, morphometric indices are not always available but by adding texture and spectral indices to red-green-blue (RGB) bands the PA improved with 12% and the UA with 6%. Building extraction from visual aerial surveys can be accurate, and archive images can be involved in the time series of a monitoring.https://www.mdpi.com/2072-4292/12/15/2397photogrammetryRGB indicesimage texturemorphometric indicesrecursive feature eliminationrandom forest
collection DOAJ
language English
format Article
sources DOAJ
author Aletta Dóra Schlosser
Gergely Szabó
László Bertalan
Zsolt Varga
Péter Enyedi
Szilárd Szabó
spellingShingle Aletta Dóra Schlosser
Gergely Szabó
László Bertalan
Zsolt Varga
Péter Enyedi
Szilárd Szabó
Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation
Remote Sensing
photogrammetry
RGB indices
image texture
morphometric indices
recursive feature elimination
random forest
author_facet Aletta Dóra Schlosser
Gergely Szabó
László Bertalan
Zsolt Varga
Péter Enyedi
Szilárd Szabó
author_sort Aletta Dóra Schlosser
title Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation
title_short Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation
title_full Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation
title_fullStr Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation
title_full_unstemmed Building Extraction Using Orthophotos and Dense Point Cloud Derived from Visual Band Aerial Imagery Based on Machine Learning and Segmentation
title_sort building extraction using orthophotos and dense point cloud derived from visual band aerial imagery based on machine learning and segmentation
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2020-07-01
description Urban sprawl related increase of built-in areas requires reliable monitoring methods and remote sensing can be an efficient technique. Aerial surveys, with high spatial resolution, provide detailed data for building monitoring, but archive images usually have only visible bands. We aimed to reveal the efficiency of visible orthophotographs and photogrammetric dense point clouds in building detection with segmentation-based machine learning (with five algorithms) using visible bands, texture information, and spectral and morphometric indices in different variable sets. Usually random forest (RF) had the best (99.8%) and partial least squares the worst overall accuracy (~60%). We found that >95% accuracy can be gained even in class level. Recursive feature elimination (RFE) was an efficient variable selection tool, its result with six variables was like when we applied all the available 31 variables. Morphometric indices had 82% producer’s and 85% user’s Accuracy (PA and UA, respectively) and combining them with spectral and texture indices, it had the largest contribution in the improvement. However, morphometric indices are not always available but by adding texture and spectral indices to red-green-blue (RGB) bands the PA improved with 12% and the UA with 6%. Building extraction from visual aerial surveys can be accurate, and archive images can be involved in the time series of a monitoring.
topic photogrammetry
RGB indices
image texture
morphometric indices
recursive feature elimination
random forest
url https://www.mdpi.com/2072-4292/12/15/2397
work_keys_str_mv AT alettadoraschlosser buildingextractionusingorthophotosanddensepointcloudderivedfromvisualbandaerialimagerybasedonmachinelearningandsegmentation
AT gergelyszabo buildingextractionusingorthophotosanddensepointcloudderivedfromvisualbandaerialimagerybasedonmachinelearningandsegmentation
AT laszlobertalan buildingextractionusingorthophotosanddensepointcloudderivedfromvisualbandaerialimagerybasedonmachinelearningandsegmentation
AT zsoltvarga buildingextractionusingorthophotosanddensepointcloudderivedfromvisualbandaerialimagerybasedonmachinelearningandsegmentation
AT peterenyedi buildingextractionusingorthophotosanddensepointcloudderivedfromvisualbandaerialimagerybasedonmachinelearningandsegmentation
AT szilardszabo buildingextractionusingorthophotosanddensepointcloudderivedfromvisualbandaerialimagerybasedonmachinelearningandsegmentation
_version_ 1724569556706394112