SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS
Semantic segmentation of point clouds is one of the main steps in automated processing of data from Airborne Laser Scanning (ALS). Established methods usually require expensive calculation of handcrafted, point-wise features. In contrast, Convolutional Neural Networks (CNNs) have been established as...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2019-05-01
|
Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/IV-2-W5/77/2019/isprs-annals-IV-2-W5-77-2019.pdf |
id |
doaj-85bbef421bd6413a9410a3f00726f6c8 |
---|---|
record_format |
Article |
spelling |
doaj-85bbef421bd6413a9410a3f00726f6c82020-11-25T01:13:59ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502019-05-01IV-2-W5778410.5194/isprs-annals-IV-2-W5-77-2019SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDSS. Schmohl0U. Sörgel1Institute for Photogrammetry, University of Stuttgart, GermanyInstitute for Photogrammetry, University of Stuttgart, GermanySemantic segmentation of point clouds is one of the main steps in automated processing of data from Airborne Laser Scanning (ALS). Established methods usually require expensive calculation of handcrafted, point-wise features. In contrast, Convolutional Neural Networks (CNNs) have been established as powerful classifiers, which at the same time also learn a set of features by themselves. However, their application to ALS data is not trivial. Pure 3D CNNs require a lot of memory and computing time, therefore most related approaches project ALS point clouds into two-dimensional images. Sparse Submanifold Convolutional Networks (SSCNs) address this issue by exploiting the sparsity often inherent in 3D data. In this work, we propose the application of SSCNs for efficient semantic segmentation of voxelized ALS point clouds in an end-to-end encoder-decoder architecture. We evaluate this method on the ISPRS Vaihingen 3D Semantic Labeling benchmark and achieve state-of-the-art 85.0% overall accuracy. Furthermore, we demonstrate its capabilities regarding large-scale ALS data by classifying a 2.5 km<sup>2</sup> subset containing 41 M points from the Actueel Hoogtebestand Nederland (AHN3) with 95% overall accuracy in just 48 s inference time or with 96% in 108 s.https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/IV-2-W5/77/2019/isprs-annals-IV-2-W5-77-2019.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
S. Schmohl U. Sörgel |
spellingShingle |
S. Schmohl U. Sörgel SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
author_facet |
S. Schmohl U. Sörgel |
author_sort |
S. Schmohl |
title |
SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS |
title_short |
SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS |
title_full |
SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS |
title_fullStr |
SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS |
title_full_unstemmed |
SUBMANIFOLD SPARSE CONVOLUTIONAL NETWORKS FOR SEMANTIC SEGMENTATION OF LARGE-SCALE ALS POINT CLOUDS |
title_sort |
submanifold sparse convolutional networks for semantic segmentation of large-scale als point clouds |
publisher |
Copernicus Publications |
series |
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
issn |
2194-9042 2194-9050 |
publishDate |
2019-05-01 |
description |
Semantic segmentation of point clouds is one of the main steps in automated processing of data from Airborne Laser Scanning (ALS). Established methods usually require expensive calculation of handcrafted, point-wise features. In contrast, Convolutional Neural Networks (CNNs) have been established as powerful classifiers, which at the same time also learn a set of features by themselves. However, their application to ALS data is not trivial. Pure 3D CNNs require a lot of memory and computing time, therefore most related approaches project ALS point clouds into two-dimensional images. Sparse Submanifold Convolutional Networks (SSCNs) address this issue by exploiting the sparsity often inherent in 3D data. In this work, we propose the application of SSCNs for efficient semantic segmentation of voxelized ALS point clouds in an end-to-end encoder-decoder architecture. We evaluate this method on the ISPRS Vaihingen 3D Semantic Labeling benchmark and achieve state-of-the-art 85.0% overall accuracy. Furthermore, we demonstrate its capabilities regarding large-scale ALS data by classifying a 2.5 km<sup>2</sup> subset containing 41 M points from the Actueel Hoogtebestand Nederland (AHN3) with 95% overall accuracy in just 48 s inference time or with 96% in 108 s. |
url |
https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/IV-2-W5/77/2019/isprs-annals-IV-2-W5-77-2019.pdf |
work_keys_str_mv |
AT sschmohl submanifoldsparseconvolutionalnetworksforsemanticsegmentationoflargescalealspointclouds AT usorgel submanifoldsparseconvolutionalnetworksforsemanticsegmentationoflargescalealspointclouds |
_version_ |
1725159437678673920 |