Semantic Extraction of Permanent Structures for the Reconstruction of Building Interiors from Point Clouds

• Main Authors: Inge Coudron, Steven Puttemans, Toon Goedemé, Patrick Vandewalle
• Format: Article
• Language: English
• Published: MDPI AG 2020-12-01
• Series: Sensors
• Subjects: deep learning; semantic segmentation; semantic completion; indoor 3D reconstruction
• Online Access: https://www.mdpi.com/1424-8220/20/23/6916

The extraction of permanent structures (such as walls, floors, and ceilings) is an important step in the reconstruction of building interiors from point clouds. These permanent structures are, in general, assumed to be planar. However, point clouds from building interiors often also contain clutter with planar surfaces such as furniture, cabinets, etc. Hence, not all planar surfaces that are extracted belong to permanent structures. This is undesirable as it can result in geometric errors in the reconstruction. Therefore, it is important that reconstruction methods can correctly detect and extract all permanent structures even in the presence of such clutter. We propose to perform semantic scene completion using deep learning, prior to the extraction of permanent structures to improve the reconstruction results. For this, we started from the ScanComplete network proposed by Dai et al. We adapted the network to use a different input representation to eliminate the need for scanning trajectory information as this is not always available. Furthermore, we optimized the architecture to make inference and training significantly faster. To further improve the results of the network, we created a more realistic dataset based on real-life scans from building interiors. The experimental results show that our approach significantly improves the extraction of the permanent structures from both synthetically generated as well as real-life point clouds, thereby improving the overall reconstruction results.