Semantic segmentation of point clouds of building interiors with deep learning: Augmenting training datasets with synthetic BIM-based point clouds

Jong Won Ma, Thomas Czerniawski, Fernanda Leite

Research output: Contribution to journalArticlepeer-review

13 Scopus citations

Abstract

This paper investigates the viability of using synthetic point clouds generated from building information models (BIMs) to train deep neural networks to perform semantic segmentation of point clouds of building interiors. In order to achieve these goals, this paper first presents a procedure for converting digital 3D BIMs into synthetic point clouds using three commercially available software systems. Then the generated synthetic point clouds are used to train a deep neural network. Semantic segmentation performance is compared for several models trained on: real point clouds, synthetic point clouds, and combinations of real and synthetic point clouds. A key finding is the 7.1% IOU boost in performance achieved when a small real point cloud dataset is augmented by synthetic point clouds for training, as compared to training the classifier on the real data alone. The experimental results confirmed the viability of using synthetic point clouds generated from building information models in combination with small datasets of real point clouds. This opens up the possibility of developing a segmentation model for building interiors that can be applied to as-built modeling of buildings that contain unseen indoor structures.

Original languageEnglish (US)
Article number103144
JournalAutomation in construction
Volume113
DOIs
StatePublished - May 2020
Externally publishedYes

Keywords

  • Building information model
  • Deep learning algorithm
  • Point clouds
  • Semantic segmentation
  • Synthetic dataset

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Civil and Structural Engineering
  • Building and Construction

Fingerprint Dive into the research topics of 'Semantic segmentation of point clouds of building interiors with deep learning: Augmenting training datasets with synthetic BIM-based point clouds'. Together they form a unique fingerprint.

Cite this