Multi-dataset synergistic in supervised learning to pre-label structural components in point clouds from shell construction scenes

• URL: http://arxiv.org/abs/2502.14721v1
• Date: Thu, 20 Feb 2025 16:48:14 GMT
• Title: Multi-dataset synergistic in supervised learning to pre-label structural components in point clouds from shell construction scenes
• Authors: Lukas Rauch, Thomas Braml,
• Abstract summary: This study addresses the challenges of segmenting complex structural components in Architecture, Engineering, and Construction (AEC) We establish a baseline through supervised training and a custom validation dataset, evaluate the cross-domain inference with large-scale indoor datasets, and utilize transfer learning to maximize segmentation performance with minimal new data.
• Score: 0.0
• License:
• Abstract: The significant effort required to annotate data for new training datasets hinders computer vision research and machine learning in the construction industry. This work explores adapting standard datasets and the latest transformer model architectures for point cloud semantic segmentation in the context of shell construction sites. Unlike common approaches focused on object segmentation of building interiors and furniture, this study addressed the challenges of segmenting complex structural components in Architecture, Engineering, and Construction (AEC). We establish a baseline through supervised training and a custom validation dataset, evaluate the cross-domain inference with large-scale indoor datasets, and utilize transfer learning to maximize segmentation performance with minimal new data. The findings indicate that with minimal fine-tuning, pre-trained transformer architectures offer an effective strategy for building component segmentation. Our results are promising for automating the annotation of new, previously unseen data when creating larger training resources and for the segmentation of frequently recurring objects.

Related papers

• Investigating Public Fine-Tuning Datasets: A Complex Review of Current Practices from a Construction Perspective [2.12587313410587]
  This paper reviews current public fine-tuning datasets from the perspective of data construction. An overview of public fine-tuning datasets from two sides: evolution and taxonomy, is provided in this review.
  arXiv  Detail & Related papers  (2024-07-11T13:11:16Z)
• Learning to Extract Structured Entities Using Language Models [52.281701191329]
  Recent advances in machine learning have significantly impacted the field of information extraction. We reformulate the task to be entity-centric, enabling the use of diverse metrics. We contribute to the field by introducing Structured Entity Extraction and proposing the Approximate Entity Set OverlaP metric.
  arXiv  Detail & Related papers  (2024-02-06T22:15:09Z)
• A Framework for Building Point Cloud Cleaning, Plane Detection and Semantic Segmentation [0.4604003661048266]
  We focus in the cleaning stage on removing outliers from the acquired point cloud data. Following the cleaning process, we perform plane detection using the robust RANSAC paradigm. The resulting segments can generate accurate and detailed point clouds representing the building's architectural elements.
  arXiv  Detail & Related papers  (2024-02-01T15:50:40Z)
• Interfacing Foundation Models' Embeddings [131.0352288172788]
  We present FIND, a generalized interface for aligning foundation models' embeddings with unified image and dataset-level understanding spanning modality and granularity. In light of the interleaved embedding space, we introduce FIND-Bench, which introduces new training and evaluation annotations to the COCO dataset for interleaved segmentation and retrieval.
  arXiv  Detail & Related papers  (2023-12-12T18:58:02Z)
• Open-Vocabulary Camouflaged Object Segmentation [66.94945066779988]
  We introduce a new task, open-vocabulary camouflaged object segmentation (OVCOS) We construct a large-scale complex scene dataset (textbfOVCamo) containing 11,483 hand-selected images with fine annotations and corresponding object classes. By integrating the guidance of class semantic knowledge and the supplement of visual structure cues from the edge and depth information, the proposed method can efficiently capture camouflaged objects.
  arXiv  Detail & Related papers  (2023-11-19T06:00:39Z)
• Segment Any Building [8.12405696290333]
  This manuscript accentuates the potency of harnessing diversified datasets in tandem with cutting-edge representation learning paradigms for building segmentation in such images. Our avant-garde joint training regimen underscores the merit of our approach, bearing significant implications in pivotal domains such as urban infrastructural development, disaster mitigation strategies, and ecological surveillance. The outcomes of this research both fortify the foundations for ensuing scholarly pursuits and presage a horizon replete with innovative applications in the discipline of building segmentation.
  arXiv  Detail & Related papers  (2023-10-02T12:49:20Z)
• Structural Concept Learning via Graph Attention for Multi-Level Rearrangement Planning [2.7195102129095003]
  We propose a deep learning approach to perform multi-level object rearrangement planning for scenes with structural dependency hierarchies. It is trained on a self-generated simulation data set with intuitive structures and works for unseen scenes with an arbitrary number of objects. We compare our method with a range of classical and model-based baselines to show that our method leverages its scene understanding to achieve better performance, flexibility, and efficiency.
  arXiv  Detail & Related papers  (2023-09-05T19:35:44Z)
• Simple and Efficient Architectures for Semantic Segmentation [50.1563637917129]
  We show that a simple encoder-decoder architecture with a ResNet-like backbone and a small multi-scale head, performs on-par or better than complex semantic segmentation architectures such as HRNet, FANet and DDRNet. We present a family of such simple architectures for desktop as well as mobile targets, which match or exceed the performance of complex models on the Cityscapes dataset.
  arXiv  Detail & Related papers  (2022-06-16T15:08:34Z)
• Towards Robust Part-aware Instance Segmentation for Industrial Bin Picking [113.79582950811348]
  We formulate a novel part-aware instance segmentation pipeline for industrial bin picking. We design a part-aware network to predict part masks and part-to-part offsets, followed by a part aggregation module to assemble the recognized parts into instances. We contribute the first instance segmentation dataset, which contains a variety of industrial objects that are thin and have non-trivial shapes.
  arXiv  Detail & Related papers  (2022-03-05T14:58:05Z)
• BuildingNet: Learning to Label 3D Buildings [19.641000866952815]
  BuildingNet: (a) large-scale 3D building models whose exteriors consistently labeled, (b) a neural network that labels building analyzing and structural relations of their geometric primitives. The dataset covers categories, such as houses, churches, skyscrapers, town halls and castles.
  arXiv  Detail & Related papers  (2021-10-11T01:45:26Z)
• Personal Fixations-Based Object Segmentation with Object Localization and Boundary Preservation [60.41628937597989]
  We focus on Personal Fixations-based Object (PFOS) to address issues in previous studies. We propose a novel network based on Object Localization and Boundary Preservation (OLBP) to segment the gazed objects. OLBP is organized in the mixed bottom-up and top-down manner with multiple types of deep supervision.
  arXiv  Detail & Related papers  (2021-01-22T09:20:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.