BIMStruct3D: A Fully Automated Hybrid Learning Scan-to-BIM Pipeline with Integrated Topology Refinement
- URL: http://arxiv.org/abs/2604.24311v2
- Date: Tue, 05 May 2026 10:37:58 GMT
- Title: BIMStruct3D: A Fully Automated Hybrid Learning Scan-to-BIM Pipeline with Integrated Topology Refinement
- Abstract summary: We present a modular pipeline for generating IFC-compliant Building Information Models from 3D point clouds.<n>The hybrid approach combines learning-based semantic segmentation with topology-aware geometric reconstruction.<n> Experiments on DeKH and CV4AEC datasets show significant improvements over a RANSAC-based baseline.
- Score: 13.23291316265073
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Automatic generation of Building Information Models (BIM) from building scans is a key challenge in architecture and construction. We present a modular pipeline for generating IFC-compliant BIM from 3D point clouds. The hybrid approach combines learning-based semantic segmentation with topology-aware geometric reconstruction to model structural elements accurately. We propose vIoU, adapting voxel-based overlap evaluation to Scan-to-BIM by enabling holistic, instance-matching-free comparison of reconstructed and ground-truth models. We release the German Hospital dataset (DeKH), including high-resolution point clouds, ground truth BIMs, and semantic annotations. Experiments on DeKH and CV4AEC datasets show significant improvements over a RANSAC-based baseline, demonstrating robustness and scalability.
Related papers
- TabNSM: Neural Sparse Mixer for Tabular Regression [2.124023760378586]
We propose TabNSM, a scalable regression framework that extends our earlier sparse-attention and mixer architectures.<n>At its core, the Adaptive Sparse Interaction Module (ASIM) integrates foreground feature discovery, sparse local interaction encoding, and Feature-Token Mixing.<n>For regression, TabNSM introduces three complementary components: a Multi-Stage Regression Head for progressive prediction refinement; GridLoss, an ordinal-aware soft-binning objective that incorporates target structure into representation learning; and RISE, a difficulty-aware sampling strategy based on loss-quantile bins.
arXiv Detail & Related papers (2026-08-18T17:22:49Z) - SEMASIA: A Large-Scale Dataset of Semantically Structured Latent Representations [12.185380843937196]
We introduce SEMASIA, a large-scale collection of latent representations extracted from approximately 1,700 pretrained vision models.<n>We analyze the conceptual organization of individual latent spaces, showing consistent prototype-like clustering.<n>We perform a large-scale regression analysis of how pretraining-data complexity, specialization, transfer learning, augmentation, and model scale relate to geometric and probing properties of embeddings.
arXiv Detail & Related papers (2026-05-10T11:42:36Z) - A Persistent Homology Design Space for 3D Point Cloud Deep Learning [5.810033007426438]
Persistent Homology (PH) offers stable, multi-scale descriptors of intrinsic shape structure.<n>Despite strong theoretical guarantees and increasing empirical adoption, its integration into deep learning for point clouds remains largely ad hoc and architecturally peripheral.<n>In this work, we introduce a unified design space for Persistent-Homology driven learning in 3D point clouds.
arXiv Detail & Related papers (2026-04-05T22:38:37Z) - Tokenizing Buildings: A Transformer for Layout Synthesis [0.6524460254566904]
Small Building Model (SBM) is a Transformer-based architecture for layout synthesis in Building Information Modeling scenes.<n>We address the question of how to tokenize buildings by unifying heterogeneous feature sets of architectural elements into sequences.<n>We train a single Transformer backbone in two modes: an encoder-only pathway that yields high-fidelity room embeddings, and an encoder-decoder pipeline for autoregressive prediction of room entities.
arXiv Detail & Related papers (2025-12-04T14:16:09Z) - Integrating BIM and UAV-based photogrammetry for Automated 3D Structure Model Segmentation [5.291432638550888]
We propose a machine learning-based framework for automated segmentation of 3D point clouds.<n>Our approach uses the complementary strengths of real-world UAV-scanned point clouds and synthetic data generated from Building Information Modeling.<n> Validation on a railroad track dataset demonstrated high accuracy in identifying and segmenting major components such as rails and crossties.
arXiv Detail & Related papers (2025-10-20T14:54:54Z) - Flow-Matching Guided Deep Unfolding for Hyperspectral Image Reconstruction [53.26903617819014]
Flow-Matching-guided Unfolding network (FMU) is first to integrate flow matching into HSI reconstruction.<n>To further strengthen the learned dynamics, we introduce a mean velocity loss.<n>Experiments on both simulated and real datasets show that FMU significantly outperforms existing approaches in reconstruction quality.
arXiv Detail & Related papers (2025-10-02T11:32:00Z) - Learning Discrete Bayesian Networks with Hierarchical Dirichlet Shrinkage [52.914168158222765]
We detail a comprehensive Bayesian framework for learning DBNs.<n>We give a novel Markov chain Monte Carlo (MCMC) algorithm utilizing parallel Langevin proposals to generate exact posterior samples.<n>We apply our methodology to uncover prognostic network structure from primary breast cancer samples.
arXiv Detail & Related papers (2025-09-16T17:24:35Z) - Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition [63.55828203989405]
We introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds.<n>Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures.<n>We propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training.
arXiv Detail & Related papers (2025-06-26T11:53:59Z) - Towards Automating the Retrospective Generation of BIM Models: A Unified Framework for 3D Semantic Reconstruction of the Built Environment [0.0]
Building Information Modeling is beneficial in construction projects.
However, it faces challenges due to the lack of a unified and scalable framework for converting 3D model details into BIM.
This paper introduces SR BIM, a unified semantic reconstruction architecture for BIM generation.
arXiv Detail & Related papers (2024-06-03T16:07:41Z) - Mechanistic Design and Scaling of Hybrid Architectures [114.3129802943915]
We identify and test new hybrid architectures constructed from a variety of computational primitives.
We experimentally validate the resulting architectures via an extensive compute-optimal and a new state-optimal scaling law analysis.
We find MAD synthetics to correlate with compute-optimal perplexity, enabling accurate evaluation of new architectures.
arXiv Detail & Related papers (2024-03-26T16:33:12Z) - Geometric Deep Learning for Structure-Based Drug Design: A Survey [83.87489798671155]
Structure-based drug design (SBDD) leverages the three-dimensional geometry of proteins to identify potential drug candidates.
Recent advancements in geometric deep learning, which effectively integrate and process 3D geometric data, have significantly propelled the field forward.
arXiv Detail & Related papers (2023-06-20T14:21:58Z) - A diverse large-scale building dataset and a novel plug-and-play domain
generalization method for building extraction [2.578242050187029]
We introduce a new building dataset and propose a novel domain generalization method to facilitate the development of building extraction from remote sensing images.
The WHU-Mix building dataset consists of a training/validation set containing 43,727 diverse images collected from all over the world, and a test set containing 8402 images from five other cities on five continents.
To further improve the generalization ability of a building extraction model, we propose a domain generalization method named batch style mixing (BSM)
arXiv Detail & Related papers (2022-08-22T01:43:13Z) - Revealing the Invisible with Model and Data Shrinking for
Composite-database Micro-expression Recognition [49.463864096615254]
We analyze the influence of learning complexity, including the input complexity and model complexity.
We propose a recurrent convolutional network (RCN) to explore the shallower-architecture and lower-resolution input data.
We develop three parameter-free modules to integrate with RCN without increasing any learnable parameters.
arXiv Detail & Related papers (2020-06-17T06:19:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.