RoofDiffusion: Constructing Roofs from Severely Corrupted Point Data via Diffusion

• URL: http://arxiv.org/abs/2404.09290v2
• Date: Sun, 13 Oct 2024 13:32:18 GMT
• Title: RoofDiffusion: Constructing Roofs from Severely Corrupted Point Data via Diffusion
• Abstract summary: RoofDiffusion is a new end-to-end self-supervised diffusion technique for robustly completing roof height maps. A variant, No-FP RoofDiffusion, simultaneously predicts building footprints and heights. Tested with the leading City3D algorithm, RoofDiffusion noticeably improves 3D building reconstruction.
• Score: 0.3277163122167433
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate completion and denoising of roof height maps are crucial to reconstructing high-quality 3D buildings. Repairing sparse points can enhance low-cost sensor use and reduce UAV flight overlap. RoofDiffusion is a new end-to-end self-supervised diffusion technique for robustly completing, in particular difficult, roof height maps. RoofDiffusion leverages widely-available curated footprints and can so handle up to 99\% point sparsity and 80\% roof area occlusion (regional incompleteness). A variant, No-FP RoofDiffusion, simultaneously predicts building footprints and heights. Both quantitatively outperform state-of-the-art unguided depth completion and representative inpainting methods for Digital Elevation Models (DEM), on both a roof-specific benchmark and the BuildingNet dataset. Qualitative assessments show the effectiveness of RoofDiffusion for datasets with real-world scans including AHN3, Dales3D, and USGS 3DEP LiDAR. Tested with the leading City3D algorithm, preprocessing height maps with RoofDiffusion noticeably improves 3D building reconstruction. RoofDiffusion is complemented by a new dataset of 13k complex roof geometries, focusing on long-tail issues in remote sensing; a novel simulation of tree occlusion; and a wide variety of large-area roof cut-outs for data augmentation and benchmarking.

Related papers

• SemCityLoc: Aerial 6DoF Localization Using Semantic 3D City Models [51.121529170856064]
  We propose SemCityLoc, a semantic-geometric alignment system that reframes aerial pose estimation.<n>Instead of matching sparse contours or dense texture, our method aligns semantic surfaces and monocular depth with lightweight semantic 3D building models.<n>Experiments demonstrate substantial improvements over existing map-based approaches.
  arXiv  Detail & Related papers  (2026-06-25T18:13:39Z)
• RadioFormer3D: Weakly Supervised 3D Radio Map Estimation in Low-Altitude Airspace via Generative Modeling [44.55033792503838]
  textbftextitRadioFormer3D is a specialized model for volumetric spectrum reconstruction under weak supervision.<n>textitRadioFormer3D achieves superior overall performance compared to representative existing methods.
  arXiv  Detail & Related papers  (2026-05-28T07:52:48Z)
• Joint Instance Segmentation and Geometric Attribute Regression for Roof Structures in Aerial Imagery [18.60580673640467]
  We present a method for jointly predicting instance-level roof segment masks from a single aerial orthophoto.<n>We introduce two key innovations: a conditional azimuth loss that suppresses supervision for flat roof segments, and a log-normalized height representation.<n>Our method achieves a mean absolute error of approximately 4 degrees for roof slope, 7 degrees for azimuth, and 1 meter for building height, with an instance segmentation AP$_50$ of 0.566.
  arXiv  Detail & Related papers  (2026-05-25T22:37:11Z)
• Reconstructing Building Height from Spaceborne TomoSAR Point Clouds Using a Dual-Topology Network [17.230182354159258]
  We introduce a learning-based framework for converting raw TomoSAR points into high-resolution building height maps.<n>Our dual-topology network alternates between a point branch that models irregular scatterer features and a grid branch that enforces spatial consistency.<n>This is the first proof of concept for large-scale urban height mapping directly from TomoSAR point clouds.
  arXiv  Detail & Related papers  (2026-01-02T11:34:35Z)
• Taming Anomalies with Down-Up Sampling Networks: Group Center Preserving Reconstruction for 3D Anomaly Detection [59.822737536103155]
  A Down-Up Sampling Network (DUS-Net) is proposed to reconstruct high-precision point clouds for 3D anomaly detection by preserving the group center geometric structure.<n>The proposed method achieves state-of-the-art (SOTA) performance with an Object-level AUROC of 79.9% and 79.5%, and a Point-level AUROC of 71.2% and 84.7% on the Real3D-AD and Anomaly-ShapeNet datasets.
  arXiv  Detail & Related papers  (2025-07-05T05:05:36Z)
• Taming Diffusion for Dataset Distillation with High Representativeness [49.3818035378669]
  D3HR is a novel diffusion-based framework to generate distilled datasets with high representativeness.<n>Our experiments demonstrate that D3HR can achieve higher accuracy across different model architectures.
  arXiv  Detail & Related papers  (2025-05-23T22:05:59Z)
• SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling [79.56581753856452]
  SparseFlex is a novel sparse-structured isosurface representation that enables differentiable mesh reconstruction at resolutions up to $10243$ directly from rendering losses. By enabling high-resolution, differentiable mesh reconstruction and generation with rendering losses, SparseFlex significantly advances the state-of-the-art in 3D shape representation and modeling.
  arXiv  Detail & Related papers  (2025-03-27T17:46:42Z)
• Decompositional Neural Scene Reconstruction with Generative Diffusion Prior [64.71091831762214]
  Decompositional reconstruction of 3D scenes, with complete shapes and detailed texture, is intriguing for downstream applications. Recent approaches incorporate semantic or geometric regularization to address this issue, but they suffer significant degradation in underconstrained areas. We propose DP-Recon, which employs diffusion priors in the form of Score Distillation Sampling (SDS) to optimize the neural representation of each individual object under novel views.
  arXiv  Detail & Related papers  (2025-03-19T02:11:31Z)
• RaNeuS: Ray-adaptive Neural Surface Reconstruction [87.20343320266215]
  We leverage a differentiable radiance field eg NeRF to reconstruct detailed 3D surfaces in addition to producing novel view renderings. Considering that different methods formulate and optimize the projection from SDF to radiance field with a globally constant Eikonal regularization, we improve with a ray-wise weighting factor. Our proposed textitRaNeuS are extensively evaluated on both synthetic and real datasets.
  arXiv  Detail & Related papers  (2024-06-14T07:54:25Z)
• SAFDNet: A Simple and Effective Network for Fully Sparse 3D Object Detection [22.120656021516695]
  SAFDNet is a straightforward yet highly effective architecture for fully sparse 3D object detection. We conducted extensive experiments on Open, nuScenes, and Argoverse2 datasets. SAFDNet surpassed the previous best hybrid detector HEDNet by 2.6% mAP while being 2.1x faster.
  arXiv  Detail & Related papers  (2024-03-09T06:48:19Z)
• Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAM [58.736472371951955]
  We introduce a ternary-type opacity (TT) model, which categorizes points on a ray intersecting a surface into three regions: before, on, and behind the surface. This enables a more accurate rendering of depth, subsequently improving the performance of image warping techniques. Our integrated approach of TT and HO achieves state-of-the-art performance on synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-12-20T18:03:17Z)
• HGDNet: A Height-Hierarchy Guided Dual-Decoder Network for Single View Building Extraction and Height Estimation [13.09940764764909]
  We propose a Height-hierarchy Guided Dual-decoder Network (HGDNet) to estimate building height. Under the guidance of synthesized discrete height-hierarchy nDSM, auxiliary height-hierarchical building extraction branch enhance the height estimation branch. Additional two-stage cascade architecture is adopted to achieve more accurate building extraction.
  arXiv  Detail & Related papers  (2023-08-10T07:03:32Z)
• 3D detection of roof sections from a single satellite image and application to LOD2-building reconstruction [12.693545159861857]
  We propose a method for urban 3D reconstruction named KIBS(textitKeypoints Inference By), which comprises two novel features. We demonstrate the potential of the KIBS method by reconstructing different urban areas in a few minutes, with a Jaccard index for the 2D segmentation of individual roof sections of $88.55%$ and $75.21%$ on our two data sets resp., and a height's mean error of such correctly segmented pixels for the 3D reconstruction of $1.60$ m and $2.06 m on our two data sets resp., hence within the LOD
  arXiv  Detail & Related papers  (2023-07-11T16:23:19Z)
• DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation [52.57289166214808]
  DiffInDScene is a novel framework for tackling the problem of high-quality 3D indoor scene generation. Inspired by KinectFusion's incremental alignment and fusion of local TSDF volumes, we propose a diffusion-based SDF fusion approach. The generated results demonstrate that our work is capable to achieve high-quality room generation directly in three-dimensional space.
  arXiv  Detail & Related papers  (2023-06-01T10:19:23Z)
• ZRG: A Dataset for Multimodal 3D Residential Rooftop Understanding [1.737244048102213]
  We present the Zeitview Rooftop Geometry dataset for residential rooftop understanding. ZRG is a large-scale residential rooftop dataset of over 20k properties collected through roof inspections from across the U.S.
  arXiv  Detail & Related papers  (2023-04-26T00:52:42Z)
• Vision Transformers, a new approach for high-resolution and large-scale mapping of canopy heights [50.52704854147297]
  We present a new vision transformer (ViT) model optimized with a classification (discrete) and a continuous loss function. This model achieves better accuracy than previously used convolutional based approaches (ConvNets) optimized with only a continuous loss function.
  arXiv  Detail & Related papers  (2023-04-22T22:39:03Z)
• On Robust Cross-View Consistency in Self-Supervised Monocular Depth Estimation [56.97699793236174]
  We study two kinds of robust cross-view consistency in this paper. We exploit the temporal coherence in both depth feature space and 3D voxel space for self-supervised monocular depth estimation. Experimental results on several outdoor benchmarks show that our method outperforms current state-of-the-art techniques.
  arXiv  Detail & Related papers  (2022-09-19T03:46:13Z)
• A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion [69.32451612060214]
  Real-scanned 3D point clouds are often incomplete, and it is important to recover complete point clouds for downstream applications. Most existing point cloud completion methods use Chamfer Distance (CD) loss for training. We propose a novel Point Diffusion-Refinement (PDR) paradigm for point cloud completion.
  arXiv  Detail & Related papers  (2021-12-07T06:59:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.