VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps

• URL: http://arxiv.org/abs/2609.05114v1
• Date: Fri, 04 Sep 2026 13:08:07 GMT
• Title: VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps
• Abstract summary: method is a graph-based model that corrects voxel labels based on local geometry and semantic information.<n>method consistently improves mIoU by 4.23--5.00 percentage points.<n>Results on an independently reconstructed out-of-distribution aerial scene suggest that the learned correction can transfer beyond the environments seen during training.
• Score: 1.8825840324755478
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Semantic 3D maps are increasingly constructed automatically for aerial robotics by integrating learned semantic predictions into 3D representations. While this avoids costly manual 3D annotation, errors in the perception and mapping pipeline can persist in the resulting map, reducing its reliability for downstream autonomous tasks. Existing 3D semantic map refinement methods either rely on the original observations, treat occupancy as part of the prediction problem, or apply non-learned local regularization to completed maps. Instead, we study post-hoc semantic correction, asking whether semantic accuracy can be recovered directly from the completed map while keeping its geometry and occupancy fixed. We introduce \method, a graph-based model that corrects voxel labels based on local geometry and neighboring semantic information. To obtain training pairs, we corrupt contiguous regions of annotated OccuFly maps according to class confusions observed in upstream maps. We evaluate \method on completed OccuFly maps generated from predictions of four independently trained 2D segmentation models. \method consistently improves mIoU by 4.23--5.00 percentage points, with gains broadly distributed across the evaluated semantic classes and particularly strong improvements for tree, roof, and wall. Results on an independently reconstructed out-of-distribution aerial scene further suggest that the learned correction can transfer beyond the environments seen during training.

Related papers

• Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison [25.854113650180736]
  Self-supervised pre-training via cross-view completion learns strong features for 3D vision from co-visible regions of image pairs.<n>We introduce Gekko, which turns this limitation into a useful signal.<n>Gekko is a network, trained from scratch, that jointly performs cross-view completion, masked autoencoding, and per-pixel prediction.
  arXiv  Detail & Related papers  (2026-09-01T16:57:46Z)
• DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstruction [67.13370009386635]
  We introduce Dual Point Maps (DualPM), where a pair of point maps is extracted from the same image-one associating pixels to their 3D locations on the object and the other to a canonical version of the object in its rest pose.<n>We show that 3D reconstruction and 3D pose estimation can be reduced to the prediction of DualPMs.
  arXiv  Detail & Related papers  (2024-12-05T18:59:48Z)
• Bayesian Self-Training for Semi-Supervised 3D Segmentation [59.544558398992386]
  3D segmentation is a core problem in computer vision. densely labeling 3D point clouds to employ fully-supervised training remains too labor intensive and expensive. Semi-supervised training provides a more practical alternative, where only a small set of labeled data is given, accompanied by a larger unlabeled set.
  arXiv  Detail & Related papers  (2024-09-12T14:54:31Z)
• Map-aided annotation for pole base detection [0.0]
  In this paper, a 2D HD map is used to automatically annotate pole-like features in images. In the absence of height information, the map features are represented as pole bases at the ground level. We show how an object detector can be trained to detect a pole base.
  arXiv  Detail & Related papers  (2024-03-04T09:23:11Z)
• Volumetric Semantically Consistent 3D Panoptic Mapping [77.13446499924977]
  We introduce an online 2D-to-3D semantic instance mapping algorithm aimed at generating semantic 3D maps suitable for autonomous agents in unstructured environments. It introduces novel ways of integrating semantic prediction confidence during mapping, producing semantic and instance-consistent 3D regions. The proposed method achieves accuracy superior to the state of the art on public large-scale datasets, improving on a number of widely used metrics.
  arXiv  Detail & Related papers  (2023-09-26T08:03:10Z)
• Neural Semantic Surface Maps [52.61017226479506]
  We present an automated technique for computing a map between two genus-zero shapes, which matches semantically corresponding regions to one another. Our approach can generate semantic surface-to-surface maps, eliminating manual annotations or any 3D training data requirement.
  arXiv  Detail & Related papers  (2023-09-09T16:21:56Z)
• SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Sampling [75.957103837167]
  Reconstructing a 3D shape based on a single sketch image is challenging due to the large domain gap between a sparse, irregular sketch and a regular, dense 3D shape. Existing works try to employ the global feature extracted from sketch to directly predict the 3D coordinates, but they usually suffer from losing fine details that are not faithful to the input sketch.
  arXiv  Detail & Related papers  (2022-08-14T16:37:51Z)
• Adjusting the Ground Truth Annotations for Connectivity-Based Learning to Delineate [69.74821030699638]
  In this paper, we introduce a method that explicitly accounts for annotation inaccuracies. We treat the annotations as active contour models that can deform themselves while preserving their topology. This enables us to jointly train the network and correct potential errors in the original annotations.
  arXiv  Detail & Related papers  (2021-12-06T04:34:18Z)
• Dynamic Semantic Occupancy Mapping using 3D Scene Flow and Closed-Form Bayesian Inference [3.0389083199673337]
  We leverage state-of-the-art semantic segmentation and 3D flow estimation using deep learning to provide measurements for map inference. We develop a continuous (i.e., can be queried at arbitrary resolution) Bayesian model that propagates the scene with flow and infers a 3D semantic occupancy map with better performance than its static counterpart.
  arXiv  Detail & Related papers  (2021-08-06T15:51:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.