SARe: Structure-Aware Large-Scale 3D Fragment Reassembly
- URL: http://arxiv.org/abs/2603.21611v1
- Date: Mon, 23 Mar 2026 06:13:14 GMT
- Title: SARe: Structure-Aware Large-Scale 3D Fragment Reassembly
- Abstract summary: 3D fragment reassembly aims to recover the rigid poses of unordered fragment point clouds or meshes in a common object coordinate system.<n>Existing end-to-end approaches are prone to cascading failures due to unreliable contact reasoning.<n>We propose Structure-Aware Reassembly (SARe), a generative framework with SARe-Gen for Euclidean-space assembly generation and SARe-Refine for inference-time refinement.
- Score: 14.2680020647518
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: 3D fragment reassembly aims to recover the rigid poses of unordered fragment point clouds or meshes in a common object coordinate system to reconstruct the complete shape. The problem becomes particularly challenging as the number of fragments grows, since the target shape is unknown and fragments provide weak semantic cues. Existing end-to-end approaches are prone to cascading failures due to unreliable contact reasoning, most notably inaccurate fragment adjacencies. To address this, we propose Structure-Aware Reassembly (SARe), a generative framework with SARe-Gen for Euclidean-space assembly generation and SARe-Refine for inference-time refinement, with explicit contact modeling. SARe-Gen jointly predicts fracture-surface token probabilities and an inter-fragment contact graph to localize contact regions and infer candidate adjacencies. It adopts a query-point-based conditioning scheme and extracts aligned local geometric tokens at query locations from a frozen geometry encoder, yielding queryable structural representations without additional structural pretraining. We further introduce an inference-time refinement stage, SARe-Refine. By verifying candidate contact edges with geometric-consistency checks, it selects reliable substructures and resamples the remaining uncertain regions while keeping verified parts fixed, leading to more stable and consistent assemblies in the many-fragment regime. We evaluate SARe across three settings, including synthetic fractures, simulated fractures from scanned real objects, and real physically fractured scans. The results demonstrate state-of-the-art performance, with more graceful degradation and higher success rates as the fragment count increases in challenging large-scale reassembly.
Related papers
- SCULPT: Subtractive Composition for 3D Part Generation [48.947695076233835]
Part-aware 3D generation aims to create digital assets that are coherent as complete objects.<n>We propose SCULPT, a framework that addresses these challenges through subtractive composition.
arXiv Detail & Related papers (2026-08-13T17:55:04Z) - ReScene: Structured Indoor Scene Reconstruction from Multi-View Captures [18.468596508491967]
ReScene is a framework that threads multi-view geometry throughout the pipeline as a unifying prior.<n>Our method consists of two main components: HierView prioritizes reconstruction views based on semantic consistency and 3D coverage.<n>ReScene sets a new state of the art across geometry, rendering, and perceptual quality on a set of ScanNet scenes.
arXiv Detail & Related papers (2026-06-26T13:08:40Z) - GARDEN: Gravity-Aligned Reconstruction of Disentangled ENvironments from RGB images [61.2170105836525]
We propose an RGB-only framework that reformulates reconstruction as physically-grounded scene factorization and outputs a structured hybrid scene representation.<n>The resulting representation combines explicit rigid bodies with a decoupled background, enabling direct physics simulation while preserving visual realism.
arXiv Detail & Related papers (2026-06-02T17:13:01Z) - OcclusionFormer: Arranging Z-Order for Layout-Grounded Image Generation [49.49933361280724]
We introduce OcclusionFormer, a novel framework that explicitly models Z-order priority by decoupling instances.<n>We also introduce a queried alignment loss that explicitly supervises individual instances and enhances semantic consistency.<n>The proposed method effectively reduces ambiguity in overlapping regions, enforces correct occlusion dependencies, and preserves structural integrity, leading to substantial accuracy gains across diverse scenes.
arXiv Detail & Related papers (2026-05-20T16:10:44Z) - Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure [55.17771962316751]
Current 3D tokenizers treat representation as spatial compression, but leave component ownership and attachment validity implicit.<n>We formulate an alternative view, interface-centric generative states, in which tokenization constructs an operational state rather than a passive compressed code.<n>We instantiate this formulation with Component-Conditioned Canonical Local Tokens (C2LT-3D), factorizing representation into canonical local geometry, partition-conditioned context, and relational seam variables.
arXiv Detail & Related papers (2026-05-11T12:09:28Z) - Long-Term Multi-Session 3D Reconstruction Under Substantial Appearance Change [52.46888249268445]
Long-term environmental monitoring requires the ability to reconstruct and align 3D models across repeated site visits separated by months or years.<n>Existing approaches rely on post-hoc alignment of independently reconstructed sessions.<n>We propose enforcing cross-session correspondences directly within a joint SfM reconstruction.
arXiv Detail & Related papers (2026-02-24T06:12:51Z) - Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes [60.92139345612904]
We present Light-SQ, a novel superquadric-based optimization framework.<n>We propose a block-regrow-fill strategy guided by structure-aware volumetric decomposition.<n>Experiments demonstrate that Light-SQ enables efficient, high-fidelity, and editable shape abstraction with superquadrics.
arXiv Detail & Related papers (2025-09-29T16:18:32Z) - Detection Based Part-level Articulated Object Reconstruction from Single RGBD Image [52.11275397911693]
We propose an end-to-end trainable, cross-category method for reconstructing multiple man-made articulated objects from a single RGBD image.<n>We depart from previous works that rely on learning instance-level latent space, focusing on man-made articulated objects with predefined part counts.<n>Our method successfully reconstructs variously structured multiple instances that previous works cannot handle, and outperforms prior works in shape reconstruction and kinematics estimation.
arXiv Detail & Related papers (2025-04-04T05:08:04Z) - Scalable Geometric Fracture Assembly via Co-creation Space among
Assemblers [24.89380678499307]
We develop a scalable framework for geometric fracture assembly without relying on semantic information.
We introduce a novel loss function, i.e., the geometric-based collision loss, to address collision issues during the fracture assembly process.
Our framework exhibits better performance on both PartNet and Breaking Bad datasets compared to existing state-of-the-art frameworks.
arXiv Detail & Related papers (2023-12-19T17:13:51Z) - Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detection [54.041049052843604]
We present STEMD, a novel end-to-end framework that enhances the DETR-like paradigm for multi-frame 3D object detection.
First, to model the inter-object spatial interaction and complex temporal dependencies, we introduce the spatial-temporal graph attention network.
Finally, it poses a challenge for the network to distinguish between the positive query and other highly similar queries that are not the best match.
arXiv Detail & Related papers (2023-07-01T13:53:14Z) - TC-SfM: Robust Track-Community-Based Structure-from-Motion [24.956499348500763]
We propose to exploit high-level information in the scene, i.e., the spatial contextual information of local regions, to guide the reconstruction.
A novel structure is proposed, namely, textittrack-community, in which each community consists of a group of tracks and represents a local segment in the scene.
arXiv Detail & Related papers (2022-06-13T01:09:12Z) - Point Scene Understanding via Disentangled Instance Mesh Reconstruction [21.92736190195887]
We propose aDisentangled Instance Mesh Reconstruction (DIMR) framework for effective point scene understanding.
A segmentation-based backbone is applied to reduce false positive object proposals.
We leverage a mesh-aware latent code space to disentangle the processes of shape completion and mesh generation.
arXiv Detail & Related papers (2022-03-31T06:36:07Z) - SCFusion: Real-time Incremental Scene Reconstruction with Semantic
Completion [86.77318031029404]
We propose a framework that performs scene reconstruction and semantic scene completion jointly in an incremental and real-time manner.
Our framework relies on a novel neural architecture designed to process occupancy maps and leverages voxel states to accurately and efficiently fuse semantic completion with the 3D global model.
arXiv Detail & Related papers (2020-10-26T15:31:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.