Articulated Object Reconstruction from Rest-State Observation
- URL: http://arxiv.org/abs/2607.27749v1
- Date: Thu, 30 Jul 2026 06:42:03 GMT
- Title: Articulated Object Reconstruction from Rest-State Observation
- Abstract summary: Building interactive digital twins requires recovering both 3D geometry and the kinematic structures that govern how objects articulate.<n>We introduce a rest-state formulation that reconstructs articulated objects from a single closed configuration.
- Score: 33.09154459685742
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Building interactive digital twins requires recovering both 3D geometry and the kinematic structures that govern how objects articulate. Yet existing methods for articulated object reconstruction require explicitly observable motion from multiple articulation states. We introduce a rest-state formulation that reconstructs articulated objects from a single closed configuration, an inherently ill-posed setting where geometry, semantics, and motion priors compensate for the absence of motion cues. Our framework adopts an explicit mesh as an intermediate representation for cross-model verification and fusion, reconciling noisy outputs from vision-language and segmentation models into spatially consistent part structures. To estimate joint parameters without observed motion, we use a video diffusion model to synthesize articulation hypotheses and validate them through geometric consistency. Our approach achieves accurate part decomposition and physically plausible articulation, performing competitively with motion-observing reconstruction-based, generation-based, and modular pretrained-model baselines.
Related papers
- UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image [58.40343808003224]
We present a debate-driven approach to articulated 3D object reconstruction from text or image inputs.<n>High-level agents reason about object semantics and motion using knowledge from vision-language and video models.<n>Low-level agents estimate articulation parameters and interaction points.<n>The same video prior, conditioned on the agreed articulation, then drives each part through its motion to expose occluded interiors and geometry.
arXiv Detail & Related papers (2026-06-29T17:44:53Z) - Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning [105.35529379360186]
Artic-O is an end-to-end, feed-forward framework for articulated object reconstruction.<n>It maps sparse multi-state observations into a pretrained latent geometry space.<n>A frozen flow-matching decoder provides a complete-shape prior for recovering visible and occluded structures.
arXiv Detail & Related papers (2026-06-20T08:15:30Z) - SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation [54.98864436812187]
We propose a self-supervised framework that estimates canonical geometry, rigid part segmentation, and joint pivots, axes, and articulation states from a single RGB-D observation.<n> Experiments on synthetic and real articulated-object datasets show that our SCAPO recovers consistent part structure and accurate articulation parameters and outperforms all self-supervised baselines.
arXiv Detail & Related papers (2026-06-01T09:04:49Z) - MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction [47.69179070489671]
Reconstructing articulated 3D objects from a single image requires jointly inferring object geometry, part structure, and motion parameters from limited visual evidence.<n>We present MonoArt, a unified framework grounded in progressive structural reasoning. Rather than predicting articulation directly from image features, MonoArt progressively transforms visual observations into canonical geometry, structured part representations, and motion-aware embeddings within a single architecture.
arXiv Detail & Related papers (2026-03-19T17:59:52Z) - PAct: Part-Decomposed Single-View Articulated Object Generation [45.04652409374895]
Articulated objects are central to interactive 3D applications, including embodied AI, robotics, and VR/AR.<n>We introduce a part-centric generative framework for articulated object creation that synthesizes part geometry, composition, and articulation under explicit part-aware conditioning.<n>Our representation models an object as a set of movable parts, each encoded by latent tokens augmented with part identity and articulation cues.
arXiv Detail & Related papers (2026-02-16T17:45:44Z) - Follow My Hold: Hand-Object Interaction Reconstruction through Geometric Guidance [61.41904916189093]
We propose a novel diffusion-based framework for reconstructing 3D geometry of hand-held objects from monocular RGB images.<n>We use hand-object interaction as geometric guidance to ensure plausible hand-object interactions.
arXiv Detail & Related papers (2025-08-25T17:11:53Z) - GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects [4.717906057951389]
We introduce a unified representation that jointly models geometry and motion using articulated 3D Gaussians.<n>This formulation improves robustness in motion decomposition and supports articulated objects with up to 20 parts.<n>We show that our method consistently achieves superior accuracy in part-level geometry reconstruction and motion estimation across a broad range of object types.
arXiv Detail & Related papers (2025-08-20T17:59:08Z) - Detection Based Part-level Articulated Object Reconstruction from Single RGBD Image [52.11275397911693]
We propose an end-to-end trainable, cross-category method for reconstructing multiple man-made articulated objects from a single RGBD image.<n>We depart from previous works that rely on learning instance-level latent space, focusing on man-made articulated objects with predefined part counts.<n>Our method successfully reconstructs variously structured multiple instances that previous works cannot handle, and outperforms prior works in shape reconstruction and kinematics estimation.
arXiv Detail & Related papers (2025-04-04T05:08:04Z) - NF3DM: Combining Neural Fields and Deformation Models for 3D Non-Rigid Motion Reconstruction [6.851721795186258]
We introduce a novel, data-driven approach for reconstructing temporally coherent 3D motion from unstructured observations of non-rigidly deforming shapes.<n>Our goal is to achieve high-fidelity motion reconstructions for shapes that undergo near-isometric deformations, such as humans wearing loose clothing.<n>Our method outperforms state-of-the-art approaches, as demonstrated by its application to human and animal motion sequences reconstructed from monocular depth videos.
arXiv Detail & Related papers (2024-12-11T16:24:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.