Pose-Aware Diffusion for 3D Generation

• URL: http://arxiv.org/abs/2605.00345v1
• Date: Fri, 01 May 2026 02:05:28 GMT
• Title: Pose-Aware Diffusion for 3D Generation
• Abstract summary: Pose-Aware Diffusion (PAD) is a novel end-to-end diffusion framework that synthesizes 3D geometry directly within the observation space.<n>PAD achieves superior geometric alignment and image-to-3D correspondence compared to state-of-the-art methods.
• Score: 27.05951575490971
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generating pose-aligned 3D objects is challenging due to the spatial mismatches and transformation ambiguities inherent in decoupled canonical-then-rotate paradigms. To this end, we introduce Pose-Aware Diffusion (PAD), a novel end-to-end diffusion framework that synthesizes 3D geometry directly within the observation space. By unprojecting monocular depth into a partial point cloud and explicitly injecting it as a 3D geometric anchor, PAD abandons canonical assumptions to enforce rigorous spatial supervision. This native generation intrinsically resolves pose ambiguity, producing high-fidelity pose-aligned assets. Extensive experiments demonstrate that PAD achieves superior geometric alignment and image-to-3D correspondence compared to state-of-the-art methods. Additionally, PAD naturally extends to compositional 3D scene reconstruction via a simple union of independently generated objects, highlighting its robust ability to preserve precise spatial layouts.

Related papers

• GOPI: Generation-Oriented 3D Pose Inference for Furniture Insertion from Single-View RGB-D Indoor Scenes [55.50433346262017]
  We study the problem of inserting new furniture into indoor scene images.<n>Under masked single-view 2D image-plane conditioning, the physical scale of the inserted furniture relative to the scene cannot be uniquely determined.<n>We reformulate the task as a combination of 3D pose inference and geometry-guided image generation.
  arXiv  Detail & Related papers  (2026-08-07T05:54:47Z)
• Reliability-Aware 3D Geometric Injection for Universal Person Re-identification [47.874819213762926]
  We propose a Universal Monocular 3D-Enhanced ReID framework driven by a Consistency-Aware Reliability Gate and Dual-Stream Residual Fusion.<n>Our method improves challenging, structure-sensitive scenarios while preserving competitive performance on clean domains.
  arXiv  Detail & Related papers  (2026-07-21T08:54:25Z)
• SeeSE3: Emergence of 3D Space in Vision Features [54.140615953727355]
  We investigate the relation between the structure of the space of visual features and the group of Euclidean transformations $SE(3)$.<n>We show that self-supervised vision models, which, in principle, have not been trained with direct 3D supervision or active agency, possess latent subspaces that are remarkably strongly correlated with 3D Euclidean space, when probed correctly.<n>We propose a new class of "Latent-Space Navigation" techniques that perform visual odometry and localization purely in the latent space, bypassing the need for explicit 3D reconstruction.
  arXiv  Detail & Related papers  (2026-07-15T18:00:31Z)
• Extend3D: Town-Scale 3D Generation [31.052455723067684]
  We propose Extend3D, a training-free pipeline for 3D scene generation from a single image.<n>By dividing the extended latent space into overlapping patches, we apply the object-centric 3D generative model to each patch and couple them at each time step.<n>Treating the incompleteness of 3D structure as noise during 3D refinement enables 3D completion via a concept, which we term under-noising.
  arXiv  Detail & Related papers  (2026-03-31T07:55:04Z)
• OneWorld: Taming Scene Generation with 3D Unified Representation Autoencoder [90.8453349494245]
  We present OneWorld, a framework that performs diffusion directly within a coherent 3D representation space.<n>OneWorld generates high-quality 3D scenes with superior cross-view consistency compared to state-of-the-art 2D-based methods.
  arXiv  Detail & Related papers  (2026-03-17T03:43:37Z)
• Interact3D: Compositional 3D Generation of Interactive Objects [31.12099147294145]
  We present a novel framework designed to generate physically plausible interacting 3D compositional objects.<n>Our approach first leverages advanced generative priors to curate high-quality individual assets.<n>To physically compose these assets, we then introduce a robust two-stage composition pipeline.
  arXiv  Detail & Related papers  (2026-03-17T03:21:06Z)
• SPAN: Spatial-Projection Alignment for Monocular 3D Object Detection [49.12928389918159]
  Existing monocular 3D detectors typically tame the pronounced nonlinear regression of 3D bounding box through decoupled prediction paradigm.<n>We propose novel Spatial-Projection Alignment (SPAN) with two pivotal components.<n>SPAN enforces an explicit global spatial constraint between the predicted and ground-truth 3D bounding boxes, thereby rectifying spatial drift caused by decoupled attribute regression.<n>3D-2D Projection Alignment ensures that the projected 3D box is aligned tightly within its corresponding 2D detection bounding box on the image plane, mitigating projection misalignment overlooked in previous works.
  arXiv  Detail & Related papers  (2025-11-10T04:48:48Z)
• CUPID: Pose-Grounded Generative 3D Reconstruction from a Single Image [32.39661961097445]
  A new generation-based 3D reconstruction method, named Cupid, infers the camera pose, 3D shape, and texture of an object from a single 2D image.<n>Experiments demonstrate Cupid outperforms leading 3D reconstruction methods with an over 3 dB PSNR gain and an over 10% Chamfer Distance reduction.
  arXiv  Detail & Related papers  (2025-10-23T17:47:38Z)
• GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation [75.39457097832113]
  This paper introduces a novel 3D generation framework, offering scalable, high-quality 3D generation with an interactive Point Cloud-structured Latent space.<n>Our framework employs a Variational Autoencoder with multi-view posed RGB-D(epth)-N(ormal) renderings as input, using a unique latent space design that preserves 3D shape information.<n>The proposed method, GaussianAnything, supports multi-modal conditional 3D generation, allowing for point cloud, caption, and single image inputs.
  arXiv  Detail & Related papers  (2024-11-12T18:59:32Z)
• NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation [52.772319840580074]
  3D shape generation aims to produce innovative 3D content adhering to specific conditions and constraints. Existing methods often decompose 3D shapes into a sequence of localized components, treating each element in isolation. We introduce a novel spatial-aware 3D shape generation framework that leverages 2D plane representations for enhanced 3D shape modeling.
  arXiv  Detail & Related papers  (2024-03-27T04:09:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.