SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation

• URL: http://arxiv.org/abs/2603.14152v1
• Date: Sat, 14 Mar 2026 23:21:38 GMT
• Title: SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation
• Abstract summary: SK-Adapter is a framework that unlocks precise skeletal manipulation for native 3D generation.<n>Our method achieves robust structural control while preserving the geometry and texture quality of the foundation model.<n>We extend this capability to local 3D editing, enabling the region specific editing of existing assets with skeletal guidance.
• Score: 37.85948688333355
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Native 3D generative models have achieved remarkable fidelity and speed, yet they suffer from a critical limitation: inability to prescribe precise structural articulations, where precise structural control within the native 3D space remains underexplored. This paper proposes SK-Adapter, a simple and yet highly efficient and effective framework that unlocks precise skeletal manipulation for native 3D generation. Moving beyond text or image prompts, which can be ambiguous for precise structure, we treat the 3D skeleton as a first-class control signal. SK-Adapter is a lightweight structural adapter network that encodes joint coordinates and topology into learnable tokens, which are injected into the frozen 3D generation backbone via cross-attention. This smart design allows the model to not only effectively "attend" to specific 3D structural constraints but also preserve its original generative priors. To bridge the data gap, we contribute Objaverse-TMS dataset, a large-scale dataset of 24k text-mesh-skeleton pairs. Extensive experiments confirm that our method achieves robust structural control while preserving the geometry and texture quality of the foundation model, significantly outperforming existing baselines. Furthermore, we extend this capability to local 3D editing, enabling the region specific editing of existing assets with skeletal guidance, which is unattainable by previous methods. Project Page: https://sk-adapter.github.io/

Related papers

• Fishbone: From One 3D Asset to a Million Controllable Edits [26.573828978137104]
  Fishbone is a unified rib-spine representation for general shapes that supports controllable parametric mesh, reduced-space dynamics, and animation.<n> ribs control local profiles such as thickness, orientation, and cross-sectional variation, while the spine controls global bending, twisting, and stretching.<n>We further construct Fishbone-136K by augmenting Hunyuan3D with rib-spine structures, and demonstrate applications in controllable 3D generation, deformation-based data augmentation for robot learning, interactive mesh editing, and agentic generation.
  arXiv  Detail & Related papers  (2026-05-24T01:38:43Z)
• VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction [59.303842406260124]
  VGGT-Edit is a feed-forward framework for text-conditioned native 3D scene editing.<n>We introduce depth-synchronized text injection to align semantic guidance with the backbone's spatial poses.<n> VGGT-Edit substantially outperforms 2D-lifting baselines, producing sharper object details, stronger multi-view consistency, and near-instant inference speed.
  arXiv  Detail & Related papers  (2026-05-14T17:59:04Z)
• Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models [53.32092058519587]
  Stroke3D is a novel framework that directly generates rigged meshes from user inputs: 2D drawn strokes and a descriptive text prompt.<n>To the best of our knowledge, our work is the first to generate rigged 3D meshes conditioned on user-drawn 2D strokes.
  arXiv  Detail & Related papers  (2026-02-10T12:17:00Z)
• Interp3D: Correspondence-aware Interpolation for Generative Textured 3D Morphing [63.141976759536625]
  We propose Interp3D, a training-free framework for textured 3D morphing.<n>It harnesses generative priors and adopts a progressive alignment principle to ensure both geometric fidelity and texture coherence.<n>For comprehensive evaluations, we construct a dedicated dataset, Interp3DData, with graded difficulty levels and assess generation results from fidelity, transition smoothness, and plausibility.
  arXiv  Detail & Related papers  (2026-01-20T16:03:22Z)
• LATTICE: Democratize High-Fidelity 3D Generation at Scale [27.310104395842075]
  LATTICE is a new framework for high-fidelity 3D asset generation.<n> VoxSet is a semi-structured representation that compresses 3D assets into a compact set of latent vectors anchored to a coarse voxel grid.<n>Our method is simple at its core, but supports arbitrary resolution decoding, low-cost training, and flexible inference schemes.
  arXiv  Detail & Related papers  (2025-11-24T03:22:19Z)
• PercHead: Perceptual Head Model for Single-Image 3D Head Reconstruction & Editing [51.56943889042673]
  PercHead is a method for single-image 3D head reconstruction and semantic 3D editing.<n>We develop a unified base model for reconstructing view-consistent 3D heads from a single input image.<n>We highlight the intuitive and powerful 3D editing capabilities of our model through a lightweight, interactive GUI.
  arXiv  Detail & Related papers  (2025-11-04T17:59:15Z)
• WorldGrow: Generating Infinite 3D World [75.81531067447203]
  We tackle the challenge of generating the infinitely extendable 3D world -- large, continuous environments with coherent geometry and realistic appearance.<n>We propose WorldGrow, a hierarchical framework for unbounded 3D scene synthesis.<n>Our method features three core components: (1) a data curation pipeline that extracts high-quality scene blocks for training, making the 3D structured latent representations suitable for scene generation; (2) a 3D block inpainting mechanism that enables context-aware scene extension; and (3) a coarse-to-fine generation strategy that ensures both global layout plausibility and local geometric/textural fidelity.
  arXiv  Detail & Related papers  (2025-10-24T17:39:52Z)
• HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editing [33.554101922316946]
  3D representations like meshes, voxels, point clouds, and NeRF-based neural implicit fields exhibit significant limitations.<n>We introduce a novel 3D Hierarchical Proxy Node representation.<n>Our method's expressive efficiency, high-fidelity rendering quality, and superior editability are shown.
  arXiv  Detail & Related papers  (2025-07-16T07:09:05Z)
• LucidDreaming: Controllable Object-Centric 3D Generation [10.646855651524387]
  We present a pipeline capable of spatial and numerical control over 3D generation from only textual prompt commands or 3D bounding boxes. LucidDreaming achieves superior results in object placement precision and generation fidelity compared to current approaches.
  arXiv  Detail & Related papers  (2023-11-30T18:55:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.