AniGen: Unified $S^3$ Fields for Animatable 3D Asset Generation

• URL: http://arxiv.org/abs/2604.08746v2
• Date: Tue, 14 Apr 2026 17:33:59 GMT
• Title: AniGen: Unified $S^3$ Fields for Animatable 3D Asset Generation
• Abstract summary: We present AniGen, a unified framework that directly generates animate-ready 3D assets conditioned on a single image.<n>Our key insight is to represent shape, skeleton, and skinning as mutually consistent $S3$ Fields (Shape, Skeleton, Skin) defined over a shared spatial domain.<n>AniGen substantially outperforms state-of-the-art sequential baselines in rig validity and animation quality.
• Score: 64.1405325883561
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Animatable 3D assets, defined as geometry equipped with an articulated skeleton and skinning weights, are fundamental to interactive graphics, embodied agents, and animation production. While recent 3D generative models can synthesize visually plausible shapes from images, the results are typically static. Obtaining usable rigs via post-hoc auto-rigging is brittle and often produces skeletons that are topologically inconsistent with the generated geometry. We present AniGen, a unified framework that directly generates animate-ready 3D assets conditioned on a single image. Our key insight is to represent shape, skeleton, and skinning as mutually consistent $S^3$ Fields (Shape, Skeleton, Skin) defined over a shared spatial domain. To enable the robust learning of these fields, we introduce two technical innovations: (i) a confidence-decaying skeleton field that explicitly handles the geometric ambiguity of bone prediction at Voronoi boundaries, and (ii) a dual skin feature field that decouples skinning weights from specific joint counts, allowing a fixed-architecture network to predict rigs of arbitrary complexity. Built upon a two-stage flow-matching pipeline, AniGen first synthesizes a sparse structural scaffold and then generates dense geometry and articulation in a structured latent space. Extensive experiments demonstrate that AniGen substantially outperforms state-of-the-art sequential baselines in rig validity and animation quality, generalizing effectively to in-the-wild images across diverse categories including animals, humanoids, and machinery. Homepage: https://yihua7.github.io/AniGen-web/

Related papers

• Scene-Level Heterogeneous Physics Simulation with 3D Gaussian Splats [32.12749945486662]
  3D Gaussian Splatting (3DGS) has achieved state-of-the-art rendering, but the representation gap prevents these assets from being physically interactive.<n>We propose a novel framework that bridges this gap by enabling 3DGS assets to participate in scene-level, heterogeneous, multi-solver physical simulations.<n>We demonstrate complex, two-way interactions between deformable 3DGS assets, standard CG assets such as fluids and meshes, and large-scale captured static environments.
  arXiv  Detail & Related papers  (2026-06-19T21:12:52Z)
• MotionDreamer: Universal Skeletal Motion Generation for 3D Rigged Shapes [52.45449797329548]
  MotionDreamer is a diffusion-based framework for category-agnostic skeletal animation generation from 2D video guidance.<n>We propose a structural-semantic injection mechanism to bridge the gap between 2D visual motion cues and heterogeneous 3D skeletal structures.<n>Our approach significantly outperforms existing methods, setting a new state-of-the-art benchmark for robust and efficient 4D asset generation.
  arXiv  Detail & Related papers  (2026-06-01T00:42:31Z)
• Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation [6.821657791615377]
  Rigel3D is a generative method for animation-ready 3D assets represented as rigged meshes.<n>A rig-aware autoencoder decodes these representations into mesh geometry, skeleton topology, joint coordinates, and skinning weights.<n>A two-stage latent generative model synthesizes both surface and skeleton representations for image-conditioned generation.
  arXiv  Detail & Related papers  (2026-05-13T07:55:29Z)
• Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priors [61.34273238077091]
  We present a novel method for generating orbital videos from a single image of an object.<n>Our method achieves superior visual quality, shape realism and multi-view consistency compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-04-14T05:35:46Z)
• Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding [50.098085774845195]
  We propose a paradigm shift by leveraging the implicit spatial prior within large-scale generation models.<n>We introduce GeneEGA-3D (Video Extracted Generative Awareness), a plug-and-play framework that repurposes a pre-trained video diffusion model as a Latent World Simulator.
  arXiv  Detail & Related papers  (2026-03-19T17:59:58Z)
• Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models [53.32092058519587]
  Stroke3D is a novel framework that directly generates rigged meshes from user inputs: 2D drawn strokes and a descriptive text prompt.<n>To the best of our knowledge, our work is the first to generate rigged 3D meshes conditioned on user-drawn 2D strokes.
  arXiv  Detail & Related papers  (2026-02-10T12:17:00Z)
• Interp3D: Correspondence-aware Interpolation for Generative Textured 3D Morphing [63.141976759536625]
  We propose Interp3D, a training-free framework for textured 3D morphing.<n>It harnesses generative priors and adopts a progressive alignment principle to ensure both geometric fidelity and texture coherence.<n>For comprehensive evaluations, we construct a dedicated dataset, Interp3DData, with graded difficulty levels and assess generation results from fidelity, transition smoothness, and plausibility.
  arXiv  Detail & Related papers  (2026-01-20T16:03:22Z)
• ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents [31.495577251319315]
  ArtiLatent is a generative framework that synthesizes human-made 3D objects with fine-grained geometry, accurate articulation, and realistic appearance.
  arXiv  Detail & Related papers  (2025-10-24T13:08:15Z)
• Puppeteer: Rig and Animate Your 3D Models [105.11046762553121]
  Puppeteer is a comprehensive framework that addresses both automatic rigging and animation for diverse 3D objects.<n>Our system first predicts plausible skeletal structures via an auto-regressive transformer.<n>It then infers skinning weights via an attention-based architecture.
  arXiv  Detail & Related papers  (2025-08-14T17:59:31Z)
• RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assets [44.655049022141384]
  We present RigAnything, a novel autoregressive transformer-based model.<n>It makes 3D assets rig-ready by probabilistically generating joints and skeleton topologies and assigning skinning weights in a template-free manner.<n>It demonstrates state-of-the-art performance across diverse object types, including humanoids, quadrupeds, marine creatures, insects, and many more.
  arXiv  Detail & Related papers  (2025-02-13T18:59:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.