AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps

• URL: http://arxiv.org/abs/2609.09513v1
• Date: Tue, 08 Sep 2026 22:55:46 GMT
• Title: AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps
• Abstract summary: We present AnimalLift, a framework for reconstructing structured, animation-compatible 3D animal assets with explicit fur from a single image.<n>A key component of our representation is a UV-aligned fur map that encodes strand geometry in a surface-aligned canonical domain.<n>Experiments on synthetic and real-world datasets demonstrate strong reconstruction quality and generalization across animal categories.
• Score: 57.43241902500102
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Reconstructing a fully animatable 3D animal from a single image remains challenging because animation-ready assets require not only plausible geometry, but also a unified topology, editable appearance, and fur representations compatible with deformation and simulation. Existing image-to-3D approaches often rely on implicit or loosely structured representations that are difficult to rig or edit, while parametric animal models support animation but cannot capture detailed texture and fur appearance. We present AnimalLift, a framework for reconstructing structured, animation-compatible 3D animal assets with explicit fur from a single image. Our method lifts an input image into a shared canonical space with a consistent topology and UV parameterization across the dataset, enabling joint prediction of canonical geometry, texture, and fur in a unified feed-forward architecture. A key component of our representation is a UV-aligned fur map that encodes strand geometry in a surface-aligned canonical domain, allowing explicit fur reconstruction compatible with mesh deformation and fur simulation. To train the model, we introduce a procedural data generation pipeline that provides large-scale supervision with aligned geometry, texture, and fur across diverse animal species and appearances. Experiments on synthetic and real-world datasets demonstrate strong reconstruction quality and generalization across animal categories. Beyond reconstruction, our structured representation directly supports downstream applications including animation, pose transfer, fur editing, and simulation-compatible rendering.

Related papers

• SAM 3D Animal: Promptable Animal 3D Reconstruction from Images in the Wild [41.19285227066038]
  We present SAM 3D Animal, the first promptable framework for multi-animal 3D reconstruction from a single image.<n>Our method jointly reconstructs multiple instances and supports flexible prompts in the form of keypoints and masks.<n> Experiments show that our framework achieves state-of-the-art results over both existing model-based and model-free methods.
  arXiv  Detail & Related papers  (2026-05-08T11:26:46Z)
• AniGen: Unified $S^3$ Fields for Animatable 3D Asset Generation [64.1405325883561]
  We present AniGen, a unified framework that directly generates animate-ready 3D assets conditioned on a single image.<n>Our key insight is to represent shape, skeleton, and skinning as mutually consistent $S3$ Fields (Shape, Skeleton, Skin) defined over a shared spatial domain.<n>AniGen substantially outperforms state-of-the-art sequential baselines in rig validity and animation quality.
  arXiv  Detail & Related papers  (2026-04-09T20:22:06Z)
• SMAL-pets: SMAL Based Avatars of Pets from Single Image [6.956006697118972]
  SMAL-pets is a comprehensive framework that generates high-quality, editable animal avatars from a single input image.<n>Our approach bridges the gap between reconstruction and generative modeling by leveraging a hybrid architecture.
  arXiv  Detail & Related papers  (2026-03-17T20:47:49Z)
• DogWeave: High-Fidelity 3D Canine Reconstruction from a Single Image via Normal Fusion and Conditional Inpainting [0.8602553195689513]
  We propose DogWeave, a model-based framework for reconstructing high-fidelity 3D canine models from a single RGB image.<n>DogWeave improves geometry by refining a coarsely-initiated parametric mesh into a detailed SDF representation.<n>DogWeave produces complete, realistic 3D models and outperforms state-of-the-art single image to 3d reconstruction methods in both shape accuracy and texture realism for canines.
  arXiv  Detail & Related papers  (2026-03-08T03:35:49Z)
• NeuralFur: Animal Fur Reconstruction From Multi-View Images [56.497408146667205]
  Reconstructing realistic animal fur geometry from images is a challenging task due to the fine-scale details, self-occlusion, and view-dependent appearance of fur.<n>We present a first multi-view-based method for high-fidelity 3D fur modeling of animals using a strand-based representation.
  arXiv  Detail & Related papers  (2026-01-18T16:46:38Z)
• Generative Zoo [41.65977386204797]
  We introduce a pipeline that samples a diverse set of poses and shapes for a variety of mammalian quadrupeds and generates realistic images with corresponding ground-truth pose and shape parameters.<n>We train a 3D pose and shape regressor on GenZoo, which achieves state-of-the-art performance on a real-world animal pose and shape estimation benchmark.
  arXiv  Detail & Related papers  (2024-12-11T04:57:53Z)
• Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos [26.65191922949358]
  We present a method to build animatable dog avatars from monocular videos. This is challenging as animals display a range of (unpredictable) non-rigid movements and have a variety of appearance details. We develop an approach that links the video frames via a 4D solution that jointly solves for animal's pose variation, and its appearance.
  arXiv  Detail & Related papers  (2024-03-25T18:41:43Z)
• Virtual Pets: Animatable Animal Generation in 3D Scenes [84.0990909455833]
  We introduce Virtual Pet, a novel pipeline to model realistic and diverse motions for target animal species within a 3D environment. We leverage monocular internet videos and extract deformable NeRF representations for the foreground and static NeRF representations for the background. We develop a reconstruction strategy, encompassing species-level shared template learning and per-video fine-tuning.
  arXiv  Detail & Related papers  (2023-12-21T18:59:30Z)
• Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization [91.52882218901627]
  We propose a novel method for constructing implicit 3D morphable face models that are both generalizable and intuitive for editing. Our method improves upon photo-realism, geometry, and expression accuracy compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-04T17:58:40Z)
• Coarse-to-fine Animal Pose and Shape Estimation [67.39635503744395]
  We propose a coarse-to-fine approach to reconstruct 3D animal mesh from a single image. The coarse estimation stage first estimates the pose, shape and translation parameters of the SMAL model. The estimated meshes are then used as a starting point by a graph convolutional network (GCN) to predict a per-vertex deformation in the refinement stage.
  arXiv  Detail & Related papers  (2021-11-16T01:27:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.