SAM 3D Animal: Promptable Animal 3D Reconstruction from Images in the Wild

• URL: http://arxiv.org/abs/2605.07604v1
• Date: Fri, 08 May 2026 11:26:46 GMT
• Title: SAM 3D Animal: Promptable Animal 3D Reconstruction from Images in the Wild
• Abstract summary: We present SAM 3D Animal, the first promptable framework for multi-animal 3D reconstruction from a single image.<n>Our method jointly reconstructs multiple instances and supports flexible prompts in the form of keypoints and masks.<n> Experiments show that our framework achieves state-of-the-art results over both existing model-based and model-free methods.
• Score: 41.19285227066038
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D animal reconstruction in the wild remains challenging due to large species variation, frequent occlusions, and the prevalence of multi-animal scenes, while existing methods predominantly focus on single-animal settings. We present SAM 3D Animal, the first promptable framework for multi-animal 3D reconstruction from a single image. Built on the SMAL+ parametric animal model, our method jointly reconstructs multiple instances and supports flexible prompts in the form of keypoints and masks which enable more reliable disambiguation in crowded and occluded scenes. To train such a model, we further introduce Herd3D, a multi-animal 3D dataset containing over 5K images, designed to increase diversity in species, interactions, and occlusion patterns. Experiments on the Animal3D, APTv2, and Animal Kingdom datasets show that our framework achieves state-of-the-art results over both existing model-based and model-free methods, demonstrating a scalable and effective solution for prompt-driven animal 3D reconstruction in the wild.

Related papers

• AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps [57.43241902500102]
  We present AnimalLift, a framework for reconstructing structured, animation-compatible 3D animal assets with explicit fur from a single image.<n>A key component of our representation is a UV-aligned fur map that encodes strand geometry in a surface-aligned canonical domain.<n>Experiments on synthetic and real-world datasets demonstrate strong reconstruction quality and generalization across animal categories.
  arXiv  Detail & Related papers  (2026-09-08T22:55:46Z)
• PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation [3.599033387924161]
  PRIMA is a framework for robust 3D quadruped mesh recovery under severe species and pose imbalance.<n>We incorporate BioCLIP embeddings as biological priors to inject semantic and morphological knowledge into the reconstruction process.<n>We construct Quadruped3D, a large-scale pseudo-3D dataset that covers diverse species and pose variations.
  arXiv  Detail & Related papers  (2026-06-01T15:13:47Z)
• 4D-Animal: Freely Reconstructing Animatable 3D Animals from Videos [15.063635374924209]
  We propose 4D-Animal, a novel framework that reconstructs animatable 3D animals from videos without requiring sparse keypoint annotations.<n>Our approach introduces a dense feature network that maps 2D representations to SMAL parameters, enhancing both the efficiency and stability of the fitting process.
  arXiv  Detail & Related papers  (2025-07-14T16:24:31Z)
• Learning the 3D Fauna of the Web [70.01196719128912]
  We develop 3D-Fauna, an approach that learns a pan-category deformable 3D animal model for more than 100 animal species jointly. One crucial bottleneck of modeling animals is the limited availability of training data. We show that prior category-specific attempts fail to generalize to rare species with limited training images.
  arXiv  Detail & Related papers  (2024-01-04T18:32:48Z)
• Virtual Pets: Animatable Animal Generation in 3D Scenes [84.0990909455833]
  We introduce Virtual Pet, a novel pipeline to model realistic and diverse motions for target animal species within a 3D environment. We leverage monocular internet videos and extract deformable NeRF representations for the foreground and static NeRF representations for the background. We develop a reconstruction strategy, encompassing species-level shared template learning and per-video fine-tuning.
  arXiv  Detail & Related papers  (2023-12-21T18:59:30Z)
• Two-stage Synthetic Supervising and Multi-view Consistency Self-supervising based Animal 3D Reconstruction by Single Image [30.997936022365018]
  We propose the combination of two-stage supervised and self-supervised training to address the challenge of obtaining animal cooperation for 3D scanning. Results of our study demonstrate that our approach outperforms state-of-the-art methods in both quantitative and qualitative aspects of bird 3D digitization.
  arXiv  Detail & Related papers  (2023-11-22T07:06:38Z)
• LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery [72.3681707384754]
  We propose a practical problem setting to estimate 3D pose and shape of animals given only a few in-the-wild images of a particular animal species. We do not assume any form of 2D or 3D ground-truth annotations, nor do we leverage any multi-view or temporal information. Following these insights, we propose LASSIE, a novel optimization framework which discovers 3D parts in a self-supervised manner.
  arXiv  Detail & Related papers  (2022-07-07T17:00:07Z)
• Self-supervised Single-view 3D Reconstruction via Semantic Consistency [142.71430568330172]
  We learn a self-supervised, single-view 3D reconstruction model that predicts the shape, texture and camera pose of a target object. The proposed method does not necessitate 3D supervision, manually annotated keypoints, multi-view images of an object or a prior 3D template.
  arXiv  Detail & Related papers  (2020-03-13T20:29:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.