UniMo: Unifying Human and Animal Motion Generation

• URL: http://arxiv.org/abs/2609.12342v1
• Date: Fri, 11 Sep 2026 02:08:54 GMT
• Title: UniMo: Unifying Human and Animal Motion Generation
• Abstract summary: We propose a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations.<n>We present UniML3D, a large-scale motion-language dataset spanning both human and animal categories.<n>Our method achieves state-of-the-art results on UniML3D and three public benchmarks including HumanML3D, KIT-ML, and AnimalML3D.
• Score: 11.84736182625855
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The conditional generation of 3D motion has emerged as a key research topic due to its wide applicability across robotics, AR/VR, gaming, and content creation. However, extending recent advances in text-driven human motion generation to the animal domain remains challenging due to two core limitations. First, animals exhibit highly diverse skeletal topologies, unlike the standard human structure, making unified modeling across species difficult and leading to inefficient per-species models. Second, existing animal motion datasets suffer from limited scale and annotation quality, constraining model performance. To address these challenges, we propose UniMo, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints. Additionally, we present UniML3D, a large-scale motion-language dataset spanning both human and animal categories, containing 145,907 motion sequences and 433,388 captions-over 102x larger than existing animal datasets. Our method achieves state-of-the-art results on UniML3D and three public benchmarks including HumanML3D, KIT-ML, and AnimalML3D, demonstrating the feasibility and effectiveness of unified human-animal motion generation. Website: https://steve-zeyu-zhang.github.io/UniMo.

Related papers

• Kirin: Animal Motion Generation from In-the-Wild Video [40.9434764171182]
  Kirin is a framework that reconstructs motion from video, learns motion priors at scale, and generates realistic motion that can be directly applied to animated assets.<n>AiM3D is the first large-scale dataset offering aligned video-text-motions for quadruped animals.<n>By leveraging an off-the-shelf image-to-3D model, we automatically rig and animate 3D meshes using generated motion, producing ready-to-render animated animals.
  arXiv  Detail & Related papers  (2026-09-01T19:56:15Z)
• Unleashing Infinite Motion: Scaling Expressive Quadrupedal Motion via Generative Video Priors [16.885943699439377]
  We release Quad-Imaginarium, an open-source dataset of 7,488 quadruped motions spanning acrobatic and performative behaviors.<n>We release Uni-Mo, a fully automated pipeline that removes the animal from the loop by reframing corresponding data as a generation problem.<n>We validate 392 randomly sampled motions on a real Unitree Go2 with a 96.7% success rate, complemented by a 97.6% success rate in simulation.
  arXiv  Detail & Related papers  (2026-06-26T16:23:40Z)
• MotionDreamer: Universal Skeletal Motion Generation for 3D Rigged Shapes [52.45449797329548]
  MotionDreamer is a diffusion-based framework for category-agnostic skeletal animation generation from 2D video guidance.<n>We propose a structural-semantic injection mechanism to bridge the gap between 2D visual motion cues and heterogeneous 3D skeletal structures.<n>Our approach significantly outperforms existing methods, setting a new state-of-the-art benchmark for robust and efficient 4D asset generation.
  arXiv  Detail & Related papers  (2026-06-01T00:42:31Z)
• Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots [54.54929302887405]
  We present the Human-Humanoid Motion dataset, which consists of 1,000 motion sequences spanning 15 action categories.<n>All motion sequences are converted into SMPL-X representations to eliminate the influence of visual appearance.<n>Analysis of the collected data reveals that humanoid motions still exhibit noticeable deviations from human movements.
  arXiv  Detail & Related papers  (2026-03-06T11:40:56Z)
• Topology-Agnostic Animal Motion Generation from Text Prompt [16.557163253248817]
  We introduce OmniZoo, a large-scale animal motion dataset spanning 140 species and 32,979 sequences.<n>We propose a generalized autoregressive motion generation framework capable of producing text-driven motions for arbitrary skeletal topologies.
  arXiv  Detail & Related papers  (2025-12-11T07:08:29Z)
• X-MoGen: Unified Motion Generation across Humans and Animals [9.967329240441844]
  X-MoGen is the first unified framework for cross-species text-driven motion generation covering both humans and animals.<n>We construct textbfUniMo4D, a large-scale dataset of 115 species and 119k motion sequences, which integrates human and animal motions under a shared skeletal topology for joint training.<n>Experiments on UniMo4D demonstrate that X-MoGen outperforms state-of-the-art methods on both seen and unseen species.
  arXiv  Detail & Related papers  (2025-08-07T08:51:51Z)
• Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance [48.986552871497]
  We introduce a novel two-stage framework that employs scene affordance as an intermediate representation. By leveraging scene affordance maps, our method overcomes the difficulty in generating human motion under multimodal condition signals. Our approach consistently outperforms all baselines on established benchmarks, including HumanML3D and HUMANISE.
  arXiv  Detail & Related papers  (2024-03-26T18:41:07Z)
• Learning the 3D Fauna of the Web [70.01196719128912]
  We develop 3D-Fauna, an approach that learns a pan-category deformable 3D animal model for more than 100 animal species jointly. One crucial bottleneck of modeling animals is the limited availability of training data. We show that prior category-specific attempts fail to generalize to rare species with limited training images.
  arXiv  Detail & Related papers  (2024-01-04T18:32:48Z)
• OmniMotionGPT: Animal Motion Generation with Limited Data [70.35662376853163]
  We introduce AnimalML3D, the first text-animal motion dataset with 1240 animation sequences spanning 36 different animal identities. We are able to generate animal motions with high diversity and fidelity, quantitatively and qualitatively outperforming the results of training human motion generation baselines on animal data.
  arXiv  Detail & Related papers  (2023-11-30T07:14:00Z)
• Single Motion Diffusion [33.81898532874481]
  We present SinMDM, a model designed to learn the internal motifs of a single motion sequence with arbitrary topology and synthesize motions of arbitrary length that are faithful to them. SinMDM can be applied in various contexts, including spatial and temporal in-betweening, motion expansion, style transfer, and crowd animation. Our results show that SinMDM outperforms existing methods both in quality and time-space efficiency.
  arXiv  Detail & Related papers  (2023-02-12T13:02:19Z)
• AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild [51.35013619649463]
  We present an extensive dataset of free-running cheetahs in the wild, called AcinoSet. The dataset contains 119,490 frames of multi-view synchronized high-speed video footage, camera calibration files and 7,588 human-annotated frames. The resulting 3D trajectories, human-checked 3D ground truth, and an interactive tool to inspect the data is also provided.
  arXiv  Detail & Related papers  (2021-03-24T15:54:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.