UniMate: One Unified Model to Animate Diverse Skeletons

• URL: http://arxiv.org/abs/2609.05415v1
• Date: Fri, 04 Sep 2026 17:59:00 GMT
• Title: UniMate: One Unified Model to Animate Diverse Skeletons
• Abstract summary: We present UniMate, a foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt.<n>UniMate introduces a topology-aware diffusion transformer, which integrates skeletal topology into attention.<n>We also curate UniML3D, 13,006 motion sequences spanning bipedal, quadrupedal, avian, marine, insectoid, serpentine, and articulated rigid objects.
• Score: 22.957889325110912
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in automatic rigging now deliver animation-ready 3D assets at scale, yet generating the motion to drive them remains a bottleneck. Existing learned animators are topology-constrained: they rely on category-specific templates or require per-skeleton fine-tuning and reference motions at inference. We present UniMate, a unified foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt, with no test-time optimization or per-skeleton retraining. UniMate introduces a topology-aware diffusion transformer, which integrates skeletal topology into attention via three mechanisms: (1) a graph-aware attention bias from pairwise joint relations and geodesic distances; (2) a spectral rotary position embedding generalizing RoPE to arbitrary kinematic trees via the graph Laplacian; and (3) a global topological conditioner attention-pooled from the rest-pose skeleton. We also curate UniML3D, 13,006 motion sequences spanning bipedal, quadrupedal, avian, marine, insectoid, serpentine, and articulated rigid objects with unified canonicalization and text pairing. Trained on this dataset, UniMate outperforms state-of-the-art baselines in quality, generalization, and efficiency, and supports zero-shot cross-topology transfer, in-betweening, expansion, and text-guided editing. Our project page is available at https://linzhanmou.com/unimate/.

Related papers

• SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology [46.893067487418314]
  We introduce SAMoR, a cross-topology motion representation that encodes each motion segment as a small fixed number.<n>A graph-transformer encoder consumes per-joint motion features, kinematic graph structure, and joint-name embeddings, then compresses them into part-level tokens.<n>To keep the part queries from collapsing into redundant global representations, we introduce a topology-agnostic attention supervision loss.
  arXiv  Detail & Related papers  (2026-07-02T13:24:47Z)
• TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation [44.79819257609757]
  We introduce TopoCap, the first unified framework capable of extracting motion from monocular video and rigging it onto characters with arbitrary, unseen skeletal topologies.<n>Our key insight is that while skeletal structures are discrete, the underlying physics of motion occupy a continuous, low-dimensional, manifold.<n>We materialize this insight via a two-stage generative pipeline.
  arXiv  Detail & Related papers  (2026-06-10T14:41:19Z)
• MotionDreamer: Universal Skeletal Motion Generation for 3D Rigged Shapes [52.45449797329548]
  MotionDreamer is a diffusion-based framework for category-agnostic skeletal animation generation from 2D video guidance.<n>We propose a structural-semantic injection mechanism to bridge the gap between 2D visual motion cues and heterogeneous 3D skeletal structures.<n>Our approach significantly outperforms existing methods, setting a new state-of-the-art benchmark for robust and efficient 4D asset generation.
  arXiv  Detail & Related papers  (2026-06-01T00:42:31Z)
• AniGen: Unified $S^3$ Fields for Animatable 3D Asset Generation [64.1405325883561]
  We present AniGen, a unified framework that directly generates animate-ready 3D assets conditioned on a single image.<n>Our key insight is to represent shape, skeleton, and skinning as mutually consistent $S3$ Fields (Shape, Skeleton, Skin) defined over a shared spatial domain.<n>AniGen substantially outperforms state-of-the-art sequential baselines in rig validity and animation quality.
  arXiv  Detail & Related papers  (2026-04-09T20:22:06Z)
• Topology-Agnostic Animal Motion Generation from Text Prompt [16.557163253248817]
  We introduce OmniZoo, a large-scale animal motion dataset spanning 140 species and 32,979 sequences.<n>We propose a generalized autoregressive motion generation framework capable of producing text-driven motions for arbitrary skeletal topologies.
  arXiv  Detail & Related papers  (2025-12-11T07:08:29Z)
• Puppeteer: Rig and Animate Your 3D Models [105.11046762553121]
  Puppeteer is a comprehensive framework that addresses both automatic rigging and animation for diverse 3D objects.<n>Our system first predicts plausible skeletal structures via an auto-regressive transformer.<n>It then infers skinning weights via an attention-based architecture.
  arXiv  Detail & Related papers  (2025-08-14T17:59:31Z)
• AnyTop: Character Animation Diffusion with Any Topology [54.07731933876742]
  We introduce AnyTop, a diffusion model that generates motions for diverse characters with distinct motion dynamics.<n>Our work features a transformer-based denoising network, tailored for arbitrary skeleton learning.<n>Our evaluation demonstrates that AnyTops well, even with as few as three training examples per topology, and can produce motions for unseen skeletons as well.
  arXiv  Detail & Related papers  (2025-02-24T17:00:36Z)
• MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency [72.82534577726334]
  We introduce MotioNet, a deep neural network that directly reconstructs the motion of a 3D human skeleton from monocular video. Our method is the first data-driven approach that directly outputs a kinematic skeleton, which is a complete, commonly used, motion representation.
  arXiv  Detail & Related papers  (2020-06-22T08:50:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.