SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology
- URL: http://arxiv.org/abs/2607.02148v1
- Date: Thu, 02 Jul 2026 13:24:47 GMT
- Title: SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology
- Abstract summary: We introduce SAMoR, a cross-topology motion representation that encodes each motion segment as a small fixed number.<n>A graph-transformer encoder consumes per-joint motion features, kinematic graph structure, and joint-name embeddings, then compresses them into part-level tokens.<n>To keep the part queries from collapsing into redundant global representations, we introduce a topology-agnostic attention supervision loss.
- Score: 46.893067487418314
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Modeling motion for articulated objects of arbitrary skeleton topology remains difficult: existing motion generators target a fixed human skeleton, and prior adaptations either fail to share a vocabulary across rigs or discard motion detail through global pooling. Our key observation is that while joint-level motion does not correspond cleanly across species, motion of functional joint groups does: a human arm, a wolf foreleg, and a bird wing share motion structure despite differing joint counts and connectivity, a correspondence that joint names (e.g., "forearm", "wing_L1") partially expose even when topology does not. We introduce SAMoR (Skeleton-Aware Motion Representation for Articulated Objects), a cross-topology motion representation that encodes each motion segment as a small fixed number ($K=8$) of part tokens shared across arbitrary skeletons. A graph-transformer encoder consumes per-joint motion features, kinematic graph structure, and joint-name embeddings, then compresses them into part-level tokens via cross-attention pooling and residual vector quantization, yielding a discrete motion codebook shared across rigs. To keep the part queries from collapsing into redundant global representations, we introduce a topology-agnostic attention supervision loss, with joint-name dropout to reduce over-reliance on text labels. We curate a heterogeneous corpus from HumanML3D, Truebones Zoo, and animated Objaverse-XL assets, and evaluate SAMoR on held-out characters with unseen skeletons. It supports accurate reconstruction and cross-topology transfer, and enables text-conditioned generation and part-wise editing via a MaskGIT token generator. SAMoR reaches $2.75 \times 10^{-2}$ normalized MPJPE on cross-topology reconstruction, $5.8\times$ below the strongest adapted variable-$J$ tokenizer baseline, while remaining competitive with fixed-skeleton specialists on HumanML3D.
Related papers
- UniMate: One Unified Model to Animate Diverse Skeletons [22.957889325110912]
We present UniMate, a foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt.<n>UniMate introduces a topology-aware diffusion transformer, which integrates skeletal topology into attention.<n>We also curate UniML3D, 13,006 motion sequences spanning bipedal, quadrupedal, avian, marine, insectoid, serpentine, and articulated rigid objects.
arXiv Detail & Related papers (2026-09-04T17:59:00Z) - TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation [44.79819257609757]
We introduce TopoCap, the first unified framework capable of extracting motion from monocular video and rigging it onto characters with arbitrary, unseen skeletal topologies.<n>Our key insight is that while skeletal structures are discrete, the underlying physics of motion occupy a continuous, low-dimensional, manifold.<n>We materialize this insight via a two-stage generative pipeline.
arXiv Detail & Related papers (2026-06-10T14:41:19Z) - NECromancer: Breathing Life into Skeletons via BVH Animation [25.254783224309477]
Motion tokenization is a key component of generalizable motion models.<n>We propose NECromancer (NEC), a universal motion tokenizer that operates directly on arbitrary BVH skeletons.<n>The resulting token space supports cross-species motion transfer, composition, denoising, generation with token-based models, and text-motion retrieval.
arXiv Detail & Related papers (2026-02-06T09:52:29Z) - PALUM: Part-based Attention Learning for Unified Motion Retargeting [53.17113525688095]
Remotion between characters with different skeleton structures is a fundamental challenge in computer animation.<n>We present a novel approach that learns common motion representations across diverse skeleton topologies.<n>Experiments demonstrate superior performance in handling diverse skeletal structures while maintaining motion realism and semantic fidelity.
arXiv Detail & Related papers (2026-01-12T07:29:44Z) - SMF: Template-free and Rig-free Animation Transfer using Kinetic Codes [32.324844649352166]
Animation retargetting applies sparse motion description to a character mesh to produce a semantically plausible and temporally coherent full-body sequence.<n>We propose Self-supervised Motion Fields (SMF), a self-supervised framework that is trained with only sparse motion representations.<n>Our architecture comprises dedicated spatial and temporal gradient predictors, which are jointly trained in an end-to-end fashion.
arXiv Detail & Related papers (2025-04-07T08:42:52Z) - AnyTop: Character Animation Diffusion with Any Topology [54.07731933876742]
We introduce AnyTop, a diffusion model that generates motions for diverse characters with distinct motion dynamics.<n>Our work features a transformer-based denoising network, tailored for arbitrary skeleton learning.<n>Our evaluation demonstrates that AnyTops well, even with as few as three training examples per topology, and can produce motions for unseen skeletons as well.
arXiv Detail & Related papers (2025-02-24T17:00:36Z) - MotioNet: 3D Human Motion Reconstruction from Monocular Video with
Skeleton Consistency [72.82534577726334]
We introduce MotioNet, a deep neural network that directly reconstructs the motion of a 3D human skeleton from monocular video.
Our method is the first data-driven approach that directly outputs a kinematic skeleton, which is a complete, commonly used, motion representation.
arXiv Detail & Related papers (2020-06-22T08:50:09Z) - Skeleton-Aware Networks for Deep Motion Retargeting [83.65593033474384]
We introduce a novel deep learning framework for data-driven motion between skeletons.
Our approach learns how to retarget without requiring any explicit pairing between the motions in the training set.
arXiv Detail & Related papers (2020-05-12T12:51:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.