IAM: Identity-Aware Human Motion and Shape Joint Generation

• URL: http://arxiv.org/abs/2604.25164v1
• Date: Tue, 28 Apr 2026 03:15:12 GMT
• Title: IAM: Identity-Aware Human Motion and Shape Joint Generation
• Abstract summary: We propose an identity-aware motion generation framework that explicitly models the relationship between body morphology and motion dynamics.<n>We introduce a joint motion-shape generation paradigm that simultaneously synthesizes motion sequences and body shape parameters.<n>Experiments on motion capture datasets and large-scale in-the-wild videos demonstrate improved motion realism and motion-identity consistency.
• Score: 14.037850965399384
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advances in text-driven human motion generation enable models to synthesize realistic motion sequences from natural language descriptions. However, most existing approaches assume identity-neutral motion and generate movements using a canonical body representation, ignoring the strong influence of body morphology on motion dynamics. In practice, attributes such as body proportions, mass distribution, and age significantly affect how actions are performed, and neglecting this coupling often leads to physically inconsistent motions. We propose an identity-aware motion generation framework that explicitly models the relationship between body morphology and motion dynamics. Instead of relying on explicit geometric measurements, identity is represented using multimodal signals, including natural language descriptions and visual cues. We further introduce a joint motion-shape generation paradigm that simultaneously synthesizes motion sequences and body shape parameters, allowing identity cues to directly modulate motion dynamics. Extensive experiments on motion capture datasets and large-scale in-the-wild videos demonstrate improved motion realism and motion-identity consistency while maintaining high motion quality. Project page: https://vjwq.github.io/IAM

Related papers

• Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling [32.83313595986613]
  We propose a framework for expanding the motion representation space by leveraging large-scale synthetic human motion.<n>Unlike conventional tokenizers trained on narrow data distributions, our approach jointly scales both the training distribution and the discrete codebook.<n>We demonstrate that training with synthetic motion substantially improves the coverage and compositionality of the learned motion vocabulary.
  arXiv  Detail & Related papers  (2026-06-25T20:50:31Z)
• Training-free Motion Factorization for Compositional Video Generation [57.819757612370374]
  We propose a motion factorization framework that decomposes complex motion into three primary categories: motionlessness, rigid motion, and non-rigid motion.<n>Our framework achieves impressive performance in motion synthesis on real-world benchmarks.
  arXiv  Detail & Related papers  (2026-03-10T02:27:48Z)
• LaMoGen: Laban Movement-Guided Diffusion for Text-to-Motion Generation [28.73306164224967]
  This work aims for interpretable and expressive control of human motion generation by seamlessly integrating the quantification methods of Laban Effort and Shape components into the text-guided motion generation models.<n>Our approach yields diverse expressive motion qualities while preserving motion identity by manipulating motion attributes according to target Laban tags.
  arXiv  Detail & Related papers  (2025-09-29T08:48:49Z)
• PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generation [35.563978243352764]
  We introduce physical mapping, integrated throughout the human interaction generation pipeline.<n>Specifically, motion imitation within a physics-based simulation environment is used to project target motions into a physically valid space.<n>Experiments show our method achieves impressive results in generated human motion quality, with a 3%-89% improvement in physical fidelity.
  arXiv  Detail & Related papers  (2025-06-09T06:04:49Z)
• GENMO: A GENeralist Model for Human MOtion [64.16188966024542]
  We present GENMO, a unified Generalist Model for Human Motion that bridges motion estimation and generation in a single framework.<n>Our key insight is to reformulate motion estimation as constrained motion generation, where the output motion must precisely satisfy observed conditioning signals.<n>Our novel architecture handles variable-length motions and mixed multimodal conditions (text, audio, video) at different time intervals, offering flexible control.
  arXiv  Detail & Related papers  (2025-05-02T17:59:55Z)
• Towards Synthesized and Editable Motion In-Betweening Through Part-Wise Phase Representation [29.62788252114547]
  styled motion in-betweening is crucial for computer animation and gaming.<n>We propose a novel framework that models motion styles at the body-part level.<n>Our approach enables more nuanced and expressive animations.
  arXiv  Detail & Related papers  (2025-03-11T08:44:27Z)
• HUMOS: Human Motion Model Conditioned on Body Shape [54.20419874234214]
  We introduce a new approach to develop a generative motion model based on body shape.<n>We show that it's possible to train this model using unpaired data.<n>The resulting model generates diverse, physically plausible, and dynamically stable human motions.
  arXiv  Detail & Related papers  (2024-09-05T23:50:57Z)
• MotionCrafter: One-Shot Motion Customization of Diffusion Models [66.44642854791807]
  We introduce MotionCrafter, a one-shot instance-guided motion customization method. MotionCrafter employs a parallel spatial-temporal architecture that injects the reference motion into the temporal component of the base model. During training, a frozen base model provides appearance normalization, effectively separating appearance from motion.
  arXiv  Detail & Related papers  (2023-12-08T16:31:04Z)
• Priority-Centric Human Motion Generation in Discrete Latent Space [59.401128190423535]
  We introduce a Priority-Centric Motion Discrete Diffusion Model (M2DM) for text-to-motion generation. M2DM incorporates a global self-attention mechanism and a regularization term to counteract code collapse. We also present a motion discrete diffusion model that employs an innovative noise schedule, determined by the significance of each motion token.
  arXiv  Detail & Related papers  (2023-08-28T10:40:16Z)
• Hierarchical Style-based Networks for Motion Synthesis [150.226137503563]
  We propose a self-supervised method for generating long-range, diverse and plausible behaviors to achieve a specific goal location. Our proposed method learns to model the motion of human by decomposing a long-range generation task in a hierarchical manner. On large-scale skeleton dataset, we show that the proposed method is able to synthesise long-range, diverse and plausible motion.
  arXiv  Detail & Related papers  (2020-08-24T02:11:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.