ParTY: Part-Guidance for Expressive Text-to-Motion Synthesis

• URL: http://arxiv.org/abs/2603.09611v1
• Date: Tue, 10 Mar 2026 12:53:12 GMT
• Title: ParTY: Part-Guidance for Expressive Text-to-Motion Synthesis
• Abstract summary: We propose ParTY, a novel framework that enhances part expressiveness while generating coherent full-body motions.<n>ParTY comprises: (1) Part-Guided Network, which first generates part motions to obtain part guidance, then uses it to generate holistic motions; (2) Part-aware Text Grounding, which diversely transforms text embeddings and appropriately aligns them with each body part; and (3) Holistic-Part Fusion, which adaptively fuses holistic motions and part motions.
• Score: 16.628208335930857
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Text-to-motion synthesis aims to generate natural and expressive human motions from textual descriptions. While existing approaches primarily focus on generating holistic motions from text descriptions, they struggle to accurately reflect actions involving specific body parts. Recent part-wise motion generation methods attempt to resolve this but face two critical limitations: (i) they lack explicit mechanisms for aligning textual semantics with individual body parts, and (ii) they often generate incoherent full-body motions due to integrating independently generated part motions. To overcome these issues and resolve the fundamental trade-off in existing methods, we propose ParTY, a novel framework that enhances part expressiveness while generating coherent full-body motions. ParTY comprises: (1) Part-Guided Network, which first generates part motions to obtain part guidance, then uses it to generate holistic motions; (2) Part-aware Text Grounding, which diversely transforms text embeddings and appropriately aligns them with each body part; and (3) Holistic-Part Fusion, which adaptively fuses holistic motions and part motions. Extensive experiments, including part-level and coherence-level evaluations, demonstrate that ParTY achieves substantial improvements over previous methods.

Related papers

• Motion-Adapter: A Diffusion Model Adapter for Text-to-Motion Generation of Compound Actions [13.380249866020355]
  We propose a plug-and-play module that guides text-to-motion diffusion models in generating compound actions.<n>Our method consistently produces more faithful and coherent compound motions across diverse textual prompts.
  arXiv  Detail & Related papers  (2026-04-17T15:08:17Z)
• Beyond Global Alignment: Fine-Grained Motion-Language Retrieval via Pyramidal Shapley-Taylor Learning [56.6025512458557]
  Motion-language retrieval aims to bridge the semantic gap between natural language and human motion.<n>Existing approaches predominantly focus on aligning entire motion sequences with global textual representations.<n>We propose a novel Pyramidal Shapley-Taylor (PST) learning framework for fine-grained motion-language retrieval.
  arXiv  Detail & Related papers  (2026-01-29T16:00:12Z)
• MoReact: Generating Reactive Motion from Textual Descriptions [57.642436102978245]
  MoReact is a diffusion-based method designed to disentangle the generation of global trajectories and local motions sequentially.<n>Our experiments, utilizing data adapted from a two-person motion dataset, demonstrate the efficacy of our approach.
  arXiv  Detail & Related papers  (2025-09-28T14:31:41Z)
• EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning [66.68366281305977]
  This paper explores a cross-modality synthesis task that infers 3D human-object interactions (HOIs) from a given text-based instruction.<n>Existing text-to-HOI synthesis methods mainly deploy a direct mapping from texts to object-specific 3D body motions.<n>We propose a novel body pose generation strategy for the text-to-HOI task: infer object-agnostic canonical body action first and then enrich object-specific interaction styles.
  arXiv  Detail & Related papers  (2025-03-01T07:15:10Z)
• BiPO: Bidirectional Partial Occlusion Network for Text-to-Motion Synthesis [0.4893345190925178]
  BiPO is a novel model that enhances text-to-motion synthesis.<n>It integrates part-based generation with a bidirectional autoregressive architecture.<n>BiPO achieves state-of-the-art performance on the HumanML3D dataset.
  arXiv  Detail & Related papers  (2024-11-28T05:42:47Z)
• TextIM: Part-aware Interactive Motion Synthesis from Text [25.91739105467082]
  TextIM is a novel framework for synthesizing TEXT-driven human Interactive Motions. Our approach leverages large language models, functioning as a human brain, to identify interacting human body parts. For training and evaluation, we carefully selected and re-labeled interactive motions from HUMANML3D to develop a specialized dataset.
  arXiv  Detail & Related papers  (2024-08-06T17:08:05Z)
• Learning Generalizable Human Motion Generator with Reinforcement Learning [95.62084727984808]
  Text-driven human motion generation is one of the vital tasks in computer-aided content creation. Existing methods often overfit specific motion expressions in the training data, hindering their ability to generalize. We present textbfInstructMotion, which incorporate the trail and error paradigm in reinforcement learning for generalizable human motion generation.
  arXiv  Detail & Related papers  (2024-05-24T13:29:12Z)
• ParCo: Part-Coordinating Text-to-Motion Synthesis [48.67225204910634]
  We propose Part-Coordinating Text-to-Motion Synthesis (ParCo) ParCo is endowed with enhanced capabilities for understanding part motions and communication among different part motion generators. Our approach demonstrates superior performance on common benchmarks with economic computations.
  arXiv  Detail & Related papers  (2024-03-27T12:41:30Z)
• SemanticBoost: Elevating Motion Generation with Augmented Textual Cues [73.83255805408126]
  Our framework comprises a Semantic Enhancement module and a Context-Attuned Motion Denoiser (CAMD) The CAMD approach provides an all-encompassing solution for generating high-quality, semantically consistent motion sequences. Our experimental results demonstrate that SemanticBoost, as a diffusion-based method, outperforms auto-regressive-based techniques.
  arXiv  Detail & Related papers  (2023-10-31T09:58:11Z)
• HumanTOMATO: Text-aligned Whole-body Motion Generation [30.729975715600627]
  This work targets a novel text-driven whole-body motion generation task. It aims at generating high-quality, diverse, and coherent facial expressions, hand gestures, and body motions simultaneously.
  arXiv  Detail & Related papers  (2023-10-19T17:59:46Z)
• SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation [58.25766404147109]
  Our goal is to synthesize 3D human motions given textual inputs describing simultaneous actions. We refer to generating such simultaneous movements as performing'spatial compositions'
  arXiv  Detail & Related papers  (2023-04-20T16:01:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.