Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing

• URL: http://arxiv.org/abs/2608.16008v1
• Date: Mon, 17 Aug 2026 01:54:44 GMT
• Title: Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing
• Abstract summary: Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions.<n>Change and Invariance Motion Editing (CIME) is a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity.
• Score: 78.44034844227868
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git

Related papers

• UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation [31.218236544871967]
  We ground motion editing directly within text-to-motion generation across data, architecture, and inference.<n>At the data level, we develop a closed-loop synthesis-and-verification pipeline that produces Omni-MoEdit, a large-scale dataset spanning body-part, amplitude, temporal, action, and style edits.<n>At the architectural level, we introduce UniMoFlow, a unified latent flow-matching model that shares broad semantic kinematic and semantics knowledge between generation and editing.<n>We augment standard evaluations with semantics-aware metrics to account for valid edits that inherently deviate from a single ground-truth reference.
  arXiv  Detail & Related papers  (2026-08-10T05:42:58Z)
• Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories [93.39170866007431]
  4D generation aims to animate 3D objects with realistic motion, holding great promise for applications.<n>Existing methods typically decouple 3D asset generation from motion synthesis.<n>We present textttACT, a trajectory-conditioned framework for topology-general skeletal animation.
  arXiv  Detail & Related papers  (2026-06-24T03:18:10Z)
• Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing [12.284953145384264]
  We address text-based 3D human motion editing, where the goal is to preserve the style and structure of a source motion while applying edits described in natural language.<n>Our goal is to create a model that understands not only this temporal aspect but also which specific joints are responsible for the change.
  arXiv  Detail & Related papers  (2026-05-31T05:09:42Z)
• Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning [55.410155357480654]
  We propose an Omni-Supervised Positive-Negative Learning framework, named OmniME.<n>Our method integrates three complementary components.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment.
  arXiv  Detail & Related papers  (2026-05-29T08:09:51Z)
• MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation [66.66098171359995]
  MotionMERGE is a unified framework that bridges the granularity gap in motion-language models.<n>First, we pioneer the study of fine-grained language-guided motion control, including detailed understanding and localized editing.<n>Second, we design ReasoningAware Granularity-Synergy pre-training, a novel strategy that employs joint supervision for cross-granularity alignment.<n>Third, we curate MotionFineEdit, a large-scale dataset with the first finegrained-temporal corrective instructions and motion-grounded CoT annotations.
  arXiv  Detail & Related papers  (2026-05-18T18:00:04Z)
• SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing [76.349958946335]
  We present SAMA (factorized Semantic Anchoring and Motion Alignment), a framework that factorizes video editing into semantic anchoring and motion modeling.<n>First, we introduce Semantic Anchoring, which establishes a reliable visual anchor by jointly predicting semantic tokens and video latents at sparse anchor frames.<n>Second, Motion Alignment pre-trains the same backbone on motion-centric video restoration pretext tasks.
  arXiv  Detail & Related papers  (2026-03-19T17:59:51Z)
• Pose-Guided Residual Refinement for Interpretable Text-to-Motion Generation and Editing [0.0]
  We introduce pose-guided residual refinement for motion (PGR$2$M), a hybrid representation that augments interpretable pose codes with residual codes learned via residual vector quantization (RVQ)<n>A base Transformer autoregressively predicts pose codes from text, and a refine Transformer predicts residual codes conditioned on text, pose codes, and quantization stage.<n>Experiments on HumanML3D and KIT-ML show that PGR$2$M improves Fréchet distance and reconstruction metrics for both generation and editing compared with CoMo.
  arXiv  Detail & Related papers  (2025-12-27T04:45:31Z)
• Follow Your Motion: A Generic Temporal Consistency Portrait Editing Framework with Trajectory Guidance [27.1886214162329]
  Follow Your Motion is a generic framework for maintaining temporal consistency in portrait editing.<n>To maintain fine-grained expression temporal consistency in talking head editing, we propose a dynamic re-weighted attention mechanism.
  arXiv  Detail & Related papers  (2025-03-28T08:18:05Z)
• SemanticBoost: Elevating Motion Generation with Augmented Textual Cues [73.83255805408126]
  Our framework comprises a Semantic Enhancement module and a Context-Attuned Motion Denoiser (CAMD) The CAMD approach provides an all-encompassing solution for generating high-quality, semantically consistent motion sequences. Our experimental results demonstrate that SemanticBoost, as a diffusion-based method, outperforms auto-regressive-based techniques.
  arXiv  Detail & Related papers  (2023-10-31T09:58:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.