Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing

• URL: http://arxiv.org/abs/2606.01014v1
• Date: Sun, 31 May 2026 05:09:42 GMT
• Title: Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing
• Abstract summary: We address text-based 3D human motion editing, where the goal is to preserve the style and structure of a source motion while applying edits described in natural language.<n>Our goal is to create a model that understands not only this temporal aspect but also which specific joints are responsible for the change.
• Score: 12.284953145384264
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We address text-based 3D human motion editing, where the goal is to preserve the style and structure of a source motion while applying edits described in natural language. The release of the MotionFix dataset has spurred active research into training-based diffusion models that directly generate an edited motion from a source motion and a text instruction. While previous works have focused primarily on learning when an edit should occur temporally, our goal is to create a model that understands not only this temporal aspect but also which specific joints are responsible for the change. Targeting this, we propose a novel architecture and a complementary auxiliary task to aid its training. Our architecture consists of two axis-anchored transformers, which extract distinct features along the joint and time dimensions respectively, and a cross-axis fusion block that integrates these representations. We further introduce an auxiliary task that trains the joint-anchored transformer to regress the Soft-DTW distance between source and target joint rotations. This objective teaches the module to understand which joints to modify and which to preserve. Through comprehensive experiments on the MotionFix dataset, we demonstrate that our method significantly improves semantic alignment with both the text instruction and the source motion, as well as the overall fidelity of the generated motion, achieving state-of-the-art results.

Related papers

• Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing [78.44034844227868]
  Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions.<n>Change and Invariance Motion Editing (CIME) is a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity.
  arXiv  Detail & Related papers  (2026-08-17T01:54:44Z)
• Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning [55.410155357480654]
  We propose an Omni-Supervised Positive-Negative Learning framework, named OmniME.<n>Our method integrates three complementary components.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment.
  arXiv  Detail & Related papers  (2026-05-29T08:09:51Z)
• InterEdit: Navigating Text-Guided Multi-Human 3D Motion Editing [73.51964472028392]
  We introduce the task of multi-person 3D motion editing, where a target motion is generated from a source and a text instruction.<n>To support this, we propose InterEdit3D, a new dataset with manual two-person motion change annotations, and a Text-guided Multi-human Motion Editing (TMME) benchmark.<n>InterEdit improves text-to-motion consistency and edit fidelity, achieving state-of-the-art TMME performance.
  arXiv  Detail & Related papers  (2026-03-13T15:30:51Z)
• SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction [20.89960239295474]
  We introduce a related task, motion similarity prediction, and propose a multi-task training paradigm.<n>We train the model jointly on motion editing and motion similarity prediction to foster the learning of semantically meaningful representations.<n>Experiments demonstrate the state-of-the-art performance of our approach in both editing alignment and fidelity.
  arXiv  Detail & Related papers  (2025-03-23T21:29:37Z)
• EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning [66.68366281305977]
  This paper explores a cross-modality synthesis task that infers 3D human-object interactions (HOIs) from a given text-based instruction.<n>Existing text-to-HOI synthesis methods mainly deploy a direct mapping from texts to object-specific 3D body motions.<n>We propose a novel body pose generation strategy for the text-to-HOI task: infer object-agnostic canonical body action first and then enrich object-specific interaction styles.
  arXiv  Detail & Related papers  (2025-03-01T07:15:10Z)
• MotionFix: Text-Driven 3D Human Motion Editing [52.11745508960547]
  Key challenges include the scarcity of training data and the need to design a model that accurately edits the source motion. We propose a methodology to semi-automatically collect a dataset of triplets comprising (i) a source motion, (ii) a target motion, and (iii) an edit text. Access to this data allows us to train a conditional diffusion model, TMED, that takes both the source motion and the edit text as input.
  arXiv  Detail & Related papers  (2024-08-01T16:58:50Z)
• SemanticBoost: Elevating Motion Generation with Augmented Textual Cues [73.83255805408126]
  Our framework comprises a Semantic Enhancement module and a Context-Attuned Motion Denoiser (CAMD) The CAMD approach provides an all-encompassing solution for generating high-quality, semantically consistent motion sequences. Our experimental results demonstrate that SemanticBoost, as a diffusion-based method, outperforms auto-regressive-based techniques.
  arXiv  Detail & Related papers  (2023-10-31T09:58:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.