Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning

• URL: http://arxiv.org/abs/2605.30969v1
• Date: Fri, 29 May 2026 08:09:51 GMT
• Title: Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning
• Abstract summary: We propose an Omni-Supervised Positive-Negative Learning framework, named OmniME.<n>Our method integrates three complementary components.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment.
• Score: 55.410155357480654
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Text-based human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the consistency of the original motion. Existing diffusion-based approaches often rely on heuristic similarity cues or coarse global conditioning, leading to motion distortion and suboptimal semantic alignment. The key challenge lies in balancing change (i.e. precisely editing target regions) and invariance (i.e. preserving unedited parts). To handle such challenge, we propose an Omni-Supervised Positive-Negative Learning framework, named OmniME. Our method integrates three complementary components: (1) retrospective feature supervision that enforces coarse-to-fine consistency across transformer layers,(2) motion preservation mechanism that focuses on subtle variations according to the source-target similarity, and (3) triplet-based semantic alignment that strengthens text-motion correspondence. Together, these components form a unified supervision paradigm that balances change and invariance. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment, validating the effectiveness of our unified learning framework. Our source codes and models have been released at: https://github.com/rocket-ycyer/OmniME.git

Related papers

• Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing [78.44034844227868]
  Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions.<n>Change and Invariance Motion Editing (CIME) is a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity.
  arXiv  Detail & Related papers  (2026-08-17T01:54:44Z)
• UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation [31.218236544871967]
  We ground motion editing directly within text-to-motion generation across data, architecture, and inference.<n>At the data level, we develop a closed-loop synthesis-and-verification pipeline that produces Omni-MoEdit, a large-scale dataset spanning body-part, amplitude, temporal, action, and style edits.<n>At the architectural level, we introduce UniMoFlow, a unified latent flow-matching model that shares broad semantic kinematic and semantics knowledge between generation and editing.<n>We augment standard evaluations with semantics-aware metrics to account for valid edits that inherently deviate from a single ground-truth reference.
  arXiv  Detail & Related papers  (2026-08-10T05:42:58Z)
• DWM: Separating World Effects from Actions in Latent World Models [34.35433044964186]
  We introduce DWM (Decomposed World Model), a supervision-level framework that operationalizes this decomposition.<n>DWM augments the predictor of a latent world model with an auxiliary world head, regularized by a normalized world-contrastive objective to be action-invariant.<n>We construct W-variants of three standard control benchmarks -- PushT-W, Reacher-W, and TwoRoom-W -- each instantiating a distinct action-invariant dynamic.
  arXiv  Detail & Related papers  (2026-07-21T05:13:26Z)
• Cross-Axis Feature Fusion with Joint-Wise Motion Difference Prediction for Text-Based 3D Human Motion Editing [12.284953145384264]
  We address text-based 3D human motion editing, where the goal is to preserve the style and structure of a source motion while applying edits described in natural language.<n>Our goal is to create a model that understands not only this temporal aspect but also which specific joints are responsible for the change.
  arXiv  Detail & Related papers  (2026-05-31T05:09:42Z)
• MotionMERGE: A Multi-granular Framework for Human Motion Editing, Reasoning, Generation, and Explanation [66.66098171359995]
  MotionMERGE is a unified framework that bridges the granularity gap in motion-language models.<n>First, we pioneer the study of fine-grained language-guided motion control, including detailed understanding and localized editing.<n>Second, we design ReasoningAware Granularity-Synergy pre-training, a novel strategy that employs joint supervision for cross-granularity alignment.<n>Third, we curate MotionFineEdit, a large-scale dataset with the first finegrained-temporal corrective instructions and motion-grounded CoT annotations.
  arXiv  Detail & Related papers  (2026-05-18T18:00:04Z)
• Language-Grounded Decoupled Action Representation for Robotic Manipulation [78.42228162226839]
  We propose the Language-Grounded Decoupled Action Representation (LaDA) framework to connect perception and control.<n>LaDA introduces a fine-grained intermediate layer of three interpretable action primitives--translation, rotation, and gripper control--providing explicit semantic structure for low-level actions.<n>It further employs a semantic-guided soft-label contrastive learning objective to align similar action primitives across tasks, enhancing generalization and motion consistency.
  arXiv  Detail & Related papers  (2026-03-13T13:08:26Z)
• 3DGesPolicy: Phoneme-Aware Holistic Co-Speech Gesture Generation Based on Action Control [3.606473077857744]
  3DGesPolicy is an action-based framework that reformulates holistic gesture generation as a continuous trajectory control problem.<n>By modeling frame-to-frame variations as unified holistic actions, our method effectively learns inter-frame holistic gesture motion patterns.<n>To further bridge the gap in expressive alignment, we propose a Gesture-Audio-Phoneme (GAP) fusion module.
  arXiv  Detail & Related papers  (2026-01-26T12:57:36Z)
• The Devil is in Attention Sharing: Improving Complex Non-rigid Image Editing Faithfulness via Attention Synergy [71.39358554558667]
  We introduce SynPS, a method that Synergistically leverages Positional embeddings and Semantic information for faithful non-rigid image editing.<n>We propose an editing measurement that quantifies the required editing magnitude at each denoising step.<n>By adaptively integrating positional and semantic cues, SynPS effectively avoids both over- and under-editing.
  arXiv  Detail & Related papers  (2025-12-16T14:08:00Z)
• SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Prediction [20.89960239295474]
  We introduce a related task, motion similarity prediction, and propose a multi-task training paradigm.<n>We train the model jointly on motion editing and motion similarity prediction to foster the learning of semantically meaningful representations.<n>Experiments demonstrate the state-of-the-art performance of our approach in both editing alignment and fidelity.
  arXiv  Detail & Related papers  (2025-03-23T21:29:37Z)
• SemanticBoost: Elevating Motion Generation with Augmented Textual Cues [73.83255805408126]
  Our framework comprises a Semantic Enhancement module and a Context-Attuned Motion Denoiser (CAMD) The CAMD approach provides an all-encompassing solution for generating high-quality, semantically consistent motion sequences. Our experimental results demonstrate that SemanticBoost, as a diffusion-based method, outperforms auto-regressive-based techniques.
  arXiv  Detail & Related papers  (2023-10-31T09:58:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.