MotionCFG: Boosting Motion Dynamics via Stochastic Concept Perturbation
- URL: http://arxiv.org/abs/2603.14073v1
- Date: Sat, 14 Mar 2026 18:39:37 GMT
- Title: MotionCFG: Boosting Motion Dynamics via Stochastic Concept Perturbation
- Abstract summary: MotionCFG is a framework that enhances motion dynamics by contrasting a target concept with its noise-blured counterparts.<n>Unlike explicit negations, this approach facilitates implicit hard negative guidance without shifting the global semantic identity.<n> MotionCFG consistently improves motion dynamics across state-of-the-art T2V frameworks.
- Score: 60.48914865049489
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Despite recent advances in Text-to-Video (T2V) synthesis, generating high-fidelity and dynamic motion remains a significant challenge. Existing methods primarily rely on Classifier-Free Guidance (CFG), often with explicit negative prompts (e.g. "static", "blurry"), to suppress undesired artifacts. However, such explicit negations frequently introduce unintended semantic bias and distort object integrity; a phenomenon we define as Content-Motion Drift. To address this, we propose MotionCFG, a framework that enhances motion dynamics by contrasting a target concept with its noise-perturbed counterparts. Specifically, by injecting Gaussian noise into the concept embeddings, MotionCFG creates localized negative anchors that encapsulate a broad complementary space of sub-optimal motion variations. Unlike explicit negations, this approach facilitates implicit hard negative mining without shifting the global semantic identity, allowing for a focused refinement of temporal details. Combined with a piecewise guidance schedule that confines intervention to the early denoising steps, MotionCFG consistently improves motion dynamics across state-of-the-art T2V frameworks with negligible computational overhead and minimal compromise in visual quality. Additionally, we demonstrate that this noise-induced contrastive mechanism is effective not only for sharpening motion trajectories but also for steering complex, non-linear concepts such as precise object numerosity, which are typically difficult to modulate via standard text-based guidance.
Related papers
- Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation [32.824608968455294]
Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text.<n>We propose WInning Noise Retrieval and Optimization (WINRO), a framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling.<n>WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining.
arXiv Detail & Related papers (2026-07-07T22:32:10Z) - Decoupled Motion Representation Learning for Moving Infrared Small Target Detection [4.006240810892944]
We propose a decoupled motion representation learning framework for moving infrared small target detection.<n>An explicit motion branch is introduced to model globally coherent motion dynamics using pretrained optical flow priors.<n>An implicit motion branch based on deformable feature alignment is designed to capture target-sensitive local motion anomalies.<n>A coherent-motion-guided local anomaly reasoning module is proposed to identify and suppress coherent-motion-induced false responses.
arXiv Detail & Related papers (2026-06-13T12:50:32Z) - MotiMotion: Motion-Controlled Video Generation with Visual Reasoning [49.243234645532745]
We introduce MotiMotion, a framework that reformulates motion control as a reasoning-then-generation problem.<n>To encourage causally grounded and commonsense-consistent interactions, we leverage a training-free vision-language reasoner.<n>To further improve motion naturalness, we propose a confidence-aware control scheme that modulates guidance strength.
arXiv Detail & Related papers (2026-05-21T17:59:36Z) - Motion-Guided Semantic Alignment with Negative Prompts for Zero-Shot Video Action Recognition [12.523217686212197]
We present a novel framework that enhances CLIP with disentangled embeddings and semantic-guided interaction.<n>Experiments on standard benchmarks demonstrate that our method consistently outperforms prior CLIP-based approaches.
arXiv Detail & Related papers (2026-04-18T16:34:29Z) - IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation [58.297199313494]
Implicit methods capture motion semantics directly from driving video, but suffer from identity leakage and entanglement between motion and appearance.<n>We propose a novel implicit motion representation that compresses per-frame motion into compact 1D motion tokens.<n>Our methodology employs a three-stage training strategy to enhance the training efficiency and ensure high fidelity.
arXiv Detail & Related papers (2026-02-07T11:17:20Z) - MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization [73.07309070257162]
MotionAdapter is a content-aware motion transfer framework that enables robust and semantically aligned motion transfer.<n>Our key insight is that effective motion transfer requires explicit disentanglement of motion from appearance.<n> MotionAdapter naturally supports complex motion transfer and motion editing tasks such as zooming.
arXiv Detail & Related papers (2026-01-05T10:01:27Z) - DiViD: Disentangled Video Diffusion for Static-Dynamic Factorization [2.0032531485183345]
We introduce DiViD, the first end-to-end video diffusion framework for explicit static-dynamic factorization.<n>DiViD extracts a global static token from the first frame and per-frame dynamic tokens, explicitly removing static content from the motion code.<n>We evaluate DiViD on real-world benchmarks using swap-based accuracy and cross-leakage metrics.
arXiv Detail & Related papers (2025-07-18T14:09:18Z) - ReCoM: Realistic Co-Speech Motion Generation with Recurrent Embedded Transformer [58.49950218437718]
We present ReCoM, an efficient framework for generating high-fidelity and generalizable human body motions synchronized with speech.<n>The core innovation lies in the Recurrent Embedded Transformer (RET), which integrates Dynamic Embedding Regularization (DER) into a Vision Transformer (ViT) core architecture.<n>To enhance model robustness, we incorporate the proposed DER strategy, which equips the model with dual capabilities of noise resistance and cross-domain generalization.
arXiv Detail & Related papers (2025-03-27T16:39:40Z) - Motion-Aware Generative Frame Interpolation [23.380470636851022]
Flow-based frame methods ensure motion stability through estimated intermediate flow but often introduce severe artifacts in complex motion regions.<n>Recent generative approaches, boosted by large-scale pre-trained video generation models, show promise in handling intricate scenes.<n>We propose Motion-aware Generative frame (MoG) that synergizes intermediate flow guidance with generative capacities to enhance fidelity.
arXiv Detail & Related papers (2025-01-07T11:03:43Z) - Spectral Motion Alignment for Video Motion Transfer using Diffusion Models [54.32923808964701]
Spectral Motion Alignment (SMA) is a framework that refines and aligns motion vectors using Fourier and wavelet transforms.<n> SMA learns motion patterns by incorporating frequency-domain regularization, facilitating the learning of whole-frame global motion dynamics.<n>Extensive experiments demonstrate SMA's efficacy in improving motion transfer while maintaining computational efficiency and compatibility across various video customization frameworks.
arXiv Detail & Related papers (2024-03-22T14:47:18Z) - EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering
within Transformer [30.470336098766765]
Video Motion Magnification (VMM) aims to break the resolution limit of human visual perception capability.
This paper proposes a novel dynamic filtering strategy to achieve static-dynamic field adaptive denoising.
We demonstrate extensive experiments that EulerMormer achieves more robust video motion magnification from the Eulerian perspective.
arXiv Detail & Related papers (2023-12-07T09:10:16Z) - Guided Motion Diffusion for Controllable Human Motion Synthesis [18.660523853430497]
We propose Guided Motion Diffusion (GMD), a method that incorporates spatial constraints into the motion generation process.
Specifically, we propose an effective feature projection scheme that manipulates motion representation to enhance the coherency between spatial information and local poses.
Our experiments justify the development of GMD, which achieves a significant improvement over state-of-the-art methods in text-based motion generation.
arXiv Detail & Related papers (2023-05-21T21:54:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.