A Unified Conditional Flow for Motion Generation, Editing, and Intra-Structural Retargeting
- URL: http://arxiv.org/abs/2604.13427v1
- Date: Wed, 15 Apr 2026 02:53:07 GMT
- Title: A Unified Conditional Flow for Motion Generation, Editing, and Intra-Structural Retargeting
- Abstract summary: We present a unifying perspective where both tasks are cast as instances of conditional transport within a single generative framework.<n>We implement this vision via a rectified-flow motion model jointly conditioned and target skeletal structures.<n>Experiments on SnapMoGen and a multi-character Mixamo subset show that a single trained model supports text-to-motion generation, zero-shot editing, and zero-shot intra-structural.
- Score: 26.68081874066983
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Text-driven motion editing and intra-structural retargeting, where source and target share topology but may differ in bone lengths, are traditionally handled by fragmented pipelines with incompatible inputs and representations: editing relies on specialized generative steering, while retargeting is deferred to geometric post-processing. We present a unifying perspective where both tasks are cast as instances of conditional transport within a single generative framework. By leveraging recent advances in flow matching, we demonstrate that editing and retargeting are fundamentally the same generative task, distinguished only by which conditioning signal, semantic or structural, is modulated during inference. We implement this vision via a rectified-flow motion model jointly conditioned on text prompts and target skeletal structures. Our architecture extends a DiT-style transformer with per-joint tokenization and explicit joint self-attention to strictly enforce kinematic dependencies, while a multi-condition classifier-free guidance strategy balances text adherence with skeletal conformity. Experiments on SnapMoGen and a multi-character Mixamo subset show that a single trained model supports text-to-motion generation, zero-shot editing, and zero-shot intra-structural retargeting. This unified approach simplifies deployment and improves structural consistency compared to task-specific baselines.
Related papers
- Decoupled Guidance: Disentangling Subject and Context Pathways in Text-to-Image Personalization [13.554566178862745]
Text-to-image personalization aims to generate a user-provided subject in novel scenes described by text.<n>Most existing methods encode subject identity (fidelity) and context (editability) through the same conditioning pathway.<n>We propose Decoupled Guidance (DeGu), a framework that routes subject identity and scene context through two independent guidance streams.
arXiv Detail & Related papers (2026-07-01T10:48:43Z) - Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories [62.54876287800644]
Diffusion and flow-based generative models produce strong images, yet their controllability remains largely endpoint-centric.<n>Recent methods have begun to exploit generation order and process decomposition to improve sample quality, but still treat intermediate states as internal computation rather than objects for interaction.<n>We propose Trajectory Forcing (TF), a trajectory-centric framework that makes the generation path explicit, semantic, and editable.
arXiv Detail & Related papers (2026-06-21T14:25:50Z) - Property-Informed Diffusion-Based Text-to-Microstructure Generation [25.492080916045012]
A property-informed diffusion-based network is proposed that enables the generation of 3D microstructures directly from textual descriptions.<n>We show that the model is capable of generating semantically meaningful and physically plausible structures across a wide range of material categories.<n>Our approach has good potential for interactive microstructure design and opens up new directions for combining language-based interfaces with inverse material discovery.
arXiv Detail & Related papers (2026-06-06T13:00:34Z) - AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editing [14.255074251309168]
AnchorSteer is a framework that disentangles tension by coupling structural anchoring with self-discovered semantic steering.<n>The proposed approach probes internal representations to extract interpretable, label-free concept vectors.<n>Experiments on ZoME-Bench and subjective tests show that the proposed framework outperforms both steering-only and anchoring-only baselines.
arXiv Detail & Related papers (2026-05-29T09:25:55Z) - Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning [55.410155357480654]
We propose an Omni-Supervised Positive-Negative Learning framework, named OmniME.<n>Our method integrates three complementary components.<n>Experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment.
arXiv Detail & Related papers (2026-05-29T08:09:51Z) - Hierarchical Consistency Learning for Test-time Adaptation in Camouflage Perception [50.278200968044665]
Camouflaged object detection (COD) aims to localize targets that exhibit minimal perceptual differences from backgrounds through physical attributes.<n>Existing methods, constrained by the static train-then-freeze paradigm, suffer from domain rigidity and dependency annotation.<n>We propose the hierarchical consistency learning framework, which integrates test-time adaptation for dynamic representation recalibration.
arXiv Detail & Related papers (2026-05-25T09:57:46Z) - Beyond Point-Wise Matching: Structural Representation Alignment for Accelerating Diffusion Transformers [93.3976834364707]
We propose sREPA, a structural REPresentation Alignment framework to enforce consistency in the relational geometry of feature maps.<n>By encouraging the model to internalize holistic spatial layouts and structural correlations from pre-trained features, sREPA achieves faster and more stable convergence.
arXiv Detail & Related papers (2026-05-16T12:01:04Z) - ASTRA: Enhancing Multi-Subject Generation with Retrieval-Augmented Pose Guidance and Disentangled Position Embedding [1.4145309506833208]
ASTRA is a novel framework that architecturally disentangles subject appearance from pose structure.<n>ASTRA achieves a new state-of-the-art in pose adherence, while maintaining high identity fidelity and text alignment in DreamBench.
arXiv Detail & Related papers (2026-04-15T14:50:05Z) - CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestrator [8.901958956012072]
Conditional image editing is crucial in scenarios requiring strict structural control.<n>Most approaches rely on single-step generation.<n>We propose textbfCAMEO, a structured multi-agent framework that reformulates conditional editing as a quality-aware, feedback-driven process.
arXiv Detail & Related papers (2026-04-03T16:27:02Z) - Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding [36.012422604739236]
We propose Structure-Aware Domain Generalization (SADG), a Mamba-based In-Context Learning framework that preserves structural hierarchy across domains and tasks.<n>SADG uses centroid-based topology and geodesic curvature continuity to generate transformation-invariant sequences.<n>It consistently outperforms state-of-the-art methods across multiple tasks including reconstruction, denoising, and registration.
arXiv Detail & Related papers (2026-03-21T09:55:10Z) - CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing [51.73433734209541]
Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks.<n>This paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing.<n>Our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time.
arXiv Detail & Related papers (2026-03-12T11:15:11Z) - Communication-Inspired Tokenization for Structured Image Representations [74.17163003465537]
COMmunication inspired Tokenization (COMiT) is a framework for learning structured discrete visual token sequences.<n>Our experiments demonstrate that while semantic alignment provides grounding, attentive sequential tokenization is critical for inducing interpretable, object-centric token structure.
arXiv Detail & Related papers (2026-02-24T09:53:50Z) - StructAlign: Structured Cross-Modal Alignment for Continual Text-to-Video Retrieval [75.28673512571449]
A key challenge in Continual Text-to-Video Retrieval is feature drift.<n>We propose StructAlign, a structured cross-modal alignment method for CTVR.<n>Our method consistently outperforms state-of-the-art continual retrieval approaches.
arXiv Detail & Related papers (2026-01-28T13:34:44Z) - CoT Referring: Improving Referring Expression Tasks with Grounded Reasoning [67.18702329644526]
CoT Referring enhances model reasoning across modalities through a structured, chain-of-thought training data structure.<n>We restructure the training data to enforce a new output form, providing new annotations for existing datasets.<n>We also integrate detection and segmentation capabilities into a unified MLLM framework, training it with a novel adaptive weighted loss to optimize performance.
arXiv Detail & Related papers (2025-10-03T08:50:21Z) - Dynamic Perturbed Adaptive Method for Infinite Task-Conflicting Time Series [0.0]
We formulate time series tasks as input-output mappings under varying objectives, where the same input may yield different outputs.<n>To study this, we construct a synthetic dataset with numerous conflicting subtasks to evaluate adaptation under frequent task shifts.<n>We propose a dynamic perturbed adaptive method based on a trunk-branch architecture, where the trunk evolves slowly to capture long-term structure.
arXiv Detail & Related papers (2025-05-17T08:33:57Z) - Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping [6.445040420833822]
We propose a hierarchical framework that combines sentence-level stylistic adaptation with paragraph-level structural coherence.<n>Our proposed framework, ZeroStylus, operates through two systematic phases: hierarchical template acquisition from reference texts and template-guided generation with multi-granular matching.
arXiv Detail & Related papers (2025-05-11T05:53:33Z) - DepGraph: Towards Any Structural Pruning [68.40343338847664]
We study general structural pruning of arbitrary architecture like CNNs, RNNs, GNNs and Transformers.
We propose a general and fully automatic method, emphDependency Graph (DepGraph), to explicitly model the dependency between layers and comprehensively group parameters for pruning.
In this work, we extensively evaluate our method on several architectures and tasks, including ResNe(X)t, DenseNet, MobileNet and Vision transformer for images, GAT for graph, DGCNN for 3D point cloud, alongside LSTM for language, and demonstrate that, even with a
arXiv Detail & Related papers (2023-01-30T14:02:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.