Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance

• URL: http://arxiv.org/abs/2601.07221v1
• Date: Mon, 12 Jan 2026 05:36:15 GMT
• Title: Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance
• Abstract summary: Multi-domain image-to-image translation re quires grounding semantic differences ex pressed in natural language prompts into corresponding visual transformations.<n>We propose LACE (Language-grounded Attribute Controllable Translation), built on two compo nents.<n>Experiments on CelebA(Dialog) and BDD100K demonstrate that LACE achieves high visual fidelity, structural preservation, and interpretable domain-specific control.
• Score: 15.370194308451495
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-domain image-to-image translation re quires grounding semantic differences ex pressed in natural language prompts into corresponding visual transformations, while preserving unrelated structural and seman tic content. Existing methods struggle to maintain structural integrity and provide fine grained, attribute-specific control, especially when multiple domains are involved. We propose LACE (Language-grounded Attribute Controllable Translation), built on two compo nents: (1) a GLIP-Adapter that fuses global semantics with local structural features to pre serve consistency, and (2) a Multi-Domain Control Guidance mechanism that explicitly grounds the semantic delta between source and target prompts into per-attribute translation vec tors, aligning linguistic semantics with domain level visual changes. Together, these modules enable compositional multi-domain control with independent strength modulation for each attribute. Experiments on CelebA(Dialog) and BDD100K demonstrate that LACE achieves high visual fidelity, structural preservation, and interpretable domain-specific control, surpass ing prior baselines. This positions LACE as a cross-modal content generation framework bridging language semantics and controllable visual translation.

Related papers

• LASA: Language-and-Source-Anchored Alignment for Domain Generalized Semantic Segmentation [43.56251979741165]
  Domain Generalization Semantic (DGSS) focuses on generalizing knowledge from labeled source domains to unseen target domains.<n>Style randomization distorts the underlying feature manifold due to its coarse-grained nature.<n>Feature normalization suppresses discnative, domain-sensitive semantic details owing to its rigid design.
  arXiv  Detail & Related papers  (2026-08-09T16:43:04Z)
• ProVG: Progressive Visual Grounding via Language Decoupling for Remote Sensing Imagery [20.725910735285762]
  Remote sensing visual grounding aims to localize objects in remote sensing imagery according to natural language expressions.<n>We propose textbfProVG, a novel RSVG framework that improves localization accuracy by decoupling language expressions into global context, spatial relations, and object attributes.<n>ProVG consistently outperforms existing methods, achieving new state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-04-02T10:59:19Z)
• MoGen: A Unified Collaborative Framework for Controllable Multi-Object Image Generation [76.94658056824422]
  MoGen is a user-friendly multi-object image generation method.<n>First, we design a Regional Semantic Anchor (RSA) module that precisely anchors phrase units in language descriptions to their corresponding image regions.<n>We introduce an Adaptive Multi-modal Guidance (AMG) module, which adaptively parses and integrates various combinations of multi-source control signals.
  arXiv  Detail & Related papers  (2026-01-09T05:57:48Z)
• Exploiting Domain Properties in Language-Driven Domain Generalization for Semantic Segmentation [16.081767698947186]
  We present a novel domain generalization framework for semantic segmentation, namely Domain-aware Prompt-driven Masked Transformer (DPMFormer)<n> Firstly, we introduce domain-aware prompt learning to facilitate semantic alignment between visual and textual cues.<n>To capture various domain-specific properties with a single source dataset, we propose domain-aware contrastive learning along with the texture perturbation that diversifies the observable domains.
  arXiv  Detail & Related papers  (2025-12-03T06:58:38Z)
• Language as an Anchor: Preserving Relative Visual Geometry for Domain Incremental Learning [8.952803050083203]
  Key challenge in Domain Incremental Learning is to continually learn under shifting distributions.<n>We propose LAVA, a novel DIL framework that replaces direct feature alignment with relative alignment driven by a text-based reference anchor.<n> experiments on standard DIL benchmarks demonstrate that LAVA achieves significant performance improvements over state-of-the-arts.
  arXiv  Detail & Related papers  (2025-11-18T12:06:55Z)
• TFANet: Three-Stage Image-Text Feature Alignment Network for Robust Referring Image Segmentation [8.48847068018671]
  This paper proposes TFANet, a Three-stage Image-Text Feature Alignment Network.<n>It enhances multimodal alignment through a hierarchical framework comprising three stages: Knowledge Plus Stage (KPS), Knowledge Fusion Stage (KFS), and Knowledge Intensification Stage (KIS)<n>In the KPS, we design the Multiscale Linear Cross-Attention Module (MLAM), which establishes rich and efficient alignment between image regions and different granularities of linguistic descriptions.<n>The KFS further strengthens feature alignment through the Cross-modal Feature Scanning Module (CFSM), which applies multimodal selective scanning to capture long-range dependencies
  arXiv  Detail & Related papers  (2025-09-16T13:26:58Z)
• Leveraging Depth and Language for Open-Vocabulary Domain-Generalized Semantic Segmentation [8.068623902839368]
  Open-Vocabulary semantic segmentation (OVSS) and domain generalization in semantic segmentation (DGSS) highlight a subtle complementarity.<n>OV-DGSS aims to generate pixel-level masks for unseen categories while maintaining robustness across unseen domains.<n>We introduce Vireo, a novel single-stage framework for OV-DGSS that unifies the strengths of OVSS and DGSS for the first time.
  arXiv  Detail & Related papers  (2025-06-11T15:54:47Z)
• Exploring Semantic Consistency and Style Diversity for Domain Generalized Semantic Segmentation [4.850207292777464]
  Domain Generalized Semantic aims to enhance the generalization of semantic segmentation across unknown target domains.<n>We introduce SCSD for Semantic Consistency prediction and Style Diversity generalization.<n>SCSD significantly outperforms existing state-of-theart methods.
  arXiv  Detail & Related papers  (2024-12-16T18:20:06Z)
• Unified Language-driven Zero-shot Domain Adaptation [55.64088594551629]
  Unified Language-driven Zero-shot Domain Adaptation (ULDA) is a novel task setting. It enables a single model to adapt to diverse target domains without explicit domain-ID knowledge.
  arXiv  Detail & Related papers  (2024-04-10T16:44:11Z)
• One-for-All: Towards Universal Domain Translation with a Single StyleGAN [86.33216867136639]
  We propose a novel translation model, UniTranslator, for transforming representations between visually distinct domains.<n>The proposed UniTranslator is versatile and capable of performing various tasks, including style mixing, stylization, and translations.<n>UniTranslator surpasses the performance of existing general-purpose models and performs well against specialized models in representative tasks.
  arXiv  Detail & Related papers  (2023-10-22T08:02:55Z)
• GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation [103.54337984566877]
  We introduce a novel versatile framework, Generative Prior-guided UNsupervised Image-to-image Translation (GP-UNIT) GP-UNIT is able to perform valid translations between both close domains and distant domains. We validate the superiority of GP-UNIT over state-of-the-art translation models in robust, high-quality and diversified translations.
  arXiv  Detail & Related papers  (2023-06-07T17:59:22Z)
• Referring Image Segmentation via Cross-Modal Progressive Comprehension [94.70482302324704]
  Referring image segmentation aims at segmenting the foreground masks of the entities that can well match the description given in the natural language expression. Previous approaches tackle this problem using implicit feature interaction and fusion between visual and linguistic modalities. We propose a Cross-Modal Progressive (CMPC) module and a Text-Guided Feature Exchange (TGFE) module to effectively address the challenging task.
  arXiv  Detail & Related papers  (2020-10-01T16:02:30Z)
• GMM-UNIT: Unsupervised Multi-Domain and Multi-Modal Image-to-Image Translation via Attribute Gaussian Mixture Modeling [66.50914391679375]
  Unsupervised image-to-image translation (UNIT) aims at learning a mapping between several visual domains by using unpaired training images. Recent studies have shown remarkable success for multiple domains but they suffer from two main limitations. We propose a method named GMM-UNIT, which is based on a content-attribute disentangled representation where the space is fitted with a GMM.
  arXiv  Detail & Related papers  (2020-03-15T10:18:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.