DRANet: Disentangling Representation and Adaptation Networks for Unsupervised Cross-Domain Adaptation

• URL: http://arxiv.org/abs/2103.13447v1
• Date: Wed, 24 Mar 2021 18:54:23 GMT
• Title: DRANet: Disentangling Representation and Adaptation Networks for Unsupervised Cross-Domain Adaptation
• Authors: Seunghun Lee, Sunghyun Cho, Sunghoon Im
• Abstract summary: DRANet is a network architecture that disentangles image representations and transfers the visual attributes in a latent space for unsupervised cross-domain adaptation. Our model encodes individual representations of content (scene structure) and style (artistic appearance) from both source and target images. It adapts the domain by incorporating the transferred style factor into the content factor along with learnable weights specified for each domain.
• Score: 23.588766224169493
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we present DRANet, a network architecture that disentangles image representations and transfers the visual attributes in a latent space for unsupervised cross-domain adaptation. Unlike the existing domain adaptation methods that learn associated features sharing a domain, DRANet preserves the distinctiveness of each domain's characteristics. Our model encodes individual representations of content (scene structure) and style (artistic appearance) from both source and target images. Then, it adapts the domain by incorporating the transferred style factor into the content factor along with learnable weights specified for each domain. This learning framework allows bi-/multi-directional domain adaptation with a single encoder-decoder network and aligns their domain shift. Additionally, we propose a content-adaptive domain transfer module that helps retain scene structure while transferring style. Extensive experiments show our model successfully separates content-style factors and synthesizes visually pleasing domain-transferred images. The proposed method demonstrates state-of-the-art performance on standard digit classification tasks as well as semantic segmentation tasks.

Related papers

• Domain-Rectifying Adapter for Cross-Domain Few-Shot Segmentation [40.667166043101076]
  We propose a small adapter for rectifying diverse target domain styles to the source domain. The adapter is trained to rectify the image features from diverse synthesized target domains to align with the source domain. Our method achieves promising results on cross-domain few-shot semantic segmentation tasks.
  arXiv  Detail & Related papers  (2024-04-16T07:07:40Z)
• Domain Generalization by Learning and Removing Domain-specific Features [15.061481139046952]
  Domain generalization aims to tackle this issue by learning a model that can generalize to unseen domains. We propose a new approach that aims to explicitly remove domain-specific features for domain generalization. We develop an encoder-decoder network to map each input image into a new image space where the learned domain-specific features are removed.
  arXiv  Detail & Related papers  (2022-12-14T08:46:46Z)
• Domain Invariant Masked Autoencoders for Self-supervised Learning from Multi-domains [73.54897096088149]
  We propose a Domain-invariant Masked AutoEncoder (DiMAE) for self-supervised learning from multi-domains. The core idea is to augment the input image with style noise from different domains and then reconstruct the image from the embedding of the augmented image. Experiments on PACS and DomainNet illustrate that DiMAE achieves considerable gains compared with recent state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-05-10T09:49:40Z)
• Disentangled Unsupervised Image Translation via Restricted Information Flow [61.44666983942965]
  Many state-of-art methods hard-code the desired shared-vs-specific split into their architecture. We propose a new method that does not rely on inductive architectural biases. We show that the proposed method achieves consistently high manipulation accuracy across two synthetic and one natural dataset.
  arXiv  Detail & Related papers  (2021-11-26T00:27:54Z)
• DensePASS: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation with Attention-Augmented Context Exchange [32.29797061415896]
  We formalize the task of unsupervised domain adaptation for panoramic semantic segmentation. A network trained on labelled examples from the source domain of pinhole camera data is deployed in a different target domain of panoramic images. We build a generic framework for cross-domain panoramic semantic segmentation based on different variants of attention-augmented domain adaptation modules.
  arXiv  Detail & Related papers  (2021-08-13T20:15:46Z)
• AFAN: Augmented Feature Alignment Network for Cross-Domain Object Detection [90.18752912204778]
  Unsupervised domain adaptation for object detection is a challenging problem with many real-world applications. We propose a novel augmented feature alignment network (AFAN) which integrates intermediate domain image generation and domain-adversarial training. Our approach significantly outperforms the state-of-the-art methods on standard benchmarks for both similar and dissimilar domain adaptations.
  arXiv  Detail & Related papers  (2021-06-10T05:01:20Z)
• Variational Interaction Information Maximization for Cross-domain Disentanglement [34.08140408283391]
  Cross-domain disentanglement is the problem of learning representations partitioned into domain-invariant and domain-specific representations. We cast the simultaneous learning of domain-invariant and domain-specific representations as a joint objective of multiple information constraints. We show that our model achieves the state-of-the-art performance in the zero-shot sketch based image retrieval task.
  arXiv  Detail & Related papers  (2020-12-08T07:11:35Z)
• DoFE: Domain-oriented Feature Embedding for Generalizable Fundus Image Segmentation on Unseen Datasets [96.92018649136217]
  We present a novel Domain-oriented Feature Embedding (DoFE) framework to improve the generalization ability of CNNs on unseen target domains. Our DoFE framework dynamically enriches the image features with additional domain prior knowledge learned from multi-source domains. Our framework generates satisfying segmentation results on unseen datasets and surpasses other domain generalization and network regularization methods.
  arXiv  Detail & Related papers  (2020-10-13T07:28:39Z)
• Latent Normalizing Flows for Many-to-Many Cross-Domain Mappings [76.85673049332428]
  Learned joint representations of images and text form the backbone of several important cross-domain tasks such as image captioning. We propose a novel semi-supervised framework, which models shared information between domains and domain-specific information separately. We demonstrate the effectiveness of our model on diverse tasks, including image captioning and text-to-image synthesis.
  arXiv  Detail & Related papers  (2020-02-16T19:49:30Z)
• CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency [119.45667331836583]
  Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another. We present a novel pixel-wise adversarial domain adaptation algorithm.
  arXiv  Detail & Related papers  (2020-01-09T19:00:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.