Domain Attention Consistency for Multi-Source Domain Adaptation
- URL: http://arxiv.org/abs/2111.03911v1
- Date: Sat, 6 Nov 2021 15:56:53 GMT
- Title: Domain Attention Consistency for Multi-Source Domain Adaptation
- Authors: Zhongying Deng, Kaiyang Zhou, Yongxin Yang, Tao Xiang
- Abstract summary: Key design is a feature channel attention module, which aims to identify transferable features (attributes)
Experiments on three MSDA benchmarks show that our DAC-Net achieves new state of the art performance on all of them.
- Score: 100.25573559447551
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most existing multi-source domain adaptation (MSDA) methods minimize the
distance between multiple source-target domain pairs via feature distribution
alignment, an approach borrowed from the single source setting. However, with
diverse source domains, aligning pairwise feature distributions is challenging
and could even be counter-productive for MSDA. In this paper, we introduce a
novel approach: transferable attribute learning. The motivation is simple:
although different domains can have drastically different visual appearances,
they contain the same set of classes characterized by the same set of
attributes; an MSDA model thus should focus on learning the most transferable
attributes for the target domain. Adopting this approach, we propose a domain
attention consistency network, dubbed DAC-Net. The key design is a feature
channel attention module, which aims to identify transferable features
(attributes). Importantly, the attention module is supervised by a consistency
loss, which is imposed on the distributions of channel attention weights
between source and target domains. Moreover, to facilitate discriminative
feature learning on the target data, we combine pseudo-labeling with a class
compactness loss to minimize the distance between the target features and the
classifier's weight vectors. Extensive experiments on three MSDA benchmarks
show that our DAC-Net achieves new state of the art performance on all of them.
Related papers
- Attention-based Class-Conditioned Alignment for Multi-Source Domain Adaptation of Object Detectors [11.616494893839757]
Domain adaptation methods for object detection (OD) strive to mitigate the impact of distribution shifts by promoting feature alignment across source and target domains.
Most state-of-the-art MSDA methods for OD perform feature alignment in a class-agnostic manner.
We propose an attention-based class-conditioned alignment method for MSDA that aligns instances of each object category across domains.
arXiv Detail & Related papers (2024-03-14T23:31:41Z) - Dynamic Domain Discrepancy Adjustment for Active Multi-Domain Adaptation [3.367755441623275]
Multi-source unsupervised domain adaptation (MUDA) aims to transfer knowledge from related source domains to an unlabeled target domain.
We propose a novel approach called Dynamic Domain Discrepancy Adjustment for Active Multi-Domain Adaptation (D3AAMDA)
This mechanism controls the alignment level of features between each source domain and the target domain, effectively leveraging the local advantageous feature information within the source domains.
arXiv Detail & Related papers (2023-07-26T09:40:19Z) - Multi-Source domain adaptation via supervised contrastive learning and
confident consistency regularization [0.0]
Multi-Source Unsupervised Domain Adaptation (multi-source UDA) aims to learn a model from several labeled source domains.
We propose Contrastive Multi-Source Domain Adaptation (CMSDA) for multi-source UDA that addresses this limitation.
arXiv Detail & Related papers (2021-06-30T14:39:15Z) - Instance Level Affinity-Based Transfer for Unsupervised Domain
Adaptation [74.71931918541748]
We propose an instance affinity based criterion for source to target transfer during adaptation, called ILA-DA.
We first propose a reliable and efficient method to extract similar and dissimilar samples across source and target, and utilize a multi-sample contrastive loss to drive the domain alignment process.
We verify the effectiveness of ILA-DA by observing consistent improvements in accuracy over popular domain adaptation approaches on a variety of benchmark datasets.
arXiv Detail & Related papers (2021-04-03T01:33:14Z) - Surprisingly Simple Semi-Supervised Domain Adaptation with Pretraining
and Consistency [93.89773386634717]
Visual domain adaptation involves learning to classify images from a target visual domain using labels available in a different source domain.
We show that in the presence of a few target labels, simple techniques like self-supervision (via rotation prediction) and consistency regularization can be effective without any adversarial alignment to learn a good target classifier.
Our Pretraining and Consistency (PAC) approach, can achieve state of the art accuracy on this semi-supervised domain adaptation task, surpassing multiple adversarial domain alignment methods, across multiple datasets.
arXiv Detail & Related papers (2021-01-29T18:40:17Z) - Discriminative Cross-Domain Feature Learning for Partial Domain
Adaptation [70.45936509510528]
Partial domain adaptation aims to adapt knowledge from a larger and more diverse source domain to a smaller target domain with less number of classes.
Recent practice on domain adaptation manages to extract effective features by incorporating the pseudo labels for the target domain.
It is essential to align target data with only a small set of source data.
arXiv Detail & Related papers (2020-08-26T03:18:53Z) - Learning to Combine: Knowledge Aggregation for Multi-Source Domain
Adaptation [56.694330303488435]
We propose a Learning to Combine for Multi-Source Domain Adaptation (LtC-MSDA) framework.
In the nutshell, a knowledge graph is constructed on the prototypes of various domains to realize the information propagation among semantically adjacent representations.
Our approach outperforms existing methods with a remarkable margin.
arXiv Detail & Related papers (2020-07-17T07:52:44Z) - MADAN: Multi-source Adversarial Domain Aggregation Network for Domain
Adaptation [58.38749495295393]
Domain adaptation aims to learn a transferable model to bridge the domain shift between one labeled source domain and another sparsely labeled or unlabeled target domain.
Recent multi-source domain adaptation (MDA) methods do not consider the pixel-level alignment between sources and target.
We propose a novel MDA framework to address these challenges.
arXiv Detail & Related papers (2020-02-19T21:22:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.