Curriculum Manager for Source Selection in Multi-Source Domain
Adaptation
- URL: http://arxiv.org/abs/2007.01261v1
- Date: Thu, 2 Jul 2020 17:15:01 GMT
- Title: Curriculum Manager for Source Selection in Multi-Source Domain
Adaptation
- Authors: Luyu Yang, Yogesh Balaji, Ser-Nam Lim, Abhinav Shrivastava
- Abstract summary: We propose an adversarial agent that learns a dynamic curriculum for source samples, called Curriculum Manager for Source Selection (CMSS)
CMSS does not require any knowledge of the domain labels, yet it outperforms other methods on four well-known benchmarks by significant margins.
- Score: 65.22251010276652
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The performance of Multi-Source Unsupervised Domain Adaptation depends
significantly on the effectiveness of transfer from labeled source domain
samples. In this paper, we proposed an adversarial agent that learns a dynamic
curriculum for source samples, called Curriculum Manager for Source Selection
(CMSS). The Curriculum Manager, an independent network module, constantly
updates the curriculum during training, and iteratively learns which domains or
samples are best suited for aligning to the target. The intuition behind this
is to force the Curriculum Manager to constantly re-measure the transferability
of latent domains over time to adversarially raise the error rate of the domain
discriminator. CMSS does not require any knowledge of the domain labels, yet it
outperforms other methods on four well-known benchmarks by significant margins.
We also provide interpretable results that shed light on the proposed method.
Related papers
- Revisiting the Domain Shift and Sample Uncertainty in Multi-source
Active Domain Transfer [69.82229895838577]
Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.
This setting neglects the more practical scenario where training data are collected from multiple sources.
This motivates us to target a new and challenging setting of knowledge transfer that extends ADA from a single source domain to multiple source domains.
arXiv Detail & Related papers (2023-11-21T13:12:21Z) - Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from
Mixture-of-Experts [33.21435044949033]
Most existing methods perform training on multiple source domains using a single model.
We propose a novel framework for unsupervised test-time adaptation, which is formulated as a knowledge distillation process.
arXiv Detail & Related papers (2022-10-08T02:28:10Z) - Label Distribution Learning for Generalizable Multi-source Person
Re-identification [48.77206888171507]
Person re-identification (Re-ID) is a critical technique in the video surveillance system.
It is difficult to directly apply the supervised model to arbitrary unseen domains.
We propose a novel label distribution learning (LDL) method to address the generalizable multi-source person Re-ID task.
arXiv Detail & Related papers (2022-04-12T15:59:10Z) - Your Classifier can Secretly Suffice Multi-Source Domain Adaptation [72.47706604261992]
Multi-Source Domain Adaptation (MSDA) deals with the transfer of task knowledge from multiple labeled source domains to an unlabeled target domain.
We present a different perspective to MSDA wherein deep models are observed to implicitly align the domains under label supervision.
arXiv Detail & Related papers (2021-03-20T12:44:13Z) - Multi-Source Domain Adaptation with Collaborative Learning for Semantic
Segmentation [32.95273803359897]
Multi-source unsupervised domain adaptation(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain.
We propose a novel multi-source domain adaptation framework based on collaborative learning for semantic segmentation.
arXiv Detail & Related papers (2021-03-08T12:51:42Z) - Curriculum CycleGAN for Textual Sentiment Domain Adaptation with
Multiple Sources [68.31273535702256]
We propose a novel instance-level MDA framework, named curriculum cycle-consistent generative adversarial network (C-CycleGAN)
C-CycleGAN consists of three components: (1) pre-trained text encoder which encodes textual input from different domains into a continuous representation space, (2) intermediate domain generator with curriculum instance-level adaptation which bridges the gap across source and target domains, and (3) task classifier trained on the intermediate domain for final sentiment classification.
We conduct extensive experiments on three benchmark datasets and achieve substantial gains over state-of-the-art DA approaches.
arXiv Detail & Related papers (2020-11-17T14:50:55Z) - Multi-source Domain Adaptation for Visual Sentiment Classification [92.53780541232773]
We propose a novel multi-source domain adaptation (MDA) method, termed Multi-source Sentiment Generative Adversarial Network (MSGAN)
To handle data from multiple source domains, MSGAN learns to find a unified sentiment latent space where data from both the source and target domains share a similar distribution.
Extensive experiments conducted on four benchmark datasets demonstrate that MSGAN significantly outperforms the state-of-the-art MDA approaches for visual sentiment classification.
arXiv Detail & Related papers (2020-01-12T08:37:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.