MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation

• URL: http://arxiv.org/abs/2103.13575v1
• Date: Thu, 25 Mar 2021 03:16:05 GMT
• Title: MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation
• Authors: Guoqiang Wei, Cuiling Lan, Wenjun Zeng, Zhibo Chen
• Abstract summary: This paper proposes an effective meta-optimization based strategy dubbed MetaAlign. We treat the domain alignment objective and the classification objective as the meta-train and meta-test tasks in a meta-learning scheme. Experimental results demonstrate the effectiveness of our proposed method on top of various alignment-based baseline approaches.
• Score: 84.90801699807426
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For unsupervised domain adaptation (UDA), to alleviate the effect of domain shift, many approaches align the source and target domains in the feature space by adversarial learning or by explicitly aligning their statistics. However, the optimization objective of such domain alignment is generally not coordinated with that of the object classification task itself such that their descent directions for optimization may be inconsistent. This will reduce the effectiveness of domain alignment in improving the performance of UDA. In this paper, we aim to study and alleviate the optimization inconsistency problem between the domain alignment and classification tasks. We address this by proposing an effective meta-optimization based strategy dubbed MetaAlign, where we treat the domain alignment objective and the classification objective as the meta-train and meta-test tasks in a meta-learning scheme. MetaAlign encourages both tasks to be optimized in a coordinated way, which maximizes the inner product of the gradients of the two tasks during training. Experimental results demonstrate the effectiveness of our proposed method on top of various alignment-based baseline approaches, for tasks of object classification and object detection. MetaAlign helps achieve the state-of-the-art performance.

Related papers

• Self-training through Classifier Disagreement for Cross-Domain Opinion Target Extraction [62.41511766918932]
  Opinion target extraction (OTE) or aspect extraction (AE) is a fundamental task in opinion mining. Recent work focus on cross-domain OTE, which is typically encountered in real-world scenarios. We propose a new SSL approach that opts for selecting target samples whose model output from a domain-specific teacher and student network disagrees on the unlabelled target data.
  arXiv  Detail & Related papers  (2023-02-28T16:31:17Z)
• Labeling Where Adapting Fails: Cross-Domain Semantic Segmentation with Point Supervision via Active Selection [81.703478548177]
  Training models dedicated to semantic segmentation require a large amount of pixel-wise annotated data. Unsupervised domain adaptation approaches aim at aligning the feature distributions between the labeled source and the unlabeled target data. Previous works attempted to include human interactions in this process under the form of sparse single-pixel annotations in the target data. We propose a new domain adaptation framework for semantic segmentation with annotated points via active selection.
  arXiv  Detail & Related papers  (2022-06-01T01:52:28Z)
• Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation [42.16718847243166]
  Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. This paper revisits the use of subspace alignment for UDA and proposes a novel adaptation algorithm that consistently leads to improved generalization.
  arXiv  Detail & Related papers  (2022-01-05T20:16:38Z)
• Pareto Domain Adaptation [35.48609986914723]
  Domain adaptation (DA) attempts to transfer the knowledge from a labeled source domain to an unlabeled target domain. We propose a new approach to control the overall optimization direction, aiming to cooperatively optimize all training objectives.
  arXiv  Detail & Related papers  (2021-12-08T06:31:13Z)
• Dynamic Feature Alignment for Semi-supervised Domain Adaptation [23.67093835143]
  We propose to use dynamic feature alignment to address both inter- and intra-domain discrepancy. Our approach, which doesn't require extensive tuning or adversarial training, significantly improves the state of the art for semi-supervised domain adaptation.
  arXiv  Detail & Related papers  (2021-10-18T22:26:27Z)
• ToAlign: Task-oriented Alignment for Unsupervised Domain Adaptation [84.90801699807426]
  We study what features should be aligned across domains and propose to make the domain alignment proactively serve classification. We explicitly decompose a feature in the source domain intoa task-related/discriminative feature that should be aligned, and a task-irrelevant feature that should be avoided/ignored.
  arXiv  Detail & Related papers  (2021-06-21T02:17:48Z)
• MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentation [14.8840510432657]
  Unsupervised domain adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain. Existing self-training based UDA approaches assign pseudo labels for target data and treat them as ground truth labels. generated pseudo labels from the model optimized on the source domain inevitably contain noise due to the domain gap.
  arXiv  Detail & Related papers  (2021-03-09T06:57:03Z)
• Surprisingly Simple Semi-Supervised Domain Adaptation with Pretraining and Consistency [93.89773386634717]
  Visual domain adaptation involves learning to classify images from a target visual domain using labels available in a different source domain. We show that in the presence of a few target labels, simple techniques like self-supervision (via rotation prediction) and consistency regularization can be effective without any adversarial alignment to learn a good target classifier. Our Pretraining and Consistency (PAC) approach, can achieve state of the art accuracy on this semi-supervised domain adaptation task, surpassing multiple adversarial domain alignment methods, across multiple datasets.
  arXiv  Detail & Related papers  (2021-01-29T18:40:17Z)
• Domain Adaptive Person Re-Identification via Coupling Optimization [58.567492812339566]
  Domain adaptive person Re-Identification (ReID) is challenging owing to the domain gap and shortage of annotations on target scenarios. This paper proposes a coupling optimization method including the Domain-Invariant Mapping (DIM) method and the Global-Local distance Optimization ( GLO) GLO is designed to train the ReID model with unsupervised setting on the target domain.
  arXiv  Detail & Related papers  (2020-11-06T14:01:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.