Open Set Domain Adaptation by Extreme Value Theory

• URL: http://arxiv.org/abs/2101.02561v1
• Date: Tue, 22 Dec 2020 19:31:32 GMT
• Title: Open Set Domain Adaptation by Extreme Value Theory
• Authors: Yiming Xu, Diego Klabjan
• Abstract summary: We tackle the open set domain adaptation problem under the assumption that the source and the target label spaces only partially overlap. We propose an instance-level reweighting strategy for domain adaptation where the weights indicate the likelihood of a sample belonging to known classes. Experiments on conventional domain adaptation datasets show that the proposed method outperforms the state-of-the-art models.
• Score: 22.826118321715455
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Common domain adaptation techniques assume that the source domain and the target domain share an identical label space, which is problematic since when target samples are unlabeled we have no knowledge on whether the two domains share the same label space. When this is not the case, the existing methods fail to perform well because the additional unknown classes are also matched with the source domain during adaptation. In this paper, we tackle the open set domain adaptation problem under the assumption that the source and the target label spaces only partially overlap, and the task becomes when the unknown classes exist, how to detect the target unknown classes and avoid aligning them with the source domain. We propose to utilize an instance-level reweighting strategy for domain adaptation where the weights indicate the likelihood of a sample belonging to known classes and to model the tail of the entropy distribution with Extreme Value Theory for unknown class detection. Experiments on conventional domain adaptation datasets show that the proposed method outperforms the state-of-the-art models.

Related papers

• Self-Paced Learning for Open-Set Domain Adaptation [50.620824701934]
  Traditional domain adaptation methods presume that the classes in the source and target domains are identical. Open-set domain adaptation (OSDA) addresses this limitation by allowing previously unseen classes in the target domain. We propose a novel framework based on self-paced learning to distinguish common and unknown class samples.
  arXiv  Detail & Related papers  (2023-03-10T14:11:09Z)
• Domain-Invariant Feature Alignment Using Variational Inference For Partial Domain Adaptation [6.04077629908308]
  The proposed technique delivers superior and comparable accuracy to existing methods. The experimental findings in numerous cross-domain classification tasks demonstrate that the proposed technique delivers superior and comparable accuracy to existing methods.
  arXiv  Detail & Related papers  (2022-12-03T10:39:14Z)
• Source-Free Domain Adaptation via Distribution Estimation [106.48277721860036]
  Domain Adaptation aims to transfer the knowledge learned from a labeled source domain to an unlabeled target domain whose data distributions are different. Recently, Source-Free Domain Adaptation (SFDA) has drawn much attention, which tries to tackle domain adaptation problem without using source data. In this work, we propose a novel framework called SFDA-DE to address SFDA task via source Distribution Estimation.
  arXiv  Detail & Related papers  (2022-04-24T12:22:19Z)
• Progressively Select and Reject Pseudo-labelled Samples for Open-Set Domain Adaptation [26.889303784575805]
  Domain adaptation solves image classification problems in the target domain by taking advantage of the labelled source data and unlabelled target data. Our proposed method learns discriminative common subspaces for the source and target domains using a novel Open-Set Locality Preserving Projection (OSLPP) algorithm. The common subspace learning and the pseudo-labelled sample selection/rejection facilitate each other in an iterative learning framework.
  arXiv  Detail & Related papers  (2021-10-25T04:28:55Z)
• Source-Free Domain Adaptive Fundus Image Segmentation with Denoised Pseudo-Labeling [56.98020855107174]
  Domain adaptation typically requires to access source domain data to utilize their distribution information for domain alignment with the target data. In many real-world scenarios, the source data may not be accessible during the model adaptation in the target domain due to privacy issue. We present a novel denoised pseudo-labeling method for this problem, which effectively makes use of the source model and unlabeled target data.
  arXiv  Detail & Related papers  (2021-09-19T06:38:21Z)
• Cross-Domain Adaptive Clustering for Semi-Supervised Domain Adaptation [85.6961770631173]
  In semi-supervised domain adaptation, a few labeled samples per class in the target domain guide features of the remaining target samples to aggregate around them. We propose a novel approach called Cross-domain Adaptive Clustering to address this problem.
  arXiv  Detail & Related papers  (2021-04-19T16:07:32Z)
• Against Adversarial Learning: Naturally Distinguish Known and Unknown in Open Set Domain Adaptation [17.819949636876018]
  Open set domain adaptation refers to the scenario that the target domain contains categories that do not exist in the source domain. We propose an "against adversarial learning" method that can distinguish unknown target data and known data naturally. Experimental results show that the proposed method can make significant improvement in performance compared with several state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-11-04T10:30:43Z)
• Open-Set Hypothesis Transfer with Semantic Consistency [99.83813484934177]
  We introduce a method that focuses on the semantic consistency under transformation of target data. Our model first discovers confident predictions and performs classification with pseudo-labels. As a result, unlabeled data can be classified into discriminative classes coincided with either source classes or unknown classes.
  arXiv  Detail & Related papers  (2020-10-01T10:44:31Z)
• Adversarial Network with Multiple Classifiers for Open Set Domain Adaptation [9.251407403582501]
  This paper focuses on the type of open set domain adaptation setting where the target domain has both private ('unknown classes') label space and the shared ('known classes') label space. Prevalent distribution-matching domain adaptation methods are inadequate in such a setting. We propose a novel adversarial domain adaptation model with multiple auxiliary classifiers.
  arXiv  Detail & Related papers  (2020-07-01T11:23:07Z)
• Cross-domain Self-supervised Learning for Domain Adaptation with Few Source Labels [78.95901454696158]
  We propose a novel Cross-Domain Self-supervised learning approach for domain adaptation. Our method significantly boosts performance of target accuracy in the new target domain with few source labels.
  arXiv  Detail & Related papers  (2020-03-18T15:11:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.