TOHAN: A One-step Approach towards Few-shot Hypothesis Adaptation
- URL: http://arxiv.org/abs/2106.06326v1
- Date: Fri, 11 Jun 2021 11:46:20 GMT
- Title: TOHAN: A One-step Approach towards Few-shot Hypothesis Adaptation
- Authors: Haoang Chi and Feng Liu and Wenjing Yang and Long Lan and Tongliang
Liu and Bo Han and William K. Cheung and James T. Kwok
- Abstract summary: In few-shot domain adaptation (FDA), classifiers for the target domain are trained with labeled data in the source domain (SD) and few labeled data in the target domain (TD)
Data usually contain private information in the current era, e.g., data distributed on personal phones.
We propose a target orientated hypothesis adaptation network (TOHAN) to solve the problem.
- Score: 73.75784418508033
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In few-shot domain adaptation (FDA), classifiers for the target domain are
trained with accessible labeled data in the source domain (SD) and few labeled
data in the target domain (TD). However, data usually contain private
information in the current era, e.g., data distributed on personal phones.
Thus, the private information will be leaked if we directly access data in SD
to train a target-domain classifier (required by FDA methods). In this paper,
to thoroughly prevent the privacy leakage in SD, we consider a very challenging
problem setting, where the classifier for the TD has to be trained using few
labeled target data and a well-trained SD classifier, named few-shot hypothesis
adaptation (FHA). In FHA, we cannot access data in SD, as a result, the private
information in SD will be protected well. To this end, we propose a target
orientated hypothesis adaptation network (TOHAN) to solve the FHA problem,
where we generate highly-compatible unlabeled data (i.e., an intermediate
domain) to help train a target-domain classifier. TOHAN maintains two deep
networks simultaneously, where one focuses on learning an intermediate domain
and the other takes care of the intermediate-to-target distributional
adaptation and the target-risk minimization. Experimental results show that
TOHAN outperforms competitive baselines significantly.
Related papers
- Privacy Preserving Federated Unsupervised Domain Adaptation with Application to Age Prediction from DNA Methylation Data [2.699900017799093]
We introduce a privacy-preserving framework for unsupervised domain adaptation in high-dimensional settings.
Our framework is the first privacy-preserving solution for high-dimensional domain adaptation in federated environments.
arXiv Detail & Related papers (2024-11-26T10:19:16Z) - Subject-Based Domain Adaptation for Facial Expression Recognition [51.10374151948157]
Adapting a deep learning model to a specific target individual is a challenging facial expression recognition task.
This paper introduces a new MSDA method for subject-based domain adaptation in FER.
It efficiently leverages information from multiple source subjects to adapt a deep FER model to a single target individual.
arXiv Detail & Related papers (2023-12-09T18:40:37Z) - SIDE: Self-supervised Intermediate Domain Exploration for Source-free
Domain Adaptation [36.470026809824674]
Domain adaptation aims to alleviate the domain shift when transferring the knowledge learned from the source domain to the target domain.
Due to privacy issues, source-free domain adaptation (SFDA) has recently become very demanding yet challenging.
This paper proposes self-supervised intermediate domain exploration (SIDE) that effectively bridges the domain gap with an intermediate domain.
arXiv Detail & Related papers (2023-10-13T07:50:37Z) - Source-Free Domain Adaptation for Medical Image Segmentation via
Prototype-Anchored Feature Alignment and Contrastive Learning [57.43322536718131]
We present a two-stage source-free domain adaptation (SFDA) framework for medical image segmentation.
In the prototype-anchored feature alignment stage, we first utilize the weights of the pre-trained pixel-wise classifier as source prototypes.
Then, we introduce the bi-directional transport to align the target features with class prototypes by minimizing its expected cost.
arXiv Detail & Related papers (2023-07-19T06:07:12Z) - Source-Free Domain Adaptation via Distribution Estimation [106.48277721860036]
Domain Adaptation aims to transfer the knowledge learned from a labeled source domain to an unlabeled target domain whose data distributions are different.
Recently, Source-Free Domain Adaptation (SFDA) has drawn much attention, which tries to tackle domain adaptation problem without using source data.
In this work, we propose a novel framework called SFDA-DE to address SFDA task via source Distribution Estimation.
arXiv Detail & Related papers (2022-04-24T12:22:19Z) - Source Data-absent Unsupervised Domain Adaptation through Hypothesis
Transfer and Labeling Transfer [137.36099660616975]
Unsupervised adaptation adaptation (UDA) aims to transfer knowledge from a related but different well-labeled source domain to a new unlabeled target domain.
Most existing UDA methods require access to the source data, and thus are not applicable when the data are confidential and not shareable due to privacy concerns.
This paper aims to tackle a realistic setting with only a classification model available trained over, instead of accessing to the source data.
arXiv Detail & Related papers (2020-12-14T07:28:50Z) - Open-Set Hypothesis Transfer with Semantic Consistency [99.83813484934177]
We introduce a method that focuses on the semantic consistency under transformation of target data.
Our model first discovers confident predictions and performs classification with pseudo-labels.
As a result, unlabeled data can be classified into discriminative classes coincided with either source classes or unknown classes.
arXiv Detail & Related papers (2020-10-01T10:44:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.