Self-Taught Cross-Domain Few-Shot Learning with Weakly Supervised Object
Localization and Task-Decomposition
- URL: http://arxiv.org/abs/2109.01302v1
- Date: Fri, 3 Sep 2021 04:23:07 GMT
- Title: Self-Taught Cross-Domain Few-Shot Learning with Weakly Supervised Object
Localization and Task-Decomposition
- Authors: Xiyao Liu, Zhong Ji, Yanwei Pang, Zhongfei Zhang
- Abstract summary: We propose a task-expansion-decomposition framework for Cross-Domain Few-Shot Learning.
The proposed Self-Taught (ST) approach alleviates the problem of non-target guidance by constructing task-oriented metric spaces.
We conduct experiments under the cross-domain setting including 8 target domains: CUB, Cars, Places, Plantae, CropDieases, EuroSAT, ISIC, and ChestX.
- Score: 84.24343796075316
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The domain shift between the source and target domain is the main challenge
in Cross-Domain Few-Shot Learning (CD-FSL). However, the target domain is
absolutely unknown during the training on the source domain, which results in
lacking directed guidance for target tasks. We observe that since there are
similar backgrounds in target domains, it can apply self-labeled samples as
prior tasks to transfer knowledge onto target tasks. To this end, we propose a
task-expansion-decomposition framework for CD-FSL, called Self-Taught (ST)
approach, which alleviates the problem of non-target guidance by constructing
task-oriented metric spaces. Specifically, Weakly Supervised Object
Localization (WSOL) and self-supervised technologies are employed to enrich
task-oriented samples by exchanging and rotating the discriminative regions,
which generates a more abundant task set. Then these tasks are decomposed into
several tasks to finish the task of few-shot recognition and rotation
classification. It helps to transfer the source knowledge onto the target tasks
and focus on discriminative regions. We conduct extensive experiments under the
cross-domain setting including 8 target domains: CUB, Cars, Places, Plantae,
CropDieases, EuroSAT, ISIC, and ChestX. Experimental results demonstrate that
the proposed ST approach is applicable to various metric-based models, and
provides promising improvements in CD-FSL.
Related papers
- Domain Adaptive Few-Shot Open-Set Learning [36.39622440120531]
We propose Domain Adaptive Few-Shot Open Set Recognition (DA-FSOS) and introduce a meta-learning-based architecture named DAFOSNET.
Our training approach ensures that DAFOS-NET can generalize well to new scenarios in the target domain.
We present three benchmarks for DA-FSOS based on the Office-Home, mini-ImageNet/CUB, and DomainNet datasets.
arXiv Detail & Related papers (2023-09-22T12:04:47Z) - Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey [33.00835033658241]
Few-shot learning enables models to perform the target tasks with very few labeled examples.
To overcome this limitation, Cross-domain few-shot learning has gained attention.
This paper presents the first comprehensive review of Cross-domain Few-shot Learning.
arXiv Detail & Related papers (2023-03-15T12:18:16Z) - Self-training through Classifier Disagreement for Cross-Domain Opinion
Target Extraction [62.41511766918932]
Opinion target extraction (OTE) or aspect extraction (AE) is a fundamental task in opinion mining.
Recent work focus on cross-domain OTE, which is typically encountered in real-world scenarios.
We propose a new SSL approach that opts for selecting target samples whose model output from a domain-specific teacher and student network disagrees on the unlabelled target data.
arXiv Detail & Related papers (2023-02-28T16:31:17Z) - Cross Domain Object Detection by Target-Perceived Dual Branch
Distillation [49.68119030818388]
Cross domain object detection is a realistic and challenging task in the wild.
We propose a novel Target-perceived Dual-branch Distillation (TDD) framework.
Our TDD significantly outperforms the state-of-the-art methods on all the benchmarks.
arXiv Detail & Related papers (2022-05-03T03:51:32Z) - Multilevel Knowledge Transfer for Cross-Domain Object Detection [26.105283273950942]
Domain shift is a well known problem where a model trained on a particular domain (source) does not perform well when exposed to samples from a different domain (target)
In this work, we address the domain shift problem for the object detection task.
Our approach relies on gradually removing the domain shift between the source and the target domains.
arXiv Detail & Related papers (2021-08-02T15:24:40Z) - Learning Task-oriented Disentangled Representations for Unsupervised
Domain Adaptation [165.61511788237485]
Unsupervised domain adaptation (UDA) aims to address the domain-shift problem between a labeled source domain and an unlabeled target domain.
We propose a dynamic task-oriented disentangling network (DTDN) to learn disentangled representations in an end-to-end fashion for UDA.
arXiv Detail & Related papers (2020-07-27T01:21:18Z) - Alleviating Semantic-level Shift: A Semi-supervised Domain Adaptation
Method for Semantic Segmentation [97.8552697905657]
A key challenge of this task is how to alleviate the data distribution discrepancy between the source and target domains.
We propose Alleviating Semantic-level Shift (ASS), which can successfully promote the distribution consistency from both global and local views.
We apply our ASS to two domain adaptation tasks, from GTA5 to Cityscapes and from Synthia to Cityscapes.
arXiv Detail & Related papers (2020-04-02T03:25:05Z) - Spatial Attention Pyramid Network for Unsupervised Domain Adaptation [66.75008386980869]
Unsupervised domain adaptation is critical in various computer vision tasks.
We design a new spatial attention pyramid network for unsupervised domain adaptation.
Our method performs favorably against the state-of-the-art methods by a large margin.
arXiv Detail & Related papers (2020-03-29T09:03:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.