Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey
- URL: http://arxiv.org/abs/2303.08557v1
- Date: Wed, 15 Mar 2023 12:18:16 GMT
- Title: Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey
- Authors: Huali Xu, Shuaifeng Zhi, Shuzhou Sun, Vishal M. Patel, Li Liu
- Abstract summary: Cross-domain few-shot learning (CDFSL) has gained attention as it allows source and target data from different domains and label spaces.
This paper provides a comprehensive review of CDFSL at the first time, which has received far less attention than FSL due to its unique setup and difficulties.
- Score: 56.58687826135517
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Deep learning has been highly successful in computer vision with large
amounts of labeled data, but struggles with limited labeled training data. To
address this, Few-shot learning (FSL) is proposed, but it assumes that all
samples (including source and target task data, where target tasks are
performed with prior knowledge from source ones) are from the same domain,
which is a stringent assumption in the real world. To alleviate this
limitation, Cross-domain few-shot learning (CDFSL) has gained attention as it
allows source and target data from different domains and label spaces. This
paper provides a comprehensive review of CDFSL at the first time, which has
received far less attention than FSL due to its unique setup and difficulties.
We expect this paper to serve as both a position paper and a tutorial for those
doing research in CDFSL. This review first introduces the definition of CDFSL
and the issues involved, followed by the core scientific question and
challenge. A comprehensive review of validated CDFSL approaches from the
existing literature is then presented, along with their detailed descriptions
based on a rigorous taxonomy. Furthermore, this paper outlines and discusses
several promising directions of CDFSL that deserve further scientific
investigation, covering aspects of problem setups, applications and theories.
Related papers
- Towards Cross-Domain Continual Learning [8.22291258264193]
We introduce a novel approach called Cross-Domain Continual Learning (CDCL)
Our method combines inter- and intra-task cross-attention mechanisms within a compact convolutional network.
By leveraging an intra-task-specific pseudo-labeling method, we ensure accurate input pairs for both labeled and unlabeled samples.
arXiv Detail & Related papers (2024-02-19T19:54:03Z) - CDFSL-V: Cross-Domain Few-Shot Learning for Videos [58.37446811360741]
Few-shot video action recognition is an effective approach to recognizing new categories with only a few labeled examples.
Existing methods in video action recognition rely on large labeled datasets from the same domain.
We propose a novel cross-domain few-shot video action recognition method that leverages self-supervised learning and curriculum learning.
arXiv Detail & Related papers (2023-09-07T19:44:27Z) - ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain
Few-Shot Learning [95.78635058475439]
Cross-Domain Few-Shot Learning aims at addressing the Few-Shot Learning problem across different domains.
This paper technically contributes a novel Multi-Expert Domain Decompositional Network (ME-D2N)
We present a novel domain decomposition module that learns to decompose the student model into two domain-related sub parts.
arXiv Detail & Related papers (2022-10-11T09:24:47Z) - Few-Shot Object Detection in Unseen Domains [4.36080478413575]
Few-shot object detection (FSOD) has thrived in recent years to learn novel object classes with limited data.
We propose various data augmentations techniques on the few shots of novel classes to account for all possible domain-specific information.
Our experiments on the T-LESS dataset show that the proposed approach succeeds in alleviating the domain gap considerably.
arXiv Detail & Related papers (2022-04-11T13:16:41Z) - DATA: Domain-Aware and Task-Aware Pre-training [94.62676913928831]
We present DATA, a simple yet effective NAS approach specialized for self-supervised learning (SSL)
Our method achieves promising results across a wide range of computation costs on downstream tasks, including image classification, object detection and semantic segmentation.
arXiv Detail & Related papers (2022-03-17T02:38:49Z) - Understanding Cross-Domain Few-Shot Learning: An Experimental Study [17.81177649496765]
Cross-domain few-shot learning has drawn increasing attention for handling large differences between the source and target domains.
Recent works have considered exploiting small-scale unlabeled data from the target domain during the pre-training stage.
This data enables self-supervised pre-training on the target domain, in addition to supervised pre-training on the source domain.
arXiv Detail & Related papers (2022-02-01T12:35:25Z) - Self-Taught Cross-Domain Few-Shot Learning with Weakly Supervised Object
Localization and Task-Decomposition [84.24343796075316]
We propose a task-expansion-decomposition framework for Cross-Domain Few-Shot Learning.
The proposed Self-Taught (ST) approach alleviates the problem of non-target guidance by constructing task-oriented metric spaces.
We conduct experiments under the cross-domain setting including 8 target domains: CUB, Cars, Places, Plantae, CropDieases, EuroSAT, ISIC, and ChestX.
arXiv Detail & Related papers (2021-09-03T04:23:07Z) - A Review of Single-Source Deep Unsupervised Visual Domain Adaptation [81.07994783143533]
Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks.
In many applications, it is prohibitively expensive and time-consuming to obtain large quantities of labeled data.
To cope with limited labeled training data, many have attempted to directly apply models trained on a large-scale labeled source domain to another sparsely labeled or unlabeled target domain.
arXiv Detail & Related papers (2020-09-01T00:06:50Z) - Revisiting Mid-Level Patterns for Cross-Domain Few-Shot Recognition [31.81367604846625]
Cross-domain few-shot learning is proposed to transfer knowledge from general-domain base classes to special-domain novel classes.
In this paper, we study a challenging subset of CDFSL where the novel classes are in distant domains from base classes.
We propose a residual-prediction task to encourage mid-level features to learn discriminative information of each sample.
arXiv Detail & Related papers (2020-08-07T12:45:39Z) - Few-Shot Learning as Domain Adaptation: Algorithm and Analysis [120.75020271706978]
Few-shot learning uses prior knowledge learned from the seen classes to recognize the unseen classes.
This class-difference-caused distribution shift can be considered as a special case of domain shift.
We propose a prototypical domain adaptation network with attention (DAPNA) to explicitly tackle such a domain shift problem in a meta-learning framework.
arXiv Detail & Related papers (2020-02-06T01:04:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.