ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain Few-Shot Learning

• URL: http://arxiv.org/abs/2210.05280v1
• Date: Tue, 11 Oct 2022 09:24:47 GMT
• Title: ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain Few-Shot Learning
• Authors: Yuqian Fu, Yu Xie, Yanwei Fu, Jingjing Chen, Yu-Gang Jiang
• Abstract summary: Cross-Domain Few-Shot Learning aims at addressing the Few-Shot Learning problem across different domains. This paper technically contributes a novel Multi-Expert Domain Decompositional Network (ME-D2N) We present a novel domain decomposition module that learns to decompose the student model into two domain-related sub parts.
• Score: 95.78635058475439
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, Cross-Domain Few-Shot Learning (CD-FSL) which aims at addressing the Few-Shot Learning (FSL) problem across different domains has attracted rising attention. The core challenge of CD-FSL lies in the domain gap between the source and novel target datasets. Though many attempts have been made for CD-FSL without any target data during model training, the huge domain gap makes it still hard for existing CD-FSL methods to achieve very satisfactory results. Alternatively, learning CD-FSL models with few labeled target domain data which is more realistic and promising is advocated in previous work~\cite{fu2021meta}. Thus, in this paper, we stick to this setting and technically contribute a novel Multi-Expert Domain Decompositional Network (ME-D2N). Concretely, to solve the data imbalance problem between the source data with sufficient examples and the auxiliary target data with limited examples, we build our model under the umbrella of multi-expert learning. Two teacher models which can be considered to be experts in their corresponding domain are first trained on the source and the auxiliary target sets, respectively. Then, the knowledge distillation technique is introduced to transfer the knowledge from two teachers to a unified student model. Taking a step further, to help our student model learn knowledge from different domain teachers simultaneously, we further present a novel domain decomposition module that learns to decompose the student model into two domain-related sub parts. This is achieved by a novel domain-specific gate that learns to assign each filter to only one specific domain in a learnable way. Extensive experiments demonstrate the effectiveness of our method. Codes and models are available at https://github.com/lovelyqian/ME-D2N_for_CDFSL.

Related papers

• Multimodal Cross-Domain Few-Shot Learning for Egocentric Action Recognition [9.458578303096424]
  We address a novel cross-domain few-shot learning task with multimodal input and unlabeled target data for egocentric action recognition. This paper simultaneously tackles two critical challenges associated with egocentric action recognition. First, we propose the incorporation of multimodal distillation into the student RGB model using teacher models. Second, we introduce ensemble masked inference, a technique that reduces the number of input tokens through masking.
  arXiv  Detail & Related papers  (2024-05-30T10:30:07Z)
• Multi-Modal Cross-Domain Alignment Network for Video Moment Retrieval [55.122020263319634]
  Video moment retrieval (VMR) aims to localize the target moment from an untrimmed video according to a given language query. In this paper, we focus on a novel task: cross-domain VMR, where fully-annotated datasets are available in one domain but the domain of interest only contains unannotated datasets. We propose a novel Multi-Modal Cross-Domain Alignment network to transfer the annotation knowledge from the source domain to the target domain.
  arXiv  Detail & Related papers  (2022-09-23T12:58:20Z)
• Cross-Domain Cross-Set Few-Shot Learning via Learning Compact and Aligned Representations [74.90423071048458]
  Few-shot learning aims to recognize novel queries with only a few support samples. We consider the domain shift problem in FSL and aim to address the domain gap between the support set and the query set. We propose a novel approach, namely stabPA, to learn prototypical compact and cross-domain aligned representations.
  arXiv  Detail & Related papers  (2022-07-16T03:40:38Z)
• Few-Shot Object Detection in Unseen Domains [4.36080478413575]
  Few-shot object detection (FSOD) has thrived in recent years to learn novel object classes with limited data. We propose various data augmentations techniques on the few shots of novel classes to account for all possible domain-specific information. Our experiments on the T-LESS dataset show that the proposed approach succeeds in alleviating the domain gap considerably.
  arXiv  Detail & Related papers  (2022-04-11T13:16:41Z)
• Meta-FDMixup: Cross-Domain Few-Shot Learning Guided by Labeled Target Data [95.47859525676246]
  A recent study finds that existing few-shot learning methods, trained on the source domain, fail to generalize to the novel target domain when a domain gap is observed. In this paper, we realize that the labeled target data in Cross-Domain Few-Shot Learning has not been leveraged in any way to help the learning process.
  arXiv  Detail & Related papers  (2021-07-26T06:15:45Z)
• Revisiting Mid-Level Patterns for Cross-Domain Few-Shot Recognition [31.81367604846625]
  Cross-domain few-shot learning is proposed to transfer knowledge from general-domain base classes to special-domain novel classes. In this paper, we study a challenging subset of CDFSL where the novel classes are in distant domains from base classes. We propose a residual-prediction task to encourage mid-level features to learn discriminative information of each sample.
  arXiv  Detail & Related papers  (2020-08-07T12:45:39Z)
• Domain-Adaptive Few-Shot Learning [124.51420562201407]
  We propose a novel domain-adversarial network (DAPN) model for domain-adaptive few-shot learning. Our solution is to explicitly enhance the source/target per-class separation before domain-adaptive feature embedding learning.
  arXiv  Detail & Related papers  (2020-03-19T08:31:14Z)
• Domain Adaptive Ensemble Learning [141.98192460069765]
  We propose a unified framework termed domain adaptive ensemble learning (DAEL) to address both problems. Experiments on three multi-source UDA and two DG datasets show that DAEL improves the state of the art on both problems, often by significant margins.
  arXiv  Detail & Related papers  (2020-03-16T16:54:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.