Collaborating Domain-shared and Target-specific Feature Clustering for Cross-domain 3D Action Recognition

• URL: http://arxiv.org/abs/2207.09767v1
• Date: Wed, 20 Jul 2022 09:18:57 GMT
• Title: Collaborating Domain-shared and Target-specific Feature Clustering for Cross-domain 3D Action Recognition
• Authors: Qinying Liu, Zilei Wang
• Abstract summary: This paper presents a novel approach dubbed CoDT to collaboratively cluster the domain-shared features and target-specific features. We propose an online clustering algorithm that enables simultaneous promotion of robust pseudo label generation and feature clustering. We conduct extensive experiments on multiple cross-domain 3D action recognition datasets, and the results demonstrate the effectiveness of our method.
• Score: 32.430703190988375
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work, we consider the problem of cross-domain 3D action recognition in the open-set setting, which has been rarely explored before. Specifically, there is a source domain and a target domain that contain the skeleton sequences with different styles and categories, and our purpose is to cluster the target data by utilizing the labeled source data and unlabeled target data. For such a challenging task, this paper presents a novel approach dubbed CoDT to collaboratively cluster the domain-shared features and target-specific features. CoDT consists of two parallel branches. One branch aims to learn domain-shared features with supervised learning in the source domain, while the other is to learn target-specific features using contrastive learning in the target domain. To cluster the features, we propose an online clustering algorithm that enables simultaneous promotion of robust pseudo label generation and feature clustering. Furthermore, to leverage the complementarity of domain-shared features and target-specific features, we propose a novel collaborative clustering strategy to enforce pair-wise relationship consistency between the two branches. We conduct extensive experiments on multiple cross-domain 3D action recognition datasets, and the results demonstrate the effectiveness of our method.

Related papers

• CDAD-Net: Bridging Domain Gaps in Generalized Category Discovery [9.505699498746976]
  Generalized Category Discovery (GCD) is a tool to cluster unlabeled samples of known and novel classes. We present Across Domain Generalized Category Discovery (AD-GCD) and bring forth CDAD-NET as a remedy. CDAD-NET is architected to synchronize potential known class samples across both the labeled (source) and unlabeled (target) datasets. Experimentally, CDAD-NET eclipses existing literature with a performance increment of 8-15% on three AD-GCD benchmarks we present.
  arXiv  Detail & Related papers  (2024-04-08T10:05:24Z)
• Adaptive Betweenness Clustering for Semi-Supervised Domain Adaptation [108.40945109477886]
  We propose a novel SSDA approach named Graph-based Adaptive Betweenness Clustering (G-ABC) for achieving categorical domain alignment. Our method outperforms previous state-of-the-art SSDA approaches, demonstrating the superiority of the proposed G-ABC algorithm.
  arXiv  Detail & Related papers  (2024-01-21T09:57:56Z)
• Unsupervised Domain Adaptation via Distilled Discriminative Clustering [45.39542287480395]
  We re-cast the domain adaptation problem as discriminative clustering of target data. We propose to jointly train the network using parallel, supervised learning objectives over labeled source data. We conduct careful ablation studies and extensive experiments on five popular benchmark datasets.
  arXiv  Detail & Related papers  (2023-02-23T13:03:48Z)
• Multi-Modal Cross-Domain Alignment Network for Video Moment Retrieval [55.122020263319634]
  Video moment retrieval (VMR) aims to localize the target moment from an untrimmed video according to a given language query. In this paper, we focus on a novel task: cross-domain VMR, where fully-annotated datasets are available in one domain but the domain of interest only contains unannotated datasets. We propose a novel Multi-Modal Cross-Domain Alignment network to transfer the annotation knowledge from the source domain to the target domain.
  arXiv  Detail & Related papers  (2022-09-23T12:58:20Z)
• Unsupervised Domain Adaptation for Point Cloud Semantic Segmentation via Graph Matching [14.876681993079062]
  We propose a graph-based framework to explore the local-level feature alignment between the two domains. We also formulate a category-guided contrastive loss to guide the segmentation model to learn discriminative features on the target domain.
  arXiv  Detail & Related papers  (2022-08-09T02:30:15Z)
• Domain Attention Consistency for Multi-Source Domain Adaptation [100.25573559447551]
  Key design is a feature channel attention module, which aims to identify transferable features (attributes) Experiments on three MSDA benchmarks show that our DAC-Net achieves new state of the art performance on all of them.
  arXiv  Detail & Related papers  (2021-11-06T15:56:53Z)
• Curriculum Graph Co-Teaching for Multi-Target Domain Adaptation [78.28390172958643]
  We identify two key aspects that can help to alleviate multiple domain-shifts in the multi-target domain adaptation (MTDA) We propose Curriculum Graph Co-Teaching (CGCT) that uses a dual classifier head, with one of them being a graph convolutional network (GCN) which aggregates features from similar samples across the domains. When the domain labels are available, we propose Domain-aware Curriculum Learning (DCL), a sequential adaptation strategy that first adapts on the easier target domains, followed by the harder ones.
  arXiv  Detail & Related papers  (2021-04-01T23:41:41Z)
• Discriminative Cross-Domain Feature Learning for Partial Domain Adaptation [70.45936509510528]
  Partial domain adaptation aims to adapt knowledge from a larger and more diverse source domain to a smaller target domain with less number of classes. Recent practice on domain adaptation manages to extract effective features by incorporating the pseudo labels for the target domain. It is essential to align target data with only a small set of source data.
  arXiv  Detail & Related papers  (2020-08-26T03:18:53Z)
• Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID [55.21702895051287]
  Domain adaptive object re-ID aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. We propose a novel self-paced contrastive learning framework with hybrid memory. Our method outperforms state-of-the-arts on multiple domain adaptation tasks of object re-ID.
  arXiv  Detail & Related papers  (2020-06-04T09:12:44Z)
• Class Conditional Alignment for Partial Domain Adaptation [10.506584969668792]
  Adrial adaptation models have demonstrated significant progress towards transferring knowledge from a labeled source dataset to an unlabeled target dataset. PDA investigates the scenarios in which the source domain is large and diverse, and the target label space is a subset of the source label space. We propose a multi-class adversarial architecture for PDA.
  arXiv  Detail & Related papers  (2020-03-14T23:51:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.