Diverse Deep Feature Ensemble Learning for Omni-Domain Generalized Person Re-identification

• URL: http://arxiv.org/abs/2410.08460v1
• Date: Fri, 11 Oct 2024 02:27:11 GMT
• Title: Diverse Deep Feature Ensemble Learning for Omni-Domain Generalized Person Re-identification
• Authors: Eugene P. W. Ang, Shan Lin, Alex C. Kot,
• Abstract summary: Person ReID methods experience a significant drop in performance when trained and tested across different datasets. Our research reveals that domain generalization methods significantly underperform single-domain supervised methods on single dataset benchmarks. We propose a way to achieve ODG-ReID by creating deep feature diversity with self-ensembles.
• Score: 30.208890289394994
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Person Re-identification (Person ReID) has progressed to a level where single-domain supervised Person ReID performance has saturated. However, such methods experience a significant drop in performance when trained and tested across different datasets, motivating the development of domain generalization techniques. However, our research reveals that domain generalization methods significantly underperform single-domain supervised methods on single dataset benchmarks. An ideal Person ReID method should be effective regardless of the number of domains involved, and when test domain data is available for training it should perform as well as state-of-the-art (SOTA) fully supervised methods. This is a paradigm that we call Omni-Domain Generalization Person ReID (ODG-ReID). We propose a way to achieve ODG-ReID by creating deep feature diversity with self-ensembles. Our method, Diverse Deep Feature Ensemble Learning (D2FEL), deploys unique instance normalization patterns that generate multiple diverse views and recombines these views into a compact encoding. To the best of our knowledge, our work is one of few to consider omni-domain generalization in Person ReID, and we advance the study of applying feature ensembles in Person ReID. D2FEL significantly improves and matches the SOTA performance for major domain generalization and single-domain supervised benchmarks.

Related papers

• Aligned Divergent Pathways for Omni-Domain Generalized Person Re-Identification [30.208890289394994]
  Person ReID has advanced significantly in fully supervised and domain generalized Person R e ID. We propose a paradigm Omni-Domain Generalization Person ReID, referred to as ODG-ReID. Our method converts a base architecture into a multi-branch structure by copying the tail of the original backbone.
  arXiv  Detail & Related papers  (2024-10-11T02:36:11Z)
• A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identification [30.208890289394994]
  This work focuses on the more practical Domain Generalized Person Re-identification (DG-ReID) problem. One promising research direction in DG-ReID is the use of implicit deep semantic feature expansion. We show that DEX and other similar implicit deep semantic feature expansion methods fail to reach their full potential on large evaluation benchmarks. We propose Unified Deep Semantic Expansion, our novel framework that unifies implicit and explicit semantic feature expansion techniques.
  arXiv  Detail & Related papers  (2024-10-11T02:15:15Z)
• NormAUG: Normalization-guided Augmentation for Domain Generalization [60.159546669021346]
  We propose a simple yet effective method called NormAUG (Normalization-guided Augmentation) for deep learning. Our method introduces diverse information at the feature level and improves the generalization of the main path. In the test stage, we leverage an ensemble strategy to combine the predictions from the auxiliary path of our model, further boosting performance.
  arXiv  Detail & Related papers  (2023-07-25T13:35:45Z)
• Generalizable Metric Network for Cross-domain Person Re-identification [55.71632958027289]
  Cross-domain (i.e., domain generalization) scene presents a challenge in Re-ID tasks. Most existing methods aim to learn domain-invariant or robust features for all domains. We propose a Generalizable Metric Network (GMN) to explore sample similarity in the sample-pair space.
  arXiv  Detail & Related papers  (2023-06-21T03:05:25Z)
• Deep Multimodal Fusion for Generalizable Person Re-identification [15.250738959921872]
  DMF is a Deep Multimodal Fusion network for the general scenarios on person re-identification task. Rich semantic knowledge is introduced to assist in feature representation learning during the pre-training stage. A realistic dataset is adopted to fine-tine the pre-trained model for distribution alignment with real-world.
  arXiv  Detail & Related papers  (2022-11-02T07:42:48Z)
• Unsupervised Domain Generalization for Person Re-identification: A Domain-specific Adaptive Framework [50.88463458896428]
  Domain generalization (DG) has attracted much attention in person re-identification (ReID) recently. Existing methods usually need the source domains to be labeled, which could be a significant burden for practical ReID tasks. We propose a simple and efficient domain-specific adaptive framework, and realize it with an adaptive normalization module.
  arXiv  Detail & Related papers  (2021-11-30T02:35:51Z)
• Unsupervised Domain Adaptive Learning via Synthetic Data for Person Re-identification [101.1886788396803]
  Person re-identification (re-ID) has gained more and more attention due to its widespread applications in video surveillance. Unfortunately, the mainstream deep learning methods still need a large quantity of labeled data to train models. In this paper, we develop a data collector to automatically generate synthetic re-ID samples in a computer game, and construct a data labeler to simultaneously annotate them.
  arXiv  Detail & Related papers  (2021-09-12T15:51:41Z)
• Semi-Supervised Domain Generalizable Person Re-Identification [74.75528879336576]
  Existing person re-identification (re-id) methods are stuck when deployed to a new unseen scenario. Recent efforts have been devoted to domain adaptive person re-id where extensive unlabeled data in the new scenario are utilized in a transductive learning manner. We aim to explore multiple labeled datasets to learn generalized domain-invariant representations for person re-id.
  arXiv  Detail & Related papers  (2021-08-11T06:08:25Z)
• Multi-Domain Adversarial Feature Generalization for Person Re-Identification [52.835955258959785]
  We propose a multi-dataset feature generalization network (MMFA-AAE) It is capable of learning a universal domain-invariant feature representation from multiple labeled datasets and generalizing it to unseen' camera systems. It also surpasses many state-of-the-art supervised methods and unsupervised domain adaptation methods by a large margin.
  arXiv  Detail & Related papers  (2020-11-25T08:03:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.