Homogeneous and Heterogeneous Consistency progressive Re-ranking for Visible-Infrared Person Re-identification

• URL: http://arxiv.org/abs/2603.16165v1
• Date: Tue, 17 Mar 2026 06:32:53 GMT
• Title: Homogeneous and Heterogeneous Consistency progressive Re-ranking for Visible-Infrared Person Re-identification
• Abstract summary: Visible-infrared person re-identification faces greater challenges than traditional person re-identification due to significant differences between modalities.<n>Existing re-ranking algorithms cannot simultaneously address the intra-modal variations and inter-modal discrepancy in cross-modal person re-identification.<n>We propose a novel Progressive Modal Relationship Re-ranking method consisting of two modules, called heterogeneous and homogeneous consistency re-ranking.
• Score: 5.004656285742371
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Visible-infrared person re-identification faces greater challenges than traditional person re-identification due to the significant differences between modalities. In particular, the differences between these modalities make effective matching even more challenging, mainly because existing re-ranking algorithms cannot simultaneously address the intra-modal variations and inter-modal discrepancy in cross-modal person re-identification. To address this problem, we propose a novel Progressive Modal Relationship Re-ranking method consisting of two modules, called heterogeneous and homogeneous consistency re-ranking(HHCR). The first module, heterogeneous consistency re-ranking, explores the relationship between the query and the gallery modalities in the test set. The second module, homogeneous consistency reranking, investigates the intrinsic relationship within each modality between the query and the gallery in the test set. Based on this, we propose a baseline for cross-modal person re-identification, called a consistency re-ranking inference network (CRI). We conducted comprehensive experiments demonstrating that our proposed re-ranking method is generalized, and both the re-ranking and the baseline achieve state-of-the-art performance.

Related papers

• Dual-Edged Homogeneous-Modality Similarity: Towards Visible-Infrared Modality-Incomplete Person Re-Identification with Modality Adaptive Matching [60.86381869046298]
  We formalize the Visible-Infrared Modality-Incomplete Re-Identification (VIMI-ReID) task.<n>The unpredictable modality combinations and inherent similarity of homogeneous-modality samples in VIMI-ReID cause a significant performance drop.<n>We propose the Modality Adaptive Matching Transformer (MAMT) to extract modality-specific and modality-shared features.
  arXiv  Detail & Related papers  (2026-07-21T04:10:20Z)
• Mind the Gap: Learning Modality-Agnostic Representations with a Cross-Modality UNet [21.513499794627165]
  Cross-modality recognition has many important applications in science, law enforcement and entertainment.<n>We propose a compact encoder-decoder neural module (cmUNet) to learn modality-agnostic representations while retaining identity-related information.<n>For cross-modality matching, we propose MarrNet where cmUNet is connected to a standard feature extraction network which takes as inputs the modality-agnostic representations and outputs similarity scores for matching.
  arXiv  Detail & Related papers  (2026-05-16T09:00:54Z)
• Thinking Before Matching: A Reinforcement Reasoning Paradigm Towards General Person Re-Identification [77.51622646061314]
  ReID-R is proposed as a novel reasoning-driven paradigm that achieves explicit identity understanding and reasoning.<n>Experiments on multiple ReID benchmarks demonstrate that ReID-R achieves competitive identity discrimination as superior methods.
  arXiv  Detail & Related papers  (2026-04-21T08:24:07Z)
• CMCC-ReID: Cross-Modality Clothing-Change Person Re-Identification [50.132682245344284]
  Cross-Modality Clothing-Change Re-Identification (CMCC-ReID) targets pedestrian matching across variations in both modality and clothing.<n>We propose a Progressive Identity Alignment Network (PIA) that progressively mitigates the issues of clothing variation and modality discrepancy.<n> PIA establishes a strong baseline for this new task and significantly outperforms existing methods.
  arXiv  Detail & Related papers  (2026-04-03T07:19:30Z)
• Search-R2: Enhancing Search-Integrated Reasoning via Actor-Refiner Collaboration [49.9937230730202]
  We propose Search-R2, a novel Actor-Refiner collaboration framework that enhances reasoning through targeted intervention.<n>Our approach decomposes the generation process into an Actor, which produces initial reasoning trajectories.<n>We show that Search-R2 consistently outperforms strong RAG and RL-based baselines across model scales.
  arXiv  Detail & Related papers  (2026-02-03T15:32:09Z)
• Dual-Granularity Cross-Modal Identity Association for Weakly-Supervised Text-to-Person Image Matching [7.1469465755934785]
  Weakly supervised text-to-person image matching is a crucial approach to reducing models' reliance on large-scale manually labeled samples.<n>We propose a dual-granularity identity association mechanism to predict complex one-to-many identity relationships.<n> Experimental results demonstrate that the proposed method substantially boosts cross-modal matching accuracy.
  arXiv  Detail & Related papers  (2025-07-09T10:59:13Z)
• Mix-Modality Person Re-Identification: A New and Practical Paradigm [20.01921944345468]
  We propose a new and more practical mix-modality retrieval paradigm.<n>Existing visible-infrared person re-identification (VI-ReID) methods have achieved some results in the bi-modality mutual retrieval paradigm.<n>This paper proposes a Mix-Modality person re-identification (MM-ReID) task, explores the influence of modality mixing ratio on performance, and constructs mix-modality test sets for existing datasets.
  arXiv  Detail & Related papers  (2024-12-06T02:19:57Z)
• Exploring Homogeneous and Heterogeneous Consistent Label Associations for Unsupervised Visible-Infrared Person ReID [57.500045584556794]
  We introduce a Modality-Unified Label Transfer (MULT) module that simultaneously accounts for both homogeneous and heterogeneous fine-grained instance-level structures.<n>The proposed MULT ensures that the generated pseudo-labels maintain alignment across modalities while upholding structural consistency within intra-modality.<n> Experiments demonstrate that our proposed method outperforms existing state-of-the-art USL-VI-ReID methods.
  arXiv  Detail & Related papers  (2024-02-01T15:33:17Z)
• Modality Unifying Network for Visible-Infrared Person Re-Identification [24.186989535051623]
  Visible-infrared person re-identification (VI-ReID) is a challenging task due to large cross-modality discrepancies and intra-class variations. Existing methods mainly focus on learning modality-shared representations by embedding different modalities into the same feature space. We propose a novel Modality Unifying Network (MUN) to explore a robust auxiliary modality for VI-ReID.
  arXiv  Detail & Related papers  (2023-09-12T14:22:22Z)
• Cross-Attention is Not Enough: Incongruity-Aware Dynamic Hierarchical Fusion for Multimodal Affect Recognition [69.32305810128994]
  Incongruity between modalities poses a challenge for multimodal fusion, especially in affect recognition. We propose the Hierarchical Crossmodal Transformer with Dynamic Modality Gating (HCT-DMG), a lightweight incongruity-aware model. HCT-DMG: 1) outperforms previous multimodal models with a reduced size of approximately 0.8M parameters; 2) recognizes hard samples where incongruity makes affect recognition difficult; 3) mitigates the incongruity at the latent level in crossmodal attention.
  arXiv  Detail & Related papers  (2023-05-23T01:24:15Z)
• Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification [84.32086702849338]
  We propose a novel modality-adaptive mixup and invariant decomposition (MID) approach for RGB-infrared person re-identification. MID designs a modality-adaptive mixup scheme to generate suitable mixed modality images between RGB and infrared images. Experiments on two challenging benchmarks demonstrate superior performance of MID over state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-03T14:26:49Z)
• Dual Gaussian-based Variational Subspace Disentanglement for Visible-Infrared Person Re-Identification [19.481092102536827]
  Visible-infrared person re-identification (VI-ReID) is a challenging and essential task in night-time intelligent surveillance systems. We present a dual Gaussian-based variational auto-encoder (DG-VAE) to disentangle an identity-discriminable and an identity-ambiguous cross-modality feature subspace. Our method outperforms state-of-the-art methods on two VI-ReID datasets.
  arXiv  Detail & Related papers  (2020-08-06T08:43:35Z)
• Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification [208.1227090864602]
  Visible-infrared person re-identification (VI-ReID) is a challenging cross-modality pedestrian retrieval problem. Existing VI-ReID methods tend to learn global representations, which have limited discriminability and weak robustness to noisy images. We propose a novel dynamic dual-attentive aggregation (DDAG) learning method by mining both intra-modality part-level and cross-modality graph-level contextual cues for VI-ReID.
  arXiv  Detail & Related papers  (2020-07-18T03:08:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.