Beyond Visual Cues: Semantic-Driven Token Filtering and Expert Routing for Anytime Person ReID

• URL: http://arxiv.org/abs/2604.15090v1
• Date: Thu, 16 Apr 2026 14:49:30 GMT
• Title: Beyond Visual Cues: Semantic-Driven Token Filtering and Expert Routing for Anytime Person ReID
• Abstract summary: Any-Time Person Re-identification (AT-ReID) necessitates the robust retrieval of target individuals under arbitrary conditions.<n>Existing methods are highly relying on pure visual features, which are prone to change due to environmental and time factors.<n>We propose a novel framework that leverages the ability of Large Vision-Language Models (LVLMs) to generate identity consistency text.
• Score: 10.58405139566836
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Any-Time Person Re-identification (AT-ReID) necessitates the robust retrieval of target individuals under arbitrary conditions, encompassing both modality shifts (daytime and nighttime) and extensive clothing-change scenarios, ranging from short-term to long-term intervals. However, existing methods are highly relying on pure visual features, which are prone to change due to environmental and time factors, resulting in significantly performance deterioration under scenarios involving illumination caused modality shifts or cloth-change. In this paper, we propose Semantic-driven Token Filtering and Expert Routing (STFER), a novel framework that leverages the ability of Large Vision-Language Models (LVLMs) to generate identity consistency text, which provides identity-discriminative features that are robust to both clothing variations and cross-modality shifts between RGB and IR. Specifically, we employ instructions to guide the LVLM in generating identity-intrinsic semantic text that captures biometric constants for the semantic model driven. The text token is further used for Semantic-driven Visual Token Filtering (SVTF), which enhances informative visual regions and suppresses redundant background noise. Meanwhile, the text token is also used for Semantic-driven Expert Routing (SER), which integrates the semantic text into expert routing, resulting in more robust multi-scenario gating. Extensive experiments on the Any-Time ReID dataset (AT-USTC) demonstrate that our model achieves state-of-the-art results. Moreover, the model trained on AT-USTC was evaluated across 5 widely-used ReID benchmarks demonstrating superior generalization capabilities with highly competitive results. Our code will be available soon.

Related papers

• SAGE: Variate-Wise Semantic Augmentation for Vision-Language Time Series Forecasting [6.3330628137530605]
  Time series forecasting models operate on raw numerical sequences, lacking the semantic knowledge that domain experts implicitly leverage.<n>We propose SAGE, an end-to-end CLIP-based framework that jointly models temporal, cross-variable, textual, and visual information.
  arXiv  Detail & Related papers  (2026-08-27T09:04:45Z)
• Latent Visual States for Efficient Multimodal Reasoning [58.350643620457]
  EVA (LatEnt Visual StAtes) is a novel framework that generates continuous latent visual representations.<n>These internal representations manifest as an adaptive sequence of Latent_slot tokens.<n> EVA achieves significant performance gains while enhancing inference efficiency.
  arXiv  Detail & Related papers  (2026-06-23T07:22:22Z)
• Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory [79.01059178883817]
  IAMFlow is a training-free identity-aware memory framework that explicitly models and tracks persistent entity identities.<n>A VLM asynchronously verifies and refines attributes from rendered frames, enabling explicit entity tracking in place of implicit similarity-based matching.<n>NarraStream-Bench is a benchmark for narrative streaming video generation that features 324 multi-prompt scripts spanning six dimensions.
  arXiv  Detail & Related papers  (2026-05-18T17:54:34Z)
• RAGTrack: Language-aware RGBT Tracking with Retrieval-Augmented Generation [71.2136732268131]
  RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions.<n>Existing RGBT trackers rely solely on initial-frame visual information for target modeling.<n>We propose RAGTrack, a novel Retrieval-Augmented Generation framework for robust RGBT tracking.
  arXiv  Detail & Related papers  (2026-03-04T01:02:04Z)
• When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Study [48.67151986743594]
  We revisit representation design for Semantic ID learning by treating text as a visual signal.<n>We conduct a systematic empirical study of OCR-based text representations, obtained by rendering item descriptions into images.<n>We find that OCR-text consistently matches or surpasses standard text embeddings for Semantic ID learning in both unimodal and multimodal settings.
  arXiv  Detail & Related papers  (2026-01-21T06:18:57Z)
• Hierarchical Prompt Learning for Image- and Text-Based Person Re-Identification [25.3625307168105]
  Person re-identification (ReID) aims to retrieve target pedestrian images given either visual queries (image-to-image, I2I) or textual descriptions (text-to-image, T2I)
  arXiv  Detail & Related papers  (2025-11-17T16:39:49Z)
• IndexNet: Timestamp and Variable-Aware Modeling for Time Series Forecasting [35.17464235813366]
  IndexNet is a vectors-based augmented framework with an Index Embedding (IE) module.<n>IE transforms timestamps into embedding and injects them into the input sequence, thereby improving the model's ability to capture long-term complex periodic patterns.<n>In parallel, CE assigns each variable a unique and trainable identity embedding based on its index, allowing the model to explicitly distinguish between heterogeneous variables.
  arXiv  Detail & Related papers  (2025-09-28T11:30:17Z)
• Vision-Free Retrieval: Rethinking Multimodal Search with Textual Scene Descriptions [81.33113485830711]
  We introduce a vision-free, single-encoder retrieval pipeline for vision-language models.<n>We migrate to a text-to-text paradigm with the assistance of VLLM-generated structured image descriptions.<n>Our approach achieves state-of-the-art zero-shot performance on multiple retrieval and compositionality benchmarks.
  arXiv  Detail & Related papers  (2025-09-23T16:22:27Z)
• What Makes You Unique? Attribute Prompt Composition for Object Re-Identification [70.67907354506278]
  Object Re-IDentification aims to recognize individuals across non-overlapping camera views.<n>Single-domain models tend to overfit to domain-specific features, whereas cross-domain models often rely on diverse normalization strategies.<n>We propose an Attribute Prompt Composition framework, which exploits textual semantics to jointly enhance discrimination and generalization.
  arXiv  Detail & Related papers  (2025-09-23T07:03:08Z)
• From Values to Tokens: An LLM-Driven Framework for Context-aware Time Series Forecasting via Symbolic Discretization [21.8427780153806]
  Time series forecasting plays a vital role in supporting decision-making across a wide range of critical applications, including energy, healthcare, and finance.<n>We propose TokenCast, an LLM-driven framework that leverages language-based symbolic representations as a unified intermediary for context-aware time series forecasting.<n>Specifically, TokenCast employs a discrete tokenizer to transform continuous numerical sequences into temporal tokens, enabling structural alignment with language-based inputs.
  arXiv  Detail & Related papers  (2025-08-08T03:51:08Z)
• Towards Text-Image Interleaved Retrieval [49.96332254241075]
  We introduce the text-image interleaved retrieval (TIIR) task, where the query and document are interleaved text-image sequences.<n>We construct a TIIR benchmark based on naturally interleaved wikiHow tutorials, where a specific pipeline is designed to generate interleaved queries.<n>We propose a novel Matryoshka Multimodal Embedder (MME), which compresses the number of visual tokens at different granularity.
  arXiv  Detail & Related papers  (2025-02-18T12:00:47Z)
• See What You Seek: Semantic Contextual Integration for Cloth-Changing Person Re-Identification [14.01260112340177]
  Cloth-changing person re-identification (CC-ReID) aims to match individuals across surveillance cameras despite variations in clothing.<n>Existing methods typically mitigate the impact of clothing changes or enhance identity (ID)-relevant features.<n>We propose a novel prompt learning framework Semantic Contextual Integration (SCI) to reduce clothing-induced discrepancies and strengthen ID cues.
  arXiv  Detail & Related papers  (2024-12-02T10:11:16Z)
• Zero-Shot Video Moment Retrieval from Frozen Vision-Language Models [58.17315970207874]
  We propose a zero-shot method for adapting generalisable visual-textual priors from arbitrary VLM to facilitate moment-text alignment. Experiments conducted on three VMR benchmark datasets demonstrate the notable performance advantages of our zero-shot algorithm.
  arXiv  Detail & Related papers  (2023-09-01T13:06:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.