Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrieval

• URL: http://arxiv.org/abs/2604.03653v1
• Date: Sat, 04 Apr 2026 09:05:14 GMT
• Title: Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrieval
• Abstract summary: Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos based on text queries that describe only partial events.<n>We propose DreamPRVR, which adopts a coarse-to-fine representation learning paradigm.
• Score: 74.31577742865488
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos based on text queries that describe only partial events. Existing methods suffer from incomplete global contextual perception, struggling with query ambiguity and local noise induced by spurious responses. To address these issues, we propose DreamPRVR, which adopts a coarse-to-fine representation learning paradigm. The model first generates global contextual semantic registers as coarse-grained highlights spanning the entire video and then concentrates on fine-grained similarity optimization for precise cross-modal matching. Concretely, these registers are generated by initializing from the video-centric distribution produced by a probabilistic variational sampler and then iteratively refined via a text-supervised truncated diffusion model. During this process, textual semantic structure learning constructs a well-formed textual latent space, enhancing the reliability of global perception. The registers are then adaptively fused with video tokens through register-augmented Gaussian attention blocks, enabling context-aware feature learning. Extensive experiments show that DreamPRVR outperforms state-of-the-art methods. Code is released at https://github.com/lijun2005/CVPR26-DreamPRVR.

Related papers

• Mitigating Semantic Collapse in Partially Relevant Video Retrieval [41.715994314208025]
  Partially Relevant Video Retrieval seeks videos where only part of the content matches a text query.<n>Existing methods treat every annotated text-video pair as a positive and all others as negatives.<n>This paper addresses the aforementioned problems, termed as semantic collapse, in both the text and video embedding spaces.
  arXiv  Detail & Related papers  (2025-10-31T12:39:20Z)
• Enhancing Partially Relevant Video Retrieval with Robust Alignment Learning [29.427720184101474]
  Partially Relevant Video Retrieval aims to retrieve videos partially relevant to a given query.<n>The core challenge lies in learning robust query-video alignment against spurious semantic correlations.<n>We propose Robust Alignment Learning framework, which explicitly models the uncertainty in data.
  arXiv  Detail & Related papers  (2025-09-01T11:30:43Z)
• Denoise-then-Retrieve: Text-Conditioned Video Denoising for Video Moment Retrieval [21.98012334983341]
  Current text-driven Video Moment Retrieval (VMR) methods encode all video clips, including irrelevant ones, disrupting multimodal alignment and hindering optimization.<n>We propose a denoise-then-retrieve paradigm that explicitly filters text-irrelevant clips from videos and then retrieves the target moment using purified multimodal representations.
  arXiv  Detail & Related papers  (2025-08-15T08:34:05Z)
• Implicit Counterfactual Learning for Audio-Visual Segmentation [50.69377287012591]
  We propose the implicit counterfactual framework (ICF) to achieve unbiased cross-modal understanding.<n>Due to the lack of semantics, heterogeneous representations may lead to erroneous matches.<n>We introduce the multi-granularity implicit text (MIT) involving video-, segment- and frame-level as the bridge to establish the modality-shared space.
  arXiv  Detail & Related papers  (2025-07-28T11:46:35Z)
• Ambiguity-Restrained Text-Video Representation Learning for Partially Relevant Video Retrieval [0.0]
  Partially Relevant Video Retrieval(PRVR) aims to retrieve a video where a specific segment is relevant to a given text query.<n>We point out the inherent ambiguity between text and video content based on their conceptual scope.<n>We propose a framework that incorporates this ambiguity into the model learning process.
  arXiv  Detail & Related papers  (2025-06-09T06:44:45Z)
• Text-Video Retrieval with Global-Local Semantic Consistent Learning [122.15339128463715]
  We propose a simple yet effective method, Global-Local Semantic Consistent Learning (GLSCL) GLSCL capitalizes on latent shared semantics across modalities for text-video retrieval. Our method achieves comparable performance with SOTA as well as being nearly 220 times faster in terms of computational cost.
  arXiv  Detail & Related papers  (2024-05-21T11:59:36Z)
• Generative Video Diffusion for Unseen Novel Semantic Video Moment Retrieval [54.22321767540878]
  Video moment retrieval (VMR) aims to locate the most likely video moment corresponding to a text query in untrimmed videos.<n>Training of existing methods is limited by the lack of diverse and generalisable VMR datasets.<n>We propose a Fine-grained Video Editing framework, termed FVE, that explores generative video diffusion.
  arXiv  Detail & Related papers  (2024-01-24T09:45:40Z)
• GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrieval [59.47258928867802]
  Given a text query, partially relevant video retrieval (PRVR) seeks to find videos containing pertinent moments in a database. This paper proposes GMMFormer, a Gaussian-Mixture-Model based Transformer which models clip representations implicitly. Experiments on three large-scale video datasets demonstrate the superiority and efficiency of GMMFormer.
  arXiv  Detail & Related papers  (2023-10-08T15:04:50Z)
• UATVR: Uncertainty-Adaptive Text-Video Retrieval [90.8952122146241]
  A common practice is to transfer text-video pairs to the same embedding space and craft cross-modal interactions with certain entities. We propose an Uncertainty-language Text-Video Retrieval approach, termed UATVR, which models each look-up as a distribution matching procedure.
  arXiv  Detail & Related papers  (2023-01-16T08:43:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.