Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval
- URL: http://arxiv.org/abs/2609.08999v1
- Date: Tue, 08 Sep 2026 16:37:35 GMT
- Title: Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval
- Abstract summary: Partially Relevant Video Retrieval retrieves untrimmed videos when queries describe only short moments.<n>We propose TRACE, a score-level evidence verification operator for PRVR.<n>On ActivityNet Captions, Charades-STA, and TVR, TRACE achieves the best SumR on all three benchmarks.
- Score: 27.64333612353748
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Partially Relevant Video Retrieval (PRVR) retrieves untrimmed videos when queries describe only short moments. Although recent methods improve local representations, uncertainty modeling, and global context, final ranking often still trusts the strongest local response; a coincidentally similar fragment can therefore produce an unsupported peak. We identify this failure as the query-agnostic concentration bottleneck and propose TRACE, a score-level evidence verification operator for PRVR. Given a query and global video registers, TRACE activates query-relevant registers, routes their support to frame-level evidence, and smoothly marginalizes alternative query-to-register-to-frame paths before localized temporal selection. Unlike representation-level feature fusion, TRACE uses this evidence only as a query-conditioned residual calibration of the original local score. On ActivityNet Captions, Charades-STA, and TVR, TRACE achieves the best SumR on all three benchmarks and improves the DreamPRVR backbone by 1.2, 1.1, and 1.5 points, respectively. Ablation, routing-corruption, hard-negative, and cross-backbone transfer analyses support the interpretation that the gains arise from query-conditioned evidence verification rather than a generic score offset.
Related papers
- Multi-Agent Self-Improving Reinforcement Learning for Video Reasoning [45.361080098317665]
Video reasoning tasks such as grounded video question answering and temporal grounding require selecting temporal evidence that supports the query.<n>We study whether a frozen verifier can also guide training.<n>Our framework couples a trainable emphGrounder with a frozen emphVerifier: the Grounder samples candidate trajectories and evidence segments.
arXiv Detail & Related papers (2026-08-25T07:46:32Z) - R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking [73.0537447183962]
We present a zero-shot composed video retrieval pipeline built around Reasoning-guided Recalling and Reranking.<n>The model generates a reasoning trace that describes the expected target video after applying the edit.<n>Experiments have demonstrated the effectiveness of our method in addressing this challenge.
arXiv Detail & Related papers (2026-05-31T09:20:53Z) - Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language [60.91064560080974]
We propose an efficient approach, SpotVMR, to trim the query-relevant clip.<n>Our proposed SpotVMR can serve as plug-and-play module, which achieves efficiency for state-of-the-art VMR methods.
arXiv Detail & Related papers (2026-05-28T11:42:28Z) - Lost in the Evidence? Reproducing Document Position and Context Size Effects in RAG [3.597778914286147]
Retrieval-Augmented Generation (RAG) systems rely on retrieved documents being input to a model's input context.<n>Prior work reports position-based effects such as lost in the middle and related long-context phenomena.<n>We show that topic sampling is a major source of variance: small topic sets can exaggerate ordering effects.<n>We also study a more realistic RAG scenario in which relevance is mediated by a retriever rather than oracle access to ground-truth documents.
arXiv Detail & Related papers (2026-05-26T14:44:19Z) - FRESCO: Benchmarking and Optimizing Re-rankers for Evolving Semantic Conflict in Retrieval-Augmented Generation [73.22935457705057]
We introduce FRESCO, a benchmark for evaluating re-rankers in temporally dynamic contexts.<n>By pairing recency-seeking queries with historical Wikipedia revisions, FRESCO tests whether re-rankers can prioritize factually recent evidence while maintaining semantic relevance.<n>Our evaluation reveals a consistent failure mode across existing re-rankers: a strong bias toward older, semantically rich documents, even when they are factually obsolete.
arXiv Detail & Related papers (2026-04-14T17:04:25Z) - Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shifts [28.52079785516312]
Video-text retrieval (VTR) models are highly vulnerable to real-world query shifts.<n>We propose HAT-VTR (Hubness Alleviation for Test-time Video-Text Retrieval), as our baseline test-time adaptation framework.<n>Extensive experiments demonstrate that HAT-VTR substantially improves robustness, consistently outperforming methods across diverse query shift scenarios.
arXiv Detail & Related papers (2026-02-15T05:57:44Z) - RANKVIDEO: Reasoning Reranking for Text-to-Video Retrieval [99.33724613432922]
We introduce RANKVIDEO, a reasoning-based reranker for video retrieval.<n>RANKVIDEO explicitly reasons over query-video pairs using video content to assess relevance.<n> Experiments on the large-scale MultiVENT 2.0 benchmark demonstrate that RANKVIDEO consistently improves retrieval performance within a two-stage framework.
arXiv Detail & Related papers (2026-02-02T18:40:37Z) - Sim-DETR: Unlock DETR for Temporal Sentence Grounding [104.78823923373784]
Temporal sentence grounding aims to identify exact moments in a video that correspond to a given textual query.<n>We find that typical strategies designed to enhance DETR do not improve, and may even degrade, its performance in this task.<n>We propose Sim-DETR, which extends the standard DETR with two minor modifications.
arXiv Detail & Related papers (2025-09-28T13:21:10Z) - Ranking Free RAG: Replacing Re-ranking with Selection in RAG for Sensitive Domains [13.58151841630302]
We propose a novel method METEORA that replaces re-ranking in RAG with a rationale-driven selection approach.<n>We show METEORA improves generation accuracy by 33.34% while using approximately 50% fewer chunks than state-of-the-art re-ranking methods.<n>In adversarial settings, METEORA significantly improves the F1 score from 0.10 to 0.44.
arXiv Detail & Related papers (2025-05-21T20:57:16Z) - Query-Dependent Video Representation for Moment Retrieval and Highlight
Detection [8.74967598360817]
Key objective of MR/HD is to localize the moment and estimate clip-wise accordance level, i.e., saliency score, to a given text query.
Recent transformer-based models do not fully exploit the information of a given query.
We introduce Query-Dependent DETR (QD-DETR), a detection transformer tailored for MR/HD.
arXiv Detail & Related papers (2023-03-24T09:32:50Z) - A Closer Look at Debiased Temporal Sentence Grounding in Videos:
Dataset, Metric, and Approach [53.727460222955266]
Temporal Sentence Grounding in Videos (TSGV) aims to ground a natural language sentence in an untrimmed video.
Recent studies have found that current benchmark datasets may have obvious moment annotation biases.
We introduce a new evaluation metric "dR@n,IoU@m" that discounts the basic recall scores to alleviate the inflating evaluation caused by biased datasets.
arXiv Detail & Related papers (2022-03-10T08:58:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.