EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence

• URL: http://arxiv.org/abs/2606.24797v1
• Date: Tue, 23 Jun 2026 16:49:28 GMT
• Title: EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence
• Abstract summary: This paper introduces the Evidence-Grounded Video Question Answering Benchmark (EG-VQA)<n> EG-VQA is comprised of 2,067 videos and 11,838 QA pairs with fine-grained evidence annotations.<n>We show that even strong proprietary models struggle to accurately ground their predictions.<n>We propose EG-Reasoner, an evidence-grounded reasoning model trained with explicit supervision.
• Score: 48.314554375516366
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advances in Video Large Language Models (Video-LLMs) have yielded promising performance on video question answering (VideoQA). Nevertheless, existing benchmarks are predominantly evaluated through answer correctness, while the grounding of predictions in relevant video evidence remains largely unexamined. This disconnect between answer generation and evidence understanding motivates the construction of the Evidence-Grounded Video Question Answering Benchmark (EG-VQA), an open-ended evaluation protocol in which each QA pair is explicitly annotated with supporting temporal evidence, thereby requiring joint reasoning and precise evidence localization. EG-VQA is comprised of 2,067 videos and 11,838 QA pairs with fine-grained evidence annotations. To evaluate predicted evidence, Evidence-Grounded F1 (EG-F1) is introduced as a unified metric in which temporal alignment and semantic consistency against ground-truth evidence are jointly measured. Experimental evaluation reveals that even strong proprietary models struggle to accurately ground their predictions, exposing a fundamental discrepancy between answer correctness and faithful evidence localization. To bridge this gap, EG-Reasoner, an evidence-grounded reasoning model trained with explicit supervision, is proposed. State-of-the-art performance is achieved among open-source models, with results competitive against proprietary systems, particularly pronounced gains are observed on reasoning-intensive tasks such as counterfactual questions. These findings demonstrate that scaling alone is insufficient for robust video understanding and that structured evidence supervision is essential for the development of more reliable and interpretable VideoQA systems.

Related papers

• Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation [28.999694748110404]
  We show that off-the-shelf fact-checking systems rely more on their parametric knowledge than on the evidence provided.<n>We propose REAL (Rigorous Evidence Ablation Learning), a training framework that promotes evidence-dependent verification.<n>Our findings highlight that strong fact-checking performance can still coexist with weak evidence dependency.
  arXiv  Detail & Related papers  (2026-09-08T16:04:20Z)
• Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos [50.28847179290796]
  PACE is a factor-guided framework for long-video evidence acquisition.<n>On MMR-V with the open-source Qwen3-VL backbone, PACE achieves 42.6% accuracy.
  arXiv  Detail & Related papers  (2026-08-26T19:38:17Z)
• HiEviDR-Bench: A Benchmark for Hierarchical Evidence Aggregation in Deep Research [52.87128503345243]
  We introduce HiEviDR-Bench, a benchmark for evaluating Hierarchical Evidence Aggregation in Deep Research.<n>HiEviDR-Bench represents each instance with an explicit evidence graph that captures evidence selection, cross-source linking, and aggregation.<n>We develop a traceability-oriented evaluation framework with five dimensions: report quality, evidence traceability, citation accuracy, claim verification, and answer correctness.
  arXiv  Detail & Related papers  (2026-07-27T23:50:46Z)
• Evidence-Backed Video Question Answering [90.93225758130426]
  Existing explainability efforts rely on textual rationales or sparse bounding boxes.<n>We propose Evidence-Backed Video Question Answering (E-VQA)<n>To support this, we introduce ST-Evidence, the first human-verified benchmark for both discriminative and generative pixel-level grounding.
  arXiv  Detail & Related papers  (2026-07-13T17:49:10Z)
• Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQA [16.471093160007587]
  VideoQA systems often rely on spurious statistical correlations rather than answer-relevant causal evidence.<n>Existing methods either rely on cross-modality correlations, costly curated training resources, or insufficient causal assumptions and constraints.<n>We propose a Counterfactual Reasoning framework for fine-grained Evidence Disentanglement (CREDiT)
  arXiv  Detail & Related papers  (2026-06-08T08:20:42Z)
• Foresee-to-Ground: From Predictive Temporal Perception to Evidence-Driven Reasoning for Video Temporal Grounding [86.37002814396674]
  We propose Foresee-to-Ground (F2G) for Video Temporal Grounding.<n>F2G integrates Predictive Temporal Perception with Evidence-Driven Reasoning.<n>It consistently improves grounding accuracy across diverse benchmarks.
  arXiv  Detail & Related papers  (2026-05-21T04:03:25Z)
• VISTAQA: Benchmarking Joint Visual Question Answering and Pixel-Level Evidence [26.0945130521806]
  Existing benchmarks assess either textual answer correctness or pixel-level localization in isolation.<n>We introduce VISTAQA, a benchmark for joint evaluation of free-form answer correctness and pixel-level evidence grounding in visual question answering.<n>We introduce GROVE, a metric that enforces joint correctness by combining textual accuracy and grounding quality via a per-sample geometric mean.
  arXiv  Detail & Related papers  (2026-05-20T03:44:06Z)
• VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification [73.02304272829785]
  VideoBench is a hierarchical benchmark for long-video answering that rigorously verifies evidence.<n>It comprises 500 manually annotated questions across 13 domains, paired with temporal intervals and spatial bounding boxes as evidence.<n>Experiments show that even GeminiPro-3-Pro correctly answers fewer than 17% of questions under the standard end-to-end QA setting.<n>Results expose a significant gap between surface-level answer correctness and genuine evidence-based reasoning.
  arXiv  Detail & Related papers  (2026-04-02T03:29:43Z)
• Stateful Evidence-Driven Retrieval-Augmented Generation with Iterative Reasoning [7.701766930531068]
  Stateful Evidence-Driven RAG with Iterative Reasoning is a framework that models question answering as a progressive evidence accumulation process.<n>The framework performs evidence-driven deficiency analysis to identify gaps and conflicts and iteratively refines queries to guide subsequent retrieval.<n> Experiments on multiple question answering benchmarks demonstrate consistent improvements over standard RAG and multi-step baselines.
  arXiv  Detail & Related papers  (2026-03-25T06:57:49Z)
• Process-of-Thought Reasoning for Videos [33.74677144833003]
  Process-of-Thought (PoT) Reasoning for Videos is a framework that makes the reasoning process explicit by structuring video inference into a sequence of lightweight, verifiable steps.<n>PoT interleaves (i) temporal evidence selection, (ii) step-wise state updates, and (iii) constrained answer synthesis, enabling the model to progressively refine hypotheses while maintaining traceability to video evidence.
  arXiv  Detail & Related papers  (2026-02-07T20:25:46Z)
• Video Evidence to Reasoning Efficient Video Understanding via Explicit Evidence Grounding [1.4582793306013615]
  Chain of Evidence (CoE) is a novel framework that architecturally decouples and co-optimizes grounding and reasoning efficiency.<n>CoE incorporates two core innovations: (1) A lightweight Evidence Grounding Module (EGM) that acts as a query-guided filter, dynamically identifying and extracting a compact set of high-fidelity visual evidence; and (2) An Evidence-Anchoring Protocol optimized via Reinforcement Learning.
  arXiv  Detail & Related papers  (2026-01-12T17:46:10Z)
• Look As You Think: Unifying Reasoning and Visual Evidence Attribution for Verifiable Document RAG via Reinforcement Learning [55.232400251303794]
  Look As You Think (LAT) is a reinforcement learning framework that trains models to produce verifiable reasoning paths with consistent attribution.<n>LAT consistently improves the vanilla model in both single- and multi-image settings, yielding average gains of 8.23% in soft exact match (EM) and 47.0% in IoU@0.5.
  arXiv  Detail & Related papers  (2025-11-15T02:50:23Z)
• VITED: Video Temporal Evidence Distillation [49.38292490256531]
  We investigate complex video question answering via chain-of-evidence reasoning.<n>Models struggle with multi-step reasoning as they uniformly sample a fixed number of frames.<n>We propose a framework to enhance existing VideoQA datasets with evidence reasoning chains.
  arXiv  Detail & Related papers  (2025-03-17T06:30:02Z)
• Can I Trust Your Answer? Visually Grounded Video Question Answering [88.11169242115416]
  We study visually grounded VideoQA in response to the emerging trends of utilizing pretraining techniques for video-language understanding. We construct NExT-GQA -- an extension of NExT-QA with 10.5$K$ temporal grounding labels tied to the original QA pairs.
  arXiv  Detail & Related papers  (2023-09-04T03:06:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.