Conformal Coverage Guarantees for Any Video Temporal Grounder

• URL: http://arxiv.org/abs/2608.07434v1
• Date: Fri, 07 Aug 2026 17:19:27 GMT
• Title: Conformal Coverage Guarantees for Any Video Temporal Grounder
• Abstract summary: Event boundaries in continuous video are ambiguous: re-annotate the same query-video pair and independent annotators mark moments that overlap by less than half on a large fraction of samples.<n> COVER changes the output object: a model-agnostic wrapper that turns any grounder, a trained localizer or a black-box video-language model.<n>Two score families, a two-sided boundary-widening score for grounders that emit an interval and a super-level-set score for grounders that emit a relevance signal.
• Score: 2.3982445219832678
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Event boundaries in continuous video are ambiguous: re-annotate the same query-video pair and independent annotators mark moments that overlap by less than half on a large fraction of samples. The ground truth for video temporal grounding is therefore a distribution over intervals, yet every grounder returns a single interval with no statement of reliability, so at deployment a wrong interval is indistinguishable from a right one. COVER changes the output object: a post-hoc, model-agnostic wrapper that turns any grounder, a trained localizer or a black-box video--language model, into one that emits a temporal region containing the true moment with probability at least $1-α$, by calibrating the quantile of a temporal nonconformity score on held-out labels and widening the base prediction by that amount. The guarantee is finite-sample and distribution-free under exchangeability, and requires neither retraining nor white-box access. We give two score families, a two-sided boundary-widening score for grounders that emit an interval and a super-level-set score for grounders that emit a relevance signal, and develop theory specific to grounding that bounds how large the certified region becomes, when coverage survives conditioning on event length, and how it degrades when moments from one video break exchangeability. Across three benchmarks and five grounders, realized coverage tracks the target, and calibration exposes what point metrics hide.

Related papers

• PERSIST: Persistent-State Discrimination for Shot Boundary Detection [2.2822910284300355]
  Shot boundary detection (SBD) is widely treated as the localisation of local visual discontinuities.<n>We reformulate SBD as boundary semantic discrimination.<n>PerSIST turns every decision into an inspectable one.
  arXiv  Detail & Related papers  (2026-08-29T14:23:00Z)
• Multi-Agent Self-Improving Reinforcement Learning for Video Reasoning [45.361080098317665]
  Video reasoning tasks such as grounded video question answering and temporal grounding require selecting temporal evidence that supports the query.<n>We study whether a frozen verifier can also guide training.<n>Our framework couples a trainable emphGrounder with a frozen emphVerifier: the Grounder samples candidate trajectories and evidence segments.
  arXiv  Detail & Related papers  (2026-08-25T07:46:32Z)
• The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeeping [70.07961857926377]
  We introduce trace-grounded parametric profiling for event counting in three controlled video tasks.<n>Across 2,190 videos, we vary event count N and frequency F while holding rendering fixed.<n>At an 80% reliability threshold, Gemini 3.6 Flash reliably counts persistent state transitions up to 12 events at 0.5 and 1.0 Hz, yet demonstrates no reliable positive-count region for transient blinking events.
  arXiv  Detail & Related papers  (2026-08-06T17:57:06Z)
• TimePLE: Rethinking Temporal Representation for Video Temporal Grounding [45.27333302368563]
  Video temporal grounding (VTG) aims to localize the continuous video interval described by a natural-language query.<n>We propose TimePLE, which reformulates VTG from endpoint prediction to interval-native grounding.<n> Experiments across four VTG benchmarks show that TimePLE consistently outperforms endpoint prediction baselines.
  arXiv  Detail & Related papers  (2026-07-27T02:56:43Z)
• TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs [36.2604844032041]
  Video multimodal large language models (MLLMs) can describe what happens in a video, but rarely identify when the supporting evidence occurs.<n>We study generalist video temporal grounding, in which one model predicts a variable-cardinality set of evidence intervals across video lengths, domains, query forms, and viewpoints.<n>TimeLens2 treats temporal evidence as an interval set throughout supervision and optimization.
  arXiv  Detail & Related papers  (2026-07-19T22:04:33Z)
• Foresee-to-Ground: From Predictive Temporal Perception to Evidence-Driven Reasoning for Video Temporal Grounding [86.37002814396674]
  We propose Foresee-to-Ground (F2G) for Video Temporal Grounding.<n>F2G integrates Predictive Temporal Perception with Evidence-Driven Reasoning.<n>It consistently improves grounding accuracy across diverse benchmarks.
  arXiv  Detail & Related papers  (2026-05-21T04:03:25Z)
• TIE: Time Interval Encoding for Video Generation over Events [50.66585165263848]
  Director-style prompting, robotic action prediction, and interactive video agents demand temporal grounding over concurrent events.<n>Modern video generators represent time as discrete points through point-wise positional encodings.<n>Time Interval TIE is a principled, plug-and-play interval-aware generalization.
  arXiv  Detail & Related papers  (2026-05-11T13:23:14Z)
• E.M.Ground: A Temporal Grounding Vid-LLM with Holistic Event Perception and Matching [87.38371267983263]
  Temporal Video Grounding aims to precisely localize time segments corresponding to query events.<n>E.M.Ground is a novel Vid-LLM for TVG that focuses on holistic and coherent event perception.<n>E.M.Ground consistently outperforms state-of-the-art Vid-LLMs by significant margins.
  arXiv  Detail & Related papers  (2026-02-05T02:16:00Z)
• Transform-Equivariant Consistency Learning for Temporal Sentence Grounding [66.10949751429781]
  We introduce a novel Equivariant Consistency Regulation Learning framework to learn more discriminative representations for each video. Our motivation comes from that the temporal boundary of the query-guided activity should be consistently predicted. In particular, we devise a self-supervised consistency loss module to enhance the completeness and smoothness of the augmented video.
  arXiv  Detail & Related papers  (2023-05-06T19:29:28Z)
• Temporal Transductive Inference for Few-Shot Video Object Segmentation [27.140141181513425]
  Few-shot object segmentation (FS-VOS) aims at segmenting video frames using a few labelled examples of classes not seen during initial training. Key to our approach is the use of both global and local temporal constraints. Empirically, our model outperforms state-of-the-art meta-learning approaches in terms of mean intersection over union on YouTube-VIS by 2.8%.
  arXiv  Detail & Related papers  (2022-03-27T14:08:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.