SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning

• URL: http://arxiv.org/abs/2608.07932v1
• Date: Sat, 08 Aug 2026 05:39:48 GMT
• Title: SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning
• Abstract summary: Sports video analysis is crucial for athletic analytics and broadcasting enhancement.<n>Current Large Multimodal Models (LMMs) inherently struggle with such dense visual complexities.<n>We propose textbfSportsGrounder, a framework that leverages an open-vocabulary visual expert to aid interleaved grounding.<n>SportsGrounder significantly improves fine-grained reasoning and achieves state-of-the-art accuracy.
• Score: 46.575904751578236
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Sports video analysis is crucial for athletic analytics and broadcasting enhancement. Dense sports video reasoning, however, demands a fine-grained understanding of numerous small-scale, highly interactive, and visually homogeneous entities (e.g., players sharing identical uniforms, the ball) across long temporal contexts. Current Large Multimodal Models (LMMs) inherently struggle with such dense visual complexities. Due to the lack of fine-grained visual details, these models often over-rely on textual priors to guess answers, especially when distinguishing visually similar actions and players. To address this, we propose \textbf{SportsGrounder}, a framework that leverages an open-vocabulary visual expert to aid interleaved grounding specifically for dense sports video reasoning. To achieve precise spatial localization, we extract domain-guided object proposals and introduce an Interleaved Grounding Fusion (IGF) mechanism. The IGF frame-by-frame integrates explicit bounding box coordinates and implicit visual semantics with global grid features. This design preserves strict temporal alignment and prevents sequence length explosion. Furthermore, we design an Action-Aware Supervision (AAS) module that directly regularizes the model's hidden states, forcing the network to learn accurate motion representations rather than relying on language bias. Optimized with Mixed Preference Optimization (MPO) to better distinguish deceptive distractors, our extensive experiments on newly curated dense sports VQA datasets (derived from SoccerNet and FineSports) demonstrate that SportsGrounder significantly improves fine-grained reasoning and achieves state-of-the-art accuracy.

Related papers

• Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding [21.581174236498196]
  We introduce SportMV-Bench, a benchmark for multi-view sports video understanding.<n>Our analysis shows that current MLLMs fail to effectively exploit multi-view information.<n>We propose SportMV-Agent, an agentic framework that orchestrates an iterative loop of active view selection, perception tool execution, and evidence-grounded reasoning.
  arXiv  Detail & Related papers  (2026-07-13T17:34:36Z)
• SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy [52.09081885158698]
  Vision-language models (VLMs) have recently shown strong potential in soccer video understanding.<n>Existing evaluation protocols focus on classification accuracy and do not assess visual grounding.<n>We introduce SoccerLens, a benchmark for grounded soccer video understanding.
  arXiv  Detail & Related papers  (2026-05-10T15:18:08Z)
• SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sports [21.410115837645318]
  SportR is the first multi-sports large-scale benchmark designed to train and evaluate MLLMs on the fundamental reasoning required for sports intelligence.<n>Our benchmark provides a dataset of 5,017 images and 2,101 videos.<n>For the most advanced tasks requiring multi-step reasoning, such as determining penalties or explaining tactics, we provide 7,118 high-quality, human-authored Chain of Thought annotations.
  arXiv  Detail & Related papers  (2025-11-09T18:55:20Z)
• Learning Sparse Temporal Video Mapping for Action Quality Assessment in Floor Gymnastics [26.717033245063092]
  We introduce a new dataset, coined AGF-Olympics, that incorporates artistic gymnastic floor routines. We propose a discriminative attention module to map the dense feature space into a sparse representation by disentangling complex associations.
  arXiv  Detail & Related papers  (2023-01-15T14:13:03Z)
• Sports Video Analysis on Large-Scale Data [10.24207108909385]
  This paper investigates the modeling of automated machine description on sports video. We propose a novel large-scale NBA dataset for Sports Video Analysis (NSVA) with a focus on captioning.
  arXiv  Detail & Related papers  (2022-08-09T16:59:24Z)
• Learning Commonsense-aware Moment-Text Alignment for Fast Video Temporal Grounding [78.71529237748018]
  Grounding temporal video segments described in natural language queries effectively and efficiently is a crucial capability needed in vision-and-language fields. Most existing approaches adopt elaborately designed cross-modal interaction modules to improve the grounding performance. We propose a commonsense-aware cross-modal alignment framework, which incorporates commonsense-guided visual and text representations into a complementary common space.
  arXiv  Detail & Related papers  (2022-04-04T13:07:05Z)
• Exploring Motion and Appearance Information for Temporal Sentence Grounding [52.01687915910648]
  We propose a Motion-Appearance Reasoning Network (MARN) to solve temporal sentence grounding. We develop separate motion and appearance branches to learn motion-guided and appearance-guided object relations. Our proposed MARN significantly outperforms previous state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2022-01-03T02:44:18Z)
• Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts [86.56462654572813]
  We focus our analysis on action spotting in soccer broadcast, which consists in temporally localizing the main actions in a soccer game. We propose a novel feature pooling method based on NetVLAD, dubbed NetVLAD++, that embeds temporally-aware knowledge. We train and evaluate our methodology on the recent large-scale dataset SoccerNet-v2, reaching 53.4% Average-mAP for action spotting.
  arXiv  Detail & Related papers  (2021-04-14T11:09:03Z)
• Decoupled Spatial Temporal Graphs for Generic Visual Grounding [120.66884671951237]
  This work investigates into a more general setting, generic visual grounding, aiming to mine all the objects satisfying the given expression. We propose a simple yet effective approach, named DSTG, which commits to 1) decomposing the spatial and temporal representations to collect all-sided cues for precise grounding. We further elaborate a new video dataset, GVG, that consists of challenging referring cases with far-ranging videos.
  arXiv  Detail & Related papers  (2021-03-18T11:56:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.