NBA_Streaming: A Large-Scale Benchmark for Fine-Grained Basketball Commentary Generation in Continuous Streams

• URL: http://arxiv.org/abs/2608.09200v2
• Date: Thu, 13 Aug 2026 08:01:18 GMT
• Title: NBA_Streaming: A Large-Scale Benchmark for Fine-Grained Basketball Commentary Generation in Continuous Streams
• Abstract summary: We introduce NBA_Streaming, a benchmark for online fine-grained basketball commentary generation.<n>NBA_Streaming contains 307.5 hours of basketball broadcasts and approximately 35K temporally aligned events.<n>We propose a causal two-stage framework that combines completion-first localization with ball-centric semantic grounding.
• Score: 17.027730382985236
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Live basketball commentary generation requires determining when an event is sufficiently observable and describing it before subsequent events unfold. However, existing methods are primarily designed for pre-segmented clips or complete videos, making them unsuitable for continuous streams. Existing datasets also provide limited supervision for player identities, fine-grained actions, event attributes, and coherent event chains, restricting the factual richness of generated commentary. To address these limitations, we introduce NBA_Streaming, a large-scale benchmark for online fine-grained basketball commentary generation. It contains 307.5 hours of basketball broadcasts and approximately 35K temporally aligned events, with annotations of event boundaries, player identities, fine-grained actions, event chains, and natural-language commentary. By moving from isolated clips to continuous streams, NBA_Streaming enables unified evaluation of event localization, response reliability, factual grounding, and commentary quality under causal constraints. We further propose a causal two-stage framework that combines completion-first localization with ball-centric semantic grounding, enabling the system to identify complete events from observed streams and organize scene, event, identity, and action cues for commentary generation. Extensive experiments reveal the difficulty of NBA_Streaming, where existing baselines struggle with online timing, factual grounding, and fine-grained description. Our framework consistently improves over strong alternatives, while the remaining gap highlights NBA_Streaming as a valuable benchmark for streaming sports video understanding and generation. The code and data will be made publicly available upon acceptance.

Related papers

• StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary [26.955988929948088]
  Streaming video understanding requires models to causally update state as video arrives.<n>This challenge is pronounced in live soccer commentary, where a system must describe completed events.<n>We present StreamSoccer, an event-driven system that uses event memory as its intermediate representation.
  arXiv  Detail & Related papers  (2026-08-20T07:19:29Z)
• PL-NBA: A Possession-level Universal Basketball Video Dataset Supporting Multiple Visual Understanding Tasks [53.77958773620005]
  This paper constructs the first possession-level basketball video dataset (PL-NBA)<n>PL-NBA contains 11,000 valid offensive possession clips and 31,567 annotated events with player names, captions, event types and timestamps.<n>Experiment is conducted on multiple visual understanding tasks, including event recognition, video captioning, temporal action localization and action anticipation.
  arXiv  Detail & Related papers  (2026-08-20T05:29:05Z)
• BasketEvent: Understanding Who Did What and When in Basketball Videos [51.926771112716686]
  We introduce BasketEvent, a player- centric basketball event understanding dataset curated from real NBA broadcasts.<n>We propose PlayNet, a player-centric reasoning framework that maps basketball videos to player-level event predictions.<n>Our data, code, and models will be made publicly available.
  arXiv  Detail & Related papers  (2026-07-23T12:39:56Z)
• LiveStarPro: Proactive Streaming Video Understanding with Hierarchical Memory for Long-Horizon Streams [59.485485426790966]
  We introduce LiveStarPro, a live streaming assistant that is designed for proactive video understanding over long-horizon streams.<n>LiveStarPro consistently surpasses existing methods, attaining a 28.9% improvement in semantic correctness.<n>Its streaming key-value cache further yields a 1.58x inference speedup over the same model without caching.
  arXiv  Detail & Related papers  (2026-06-16T11:18:05Z)
• BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxing [9.244368483134101]
  We present BoxComm, a large-scale dataset comprising 445 World Boxing Championship match videos with over 52K commentary sentences from professional broadcasts.<n>We propose a structured commentary taxonomy that categorizes each sentence into play-by-play, tactical, or contextual.<n>We introduce two novel and complementary evaluations tailored to sports commentary generation.
  arXiv  Detail & Related papers  (2026-04-06T04:56:49Z)
• Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoning [18.388733074404403]
  Soccer commentary plays a crucial role in enhancing the soccer game viewing experience for audiences.<n>Previous studies in automatic soccer commentary generation typically adopt an end-to-end method to generate anonymous live text commentary.<n>We propose GameSight, a two-stage model to address soccer commentary generation as a knowledge-enhanced visual reasoning task.
  arXiv  Detail & Related papers  (2026-03-31T02:24:32Z)
• Real-Time Generation of Game Video Commentary with Multimodal LLMs: Pause-Aware Decoding Approaches [69.57389826203699]
  We investigate whether in-context prompting alone can support real-time commentary generation that is both semantically relevant and well-timed.<n>We propose two prompting-based decoding strategies: 1) a fixed-interval approach, and 2) a novel dynamic interval-based decoding approach.<n> Experiments on Japanese and English datasets of racing and fighting games show that the dynamic interval-based decoding can generate commentary more closely aligned with human utterance timing and content using prompting alone.
  arXiv  Detail & Related papers  (2026-03-03T06:39:04Z)
• Commentary Generation for Soccer Highlights [0.0]
  We extend MatchVoice to commentary generation for soccer highlights using the GOAL dataset.<n>We conduct extensive experiments to reproduce the original MatchTime results and evaluate our setup.<n>Our findings suggest the need for integrating techniques from broader video-language domains to further enhance performance.
  arXiv  Detail & Related papers  (2025-08-11T01:48:37Z)
• A Simple and Effective Temporal Grounding Pipeline for Basketball Broadcast Footage [0.0]
  We present a reliable temporal grounding pipeline for video-to-analytic alignment of basketball broadcast footage. Our method aligns a pre-labeled corpus of play-by-play annotations containing dense event annotations to video frames, enabling quick retrieval of labeled video segments.
  arXiv  Detail & Related papers  (2024-10-30T17:27:44Z)
• MatchTime: Towards Automatic Soccer Game Commentary Generation [52.431010585268865]
  We consider constructing an automatic soccer game commentary model to improve the audiences' viewing experience. First, observing the prevalent video-text misalignment in existing datasets, we manually annotate timestamps for 49 matches. Second, we propose a multi-modal temporal alignment pipeline to automatically correct and filter the existing dataset at scale. Third, based on our curated dataset, we train an automatic commentary generation model, named MatchVoice.
  arXiv  Detail & Related papers  (2024-06-26T17:57:25Z)
• Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark [49.54265459763042]
  We construct a multimodal basketball game knowledge graph (KG_NBA_2022) to provide additional knowledge beyond videos. Then, a dataset that contains 9 types of fine-grained shooting events and 286 players' knowledge is constructed based on KG_NBA_2022. We develop a knowledge guided entity-aware video captioning network (KEANet) based on a candidate player list in encoder-decoder form for basketball live text broadcast.
  arXiv  Detail & Related papers  (2024-01-25T02:08:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.