StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary
- URL: http://arxiv.org/abs/2608.19723v1
- Date: Thu, 20 Aug 2026 07:19:29 GMT
- Title: StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary
- Abstract summary: Streaming video understanding requires models to causally update state as video arrives.<n>This challenge is pronounced in live soccer commentary, where a system must describe completed events.<n>We present StreamSoccer, an event-driven system that uses event memory as its intermediate representation.
- Score: 26.955988929948088
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Streaming video understanding requires models to causally update state as video arrives and organize growing history into semantic units that can evolve, persist, and be recalled under bounded computation and memory. This challenge is pronounced in live soccer commentary, where a system must describe completed events, summarize recent play, recall earlier events, or remain silent using only information available before each utterance. We present StreamSoccer, an event-driven system that uses event memory as its intermediate representation. A fixed-budget active memory integrates the stream; completed event states are retained locally and consolidated into retrievable historical records. A unified generator uses current, recent, and historical context to produce three commentary modes, while a rule-assisted scheduler selects a mode or silence. Unlike streaming video-language models organized around frames, visual tokens, or caches, and soccer-commentary methods based on predefined clips or output timestamps, StreamSoccer explicitly models event lifecycles. We construct a three-track streaming soccer commentary dataset and a layered evaluation protocol. At common reference anchors, StreamSoccer obtains CIDEr scores of 38.62, 23.96, and 17.39 for current-event, recent-window, and historical-memory commentary, ranking first on the current-event and historical-memory tracks and second on recent-window. Controlled ablations show that local completed events improve all tracks and that the full system performs best on all three. Across 174 raw-video runs on 58 matches, per-minute RTF p95 ranges from 0.10 to 0.22 without sustained growth with match history. These results indicate that event memory supports streaming soccer commentary across temporal scopes while controlling long-history computation.
Related papers
- NBA_Streaming: A Large-Scale Benchmark for Fine-Grained Basketball Commentary Generation in Continuous Streams [17.027730382985236]
We introduce NBA_Streaming, a benchmark for online fine-grained basketball commentary generation.<n>NBA_Streaming contains 307.5 hours of basketball broadcasts and approximately 35K temporally aligned events.<n>We propose a causal two-stage framework that combines completion-first localization with ball-centric semantic grounding.
arXiv Detail & Related papers (2026-08-10T07:15:09Z) - StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding [42.88155526332792]
We introduce StreamArena, a benchmark for hour-scale, interactive streaming video understanding.<n> evaluation across diverse systems exposes a tension between continuous interaction and long-horizon multimodal comprehension.<n>We address this tension with StreamMind, a two-tier architecture that assigns latency-critical interaction and proactive monitoring to independently scheduled workers.
arXiv Detail & Related papers (2026-08-06T07:46:37Z) - Video = World + Event Stream [70.56197496608006]
Wan-Streamer v0.3 reframes our native interaction model under a single organizing: a is a world plus an event stream.<n>This yields a general-purpose pretraining task over large amounts of real video.<n> Functionally, the model's multimodal understanding process is vision--action-like.
arXiv Detail & Related papers (2026-07-16T14:19:42Z) - LiveStarPro: Proactive Streaming Video Understanding with Hierarchical Memory for Long-Horizon Streams [59.485485426790966]
We introduce LiveStarPro, a live streaming assistant that is designed for proactive video understanding over long-horizon streams.<n>LiveStarPro consistently surpasses existing methods, attaining a 28.9% improvement in semantic correctness.<n>Its streaming key-value cache further yields a 1.58x inference speedup over the same model without caching.
arXiv Detail & Related papers (2026-06-16T11:18:05Z) - Don't Pause! Every prediction matters in a streaming video [55.509551643600794]
We introduce SPOT-Bench, featuring multi-turn proactive queries that evaluate general streaming perception and assistive capabilities.<n> SPOT-Bench comes with Timeliness-F1, a metric that measures streaming predictions by their temporal precision and balanced coverage across the entire video.<n>Our benchmark reveals: (i) offline models detect events reliably but spam predictions unprompted; (ii) post-training for silence reduces spamming but induces unresponsiveness; (iii) half of the streaming video expects no response, which we term dead-time - compute spent here does not affect response latency.
arXiv Detail & Related papers (2026-04-27T11:07:03Z) - Mixture of Contexts for Long Video Generation [72.96361488755986]
We recast long-context video generation as an internal information retrieval task.<n>We propose a simple, learnable sparse attention routing module, Mixture of Contexts (MoC), as an effective long-term memory retrieval engine.<n>As we scale the data and gradually sparsify the routing, the model allocates compute to salient history, preserving identities, actions, and scenes over minutes of content.
arXiv Detail & Related papers (2025-08-28T17:57:55Z) - Commentary Generation for Soccer Highlights [0.0]
We extend MatchVoice to commentary generation for soccer highlights using the GOAL dataset.<n>We conduct extensive experiments to reproduce the original MatchTime results and evaluate our setup.<n>Our findings suggest the need for integrating techniques from broader video-language domains to further enhance performance.
arXiv Detail & Related papers (2025-08-11T01:48:37Z) - Hierarchical Event Memory for Accurate and Low-latency Online Video Temporal Grounding [49.51013055630857]
We tackle the task of online video temporal grounding (OnVTG), which requires the model to locate events related to a given text query within a video stream.<n>Unlike regular video temporal grounding, OnVTG requires the model to make predictions without observing future frames.<n>We propose an event-based OnVTG framework that makes predictions based on event proposals that model event-level information with various durations.
arXiv Detail & Related papers (2025-08-06T15:33:49Z) - Unifying Event Detection and Captioning as Sequence Generation via
Pre-Training [53.613265415703815]
We propose a unified pre-training and fine-tuning framework to enhance the inter-task association between event detection and captioning.
Our model outperforms the state-of-the-art methods, and can be further boosted when pre-trained on extra large-scale video-text data.
arXiv Detail & Related papers (2022-07-18T14:18:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.