An LLM-Based Automatic Sportscast Solution for Robot Soccer Matches

• URL: http://arxiv.org/abs/2607.14809v1
• Date: Thu, 16 Jul 2026 10:27:23 GMT
• Title: An LLM-Based Automatic Sportscast Solution for Robot Soccer Matches
• Abstract summary: This paper introduces a fully autonomous, real-time sports commentator for RoboCup matches.<n>By bridging the gap between raw tracking and natural language generation, our neuro-symbolic architecture extracts precise statistics from video streams.<n>The proposed system is capable of generating statistics and commentary both during live match streaming and in post-game analysis.
• Score: 3.228960871960554
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: RoboCup has always been a scenario to develop systems that solve real-world problems. Driven by the main goal of playing against the 2050 FIFA World Cup champions, the RoboCup Soccer leagues need to constantly measure how the research community is progressing. Computing visual statistics from match videos is a crucial way to track this evolution. To address this challenge, this paper introduces a fully autonomous, real-time sports commentator for RoboCup matches. By bridging the gap between raw kinematic tracking and natural language generation, our neuro-symbolic architecture extracts precise statistics from video streams and turns them into fluent, hallucination-free narration. The proposed system is capable of generating statistics and commentary both during live match streaming and in post-game analysis, easily adapting to the new dynamism of the league where different humanoid robots of different sizes share the field. Supplemental materials are available at https://lab-rococo-sapienza.github.io/MARIO/

Related papers

• Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Models [76.29781698910202]
  We propose a framework for fine-grained cooperative spatial reasoning.<n> SP-CoR combines dynamics-aware multi-robot frame sampling, spectral- and physics-guided view fusion, and physics-aligned prompt distillation.<n>It consistently improves cooperative reasoning, outperforming the strongest finetuned baseline by +3.87% on Habitat and +7.12% on iGibson.
  arXiv  Detail & Related papers  (2026-05-18T14:04:26Z)
• Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoning [18.388733074404403]
  Soccer commentary plays a crucial role in enhancing the soccer game viewing experience for audiences.<n>Previous studies in automatic soccer commentary generation typically adopt an end-to-end method to generate anonymous live text commentary.<n>We propose GameSight, a two-stage model to address soccer commentary generation as a knowledge-enhanced visual reasoning task.
  arXiv  Detail & Related papers  (2026-03-31T02:24:32Z)
• SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understanding [44.04695944511487]
  SoccerChat is a conversational AI framework that integrates visual and textual data for enhanced soccer video comprehension.<n>We benchmark SoccerChat on action classification and referee decision-making tasks, demonstrating its performance in general soccer event comprehension.<n>Our findings highlight the importance of multimodal integration in advancing soccer analytics, paving the way for more interactive and explainable AI-driven sports analysis.
  arXiv  Detail & Related papers  (2025-05-22T13:01:51Z)
• SoccerDiffusion: Toward Learning End-to-End Humanoid Robot Soccer from Gameplay Recordings [2.572390511592254]
  SoccerDiffusion is a transformer-based diffusion model to learn end-to-end control policies for humanoid robot soccer.<n>We employ a distillation technique to enable real-time inference on embedded platforms.<n>Our results demonstrate the model's ability to replicate complex motion behaviors in simulation and on physical robots.
  arXiv  Detail & Related papers  (2025-04-29T14:21:08Z)
• Towards Universal Soccer Video Understanding [58.889409980618396]
  This paper aims to a comprehensive multi-modal framework for soccer understanding.<n>We introduce SoccerReplay-1988, the largest multi-modal soccer dataset to date, featuring videos and detailed annotations from 1, complete matches.<n>We present an advanced soccer-specific visual, MatchVision, which leveragestemporal information across soccer videos and excels in various downstream tasks.
  arXiv  Detail & Related papers  (2024-12-02T18:58:04Z)
• GRUtopia: Dream General Robots in a City at Scale [65.08318324604116]
  This paper introduces project GRUtopia, the first simulated interactive 3D society designed for various robots. GRScenes includes 100k interactive, finely annotated scenes, which can be freely combined into city-scale environments. GRResidents is a Large Language Model (LLM) driven Non-Player Character (NPC) system that is responsible for social interaction.
  arXiv  Detail & Related papers  (2024-07-15T17:40:46Z)
• RobocupGym: A challenging continuous control benchmark in Robocup [7.926196208425107]
  We introduce a Robocup-based RL environment based on the open source rcssserver3d soccer server. In each task, an RL agent controls a simulated robot, and can interact with the ball or other agents.
  arXiv  Detail & Related papers  (2024-07-03T15:26:32Z)
• MatchTime: Towards Automatic Soccer Game Commentary Generation [52.431010585268865]
  We consider constructing an automatic soccer game commentary model to improve the audiences' viewing experience. First, observing the prevalent video-text misalignment in existing datasets, we manually annotate timestamps for 49 matches. Second, we propose a multi-modal temporal alignment pipeline to automatically correct and filter the existing dataset at scale. Third, based on our curated dataset, we train an automatic commentary generation model, named MatchVoice.
  arXiv  Detail & Related papers  (2024-06-26T17:57:25Z)
• Learning Robot Soccer from Egocentric Vision with Deep Reinforcement Learning [17.906144781244336]
  We train end-to-end robot soccer policies with fully onboard computation and sensing via egocentric RGB vision. This paper constitutes a first demonstration of end-to-end training for multi-agent robot soccer.
  arXiv  Detail & Related papers  (2024-05-03T18:41:13Z)
• Learning an Actionable Discrete Diffusion Policy via Large-Scale Actionless Video Pre-Training [69.54948297520612]
  Learning a generalist embodied agent poses challenges, primarily stemming from the scarcity of action-labeled robotic datasets. We introduce a novel framework to tackle these challenges, which leverages a unified discrete diffusion to combine generative pre-training on human videos and policy fine-tuning on a small number of action-labeled robot videos. Our method generates high-fidelity future videos for planning and enhances the fine-tuned policies compared to previous state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-02-22T09:48:47Z)
• SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos [62.686484228479095]
  We propose a novel dataset for multiple object tracking composed of 200 sequences of 30s each. The dataset is fully annotated with bounding boxes and tracklet IDs. Our analysis shows that multiple player, referee and ball tracking in soccer videos is far from being solved.
  arXiv  Detail & Related papers  (2022-04-14T12:22:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.