Generalizing Sports Feedback Generation by Watching Competitions and Reading Books: A Rock Climbing Case Study

• URL: http://arxiv.org/abs/2602.08996v1
• Date: Mon, 09 Feb 2026 18:41:43 GMT
• Title: Generalizing Sports Feedback Generation by Watching Competitions and Reading Books: A Rock Climbing Case Study
• Abstract summary: Video-LLMs struggle on the challenging task of sports feedback generation.<n>Traditional text generation evaluation metrics fail to capture the unique aspects of sports feedback quality.<n>We propose two evaluation metrics: (1) specificity and (2) actionability.
• Score: 27.82932642584153
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: While there is rapid progress in video-LLMs with advanced reasoning capabilities, prior work shows that these models struggle on the challenging task of sports feedback generation and require expensive and difficult-to-collect finetuning feedback data for each sport. This limitation is evident from the poor generalization to sports unseen during finetuning. Furthermore, traditional text generation evaluation metrics (e.g., BLEU-4, METEOR, ROUGE-L, BERTScore), originally developed for machine translation and summarization, fail to capture the unique aspects of sports feedback quality. To address the first problem, using rock climbing as our case study, we propose using auxiliary freely-available web data from the target domain, such as competition videos and coaching manuals, in addition to existing sports feedback from a disjoint, source domain to improve sports feedback generation performance on the target domain. To improve evaluation, we propose two evaluation metrics: (1) specificity and (2) actionability. Together, our approach enables more meaningful and practical generation of sports feedback under limited annotations.

Related papers

• BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxing [9.244368483134101]
  We present BoxComm, a large-scale dataset comprising 445 World Boxing Championship match videos with over 52K commentary sentences from professional broadcasts.<n>We propose a structured commentary taxonomy that categorizes each sentence into play-by-play, tactical, or contextual.<n>We introduce two novel and complementary evaluations tailored to sports commentary generation.
  arXiv  Detail & Related papers  (2026-04-06T04:56:49Z)
• SportSkills: Physical Skill Learning from Sports Instructional Videos [51.16409727318035]
  SportSkills is the first large-scale sports dataset geared towards physical skill learning with in-the-wild video.<n>We show that SportSkills unlocks the ability to understand fine-grained differences between physical actions.<n>We introduce the first large-scale task formulation of mistake-conditioned instructional video retrieval.
  arXiv  Detail & Related papers  (2026-03-26T08:29:35Z)
• Learning Skill-Attributes for Transferable Assessment in Video [56.813876909367856]
  Skill assessment from video entails rating the quality of a person's physical performance and explaining what could be done better.<n>Our CrossTrainer approach discovers skill-attributes, such as balance, control, and hand positioning.<n>By abstracting out the shared behaviors indicative of human skill, the proposed video representation generalizes substantially better than an array of existing techniques.
  arXiv  Detail & Related papers  (2025-11-17T23:53:06Z)
• SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sports [21.410115837645318]
  SportR is the first multi-sports large-scale benchmark designed to train and evaluate MLLMs on the fundamental reasoning required for sports intelligence.<n>Our benchmark provides a dataset of 5,017 images and 2,101 videos.<n>For the most advanced tasks requiring multi-step reasoning, such as determining penalties or explaining tactics, we provide 7,118 high-quality, human-authored Chain of Thought annotations.
  arXiv  Detail & Related papers  (2025-11-09T18:55:20Z)
• FineQuest: Adaptive Knowledge-Assisted Sports Video Understanding via Agent-of-Thoughts Reasoning [10.942503187642851]
  FineQuest is the first training-free framework that leverages dual-mode reasoning inspired by cognitive science.<n>FineQuest incorporates SSGraph, a multimodal sports knowledge scene graph spanning nine sports.<n>We introduce two new sports VideoQA benchmarks, Gym-QA and Diving-QA, derived from the FineGym and FineDiving datasets.
  arXiv  Detail & Related papers  (2025-09-15T11:27:23Z)
• FACTS: Fine-Grained Action Classification for Tactical Sports [4.810476621219244]
  Classifying fine-grained actions in fast-paced, close-combat sports such as fencing and boxing presents unique challenges.<n>We introduce FACTS, a novel approach for fine-grained action recognition that processes raw video data directly.<n>Our findings enhance training, performance analysis, and spectator engagement, setting a new benchmark for action classification in tactical sports.
  arXiv  Detail & Related papers  (2024-12-21T03:00:25Z)
• MatchTime: Towards Automatic Soccer Game Commentary Generation [52.431010585268865]
  We consider constructing an automatic soccer game commentary model to improve the audiences' viewing experience. First, observing the prevalent video-text misalignment in existing datasets, we manually annotate timestamps for 49 matches. Second, we propose a multi-modal temporal alignment pipeline to automatically correct and filter the existing dataset at scale. Third, based on our curated dataset, we train an automatic commentary generation model, named MatchVoice.
  arXiv  Detail & Related papers  (2024-06-26T17:57:25Z)
• Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Video [5.885902974241053]
  Reasoning over complex sports scenarios has posed significant challenges to current NLP technologies. Our evaluation spans from simple queries on basic rules and historical facts to complex, context-specific reasoning. We propose a new benchmark based on a comprehensive overview of existing sports datasets and provided extensive error analysis.
  arXiv  Detail & Related papers  (2024-06-21T05:57:50Z)
• Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports [104.40202007324633]
  We introduce the first dataset, named Sports-QA, specifically designed for the sports VideoQA task.<n>Sports-QA dataset includes various types of questions, such as descriptions, chronologies, causalities, and counterfactual conditions.<n>We propose a new Auto-Focus Transformer (AFT) capable of automatically focusing on particular scales of temporal information for question answering.
  arXiv  Detail & Related papers  (2024-01-03T02:22:34Z)
• Towards Active Learning for Action Spotting in Association Football Videos [59.84375958757395]
  Analyzing football videos is challenging and requires identifying subtle and diverse-temporal patterns. Current algorithms face significant challenges when learning from limited annotated data. We propose an active learning framework that selects the most informative video samples to be annotated next.
  arXiv  Detail & Related papers  (2023-04-09T11:50:41Z)
• A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications [60.3327085463545]
  We present a survey on video action recognition for sports analytics. We introduce more than ten types of sports, including team sports, such as football, basketball, volleyball, hockey and individual sports, such as figure skating, gymnastics, table tennis, diving and badminton. We develop a toolbox using PaddlePaddle, which supports football, basketball, table tennis and figure skating action recognition.
  arXiv  Detail & Related papers  (2022-06-02T13:19:36Z)
• Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos [96.45804577283563]
  We present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. We learn the video dynamic information but also focus on the static postures of the detected athletes in specific frames. We combine the features of the two streams to regress the final video score, supervised by ground-truth scores given by experts.
  arXiv  Detail & Related papers  (2020-08-13T15:51:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.