FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understanding

• URL: http://arxiv.org/abs/2504.19514v1
• Date: Mon, 28 Apr 2025 06:25:04 GMT
• Title: FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understanding
• Abstract summary: FSAnno is a large-scale dataset advancing artistic sports understanding through figure skating.<n> FSBench is a benchmark dataset for fair model evaluation.
• Score: 18.20702178835379
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Figure skating, known as the "Art on Ice," is among the most artistic sports, challenging to understand due to its blend of technical elements (like jumps and spins) and overall artistic expression. Existing figure skating datasets mainly focus on single tasks, such as action recognition or scoring, lacking comprehensive annotations for both technical and artistic evaluation. Current sports research is largely centered on ball games, with limited relevance to artistic sports like figure skating. To address this, we introduce FSAnno, a large-scale dataset advancing artistic sports understanding through figure skating. FSAnno includes an open-access training and test dataset, alongside a benchmark dataset, FSBench, for fair model evaluation. FSBench consists of FSBench-Text, with multiple-choice questions and explanations, and FSBench-Motion, containing multimodal data and Question and Answer (QA) pairs, supporting tasks from technical analysis to performance commentary. Initial tests on FSBench reveal significant limitations in existing models' understanding of artistic sports. We hope FSBench will become a key tool for evaluating and enhancing model comprehension of figure skating.

Related papers

• MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs [66.28927610631096]
  Musebench is a benchmark designed to evaluate large language models (MLLMs) on nuanced artistic understanding.<n>It comprises 4,016 questions spanning cinematic arts, static visual arts, stage performing arts, and game arts.<n>A zero-shot evaluation of 28 state-of-the-art MLLMs reveals that even the best-performing model achieves only 48.29% accuracy.
  arXiv  Detail & Related papers  (2026-06-29T09:27:02Z)
• SportSkills: Physical Skill Learning from Sports Instructional Videos [51.16409727318035]
  SportSkills is the first large-scale sports dataset geared towards physical skill learning with in-the-wild video.<n>We show that SportSkills unlocks the ability to understand fine-grained differences between physical actions.<n>We introduce the first large-scale task formulation of mistake-conditioned instructional video retrieval.
  arXiv  Detail & Related papers  (2026-03-26T08:29:35Z)
• Bridging Cognitive Gap: Hierarchical Description Learning for Artistic Image Aesthetics Assessment [51.40989269202702]
  aesthetic quality assessment task is crucial for developing a human-aligned quantitative evaluation system for AIGC.<n>We propose ArtQuant, an aesthetics assessment framework for artistic images which couples isolated aesthetic dimensions through description generation.<n>Our approach achieves epoch state-of-the-art performance on several datasets while requiring only 33% of conventional trainings.
  arXiv  Detail & Related papers  (2025-12-29T12:18:26Z)
• SoccerMaster: A Vision Foundation Model for Soccer Understanding [50.88251190999469]
  Soccer understanding has recently garnered growing research interest due to its domain-specific complexity and unique challenges.<n>This work aims to propose a unified model to handle diverse soccer visual understanding tasks, ranging from fine-grained perception to semantic reasoning.<n>We present SoccerMaster, the first soccer-specific vision foundation model that unifies diverse understanding tasks within a single framework.
  arXiv  Detail & Related papers  (2025-12-11T18:03:30Z)
• Learning Skill-Attributes for Transferable Assessment in Video [56.813876909367856]
  Skill assessment from video entails rating the quality of a person's physical performance and explaining what could be done better.<n>Our CrossTrainer approach discovers skill-attributes, such as balance, control, and hand positioning.<n>By abstracting out the shared behaviors indicative of human skill, the proposed video representation generalizes substantially better than an array of existing techniques.
  arXiv  Detail & Related papers  (2025-11-17T23:53:06Z)
• SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sports [21.410115837645318]
  SportR is the first multi-sports large-scale benchmark designed to train and evaluate MLLMs on the fundamental reasoning required for sports intelligence.<n>Our benchmark provides a dataset of 5,017 images and 2,101 videos.<n>For the most advanced tasks requiring multi-step reasoning, such as determining penalties or explaining tactics, we provide 7,118 high-quality, human-authored Chain of Thought annotations.
  arXiv  Detail & Related papers  (2025-11-09T18:55:20Z)
• VIFSS: View-Invariant and Figure Skating-Specific Pose Representation Learning for Temporal Action Segmentation [5.453385501324681]
  We propose a new TAS framework for figure skating jumps that explicitly incorporates both the three-dimensional nature and the semantic procedure of jump movements.<n>Our method achieves over 92% F1@50 on element-level TAS, which requires recognizing both jump types and rotation levels.
  arXiv  Detail & Related papers  (2025-08-14T02:15:21Z)
• YourSkatingCoach: A Figure Skating Video Benchmark for Fine-Grained Element Analysis [10.444961818248624]
  dataset contains 454 videos of jump elements, the detected skater skeletons in each video, along with the gold labels of the start and ending frames of each jump, together as a video benchmark for figure skating. We propose air time detection, a novel motion analysis task, the goal of which is to accurately detect the duration of the air time of a jump. To verify the generalizability of the fine-grained labels, we apply the same process to other sports as cross-sports tasks but for coarse-grained task action classification.
  arXiv  Detail & Related papers  (2024-10-27T12:52:28Z)
• 3D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach [5.453385501324681]
  In figure skating, technical judgments are performed by watching skaters' 3D movements, and its part of the judging procedure can be regarded as a Temporal Action (TAS) task. There is a lack of datasets and effective methods for TAS tasks requiring 3D pose data. In this study, we first created the FS-Jump3D dataset of complex and dynamic figure skating jumps using optical markerless motion capture. We also propose a new fine-grained figure skating jump TAS dataset annotation method with which TAS models can learn jump procedures.
  arXiv  Detail & Related papers  (2024-08-29T15:42:06Z)
• GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
  Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI. We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
  arXiv  Detail & Related papers  (2024-08-01T11:52:56Z)
• Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image Retrieval [85.73149096516543]
  We address the choice of viewpoint during sketch creation in Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) A pilot study highlights the system's struggle when query-sketches differ in viewpoint from target instances. To reconcile this, we advocate for a view-aware system, seamlessly accommodating both view-agnostic and view-specific tasks.
  arXiv  Detail & Related papers  (2024-07-01T21:20:44Z)
• OSL-ActionSpotting: A Unified Library for Action Spotting in Sports Videos [56.393522913188704]
  We introduce OSL-ActionSpotting, a Python library that unifies different action spotting algorithms to streamline research and applications in sports video analytics. We successfully integrated three cornerstone action spotting methods into OSL-ActionSpotting, achieving performance metrics that match those of the original, disparates.
  arXiv  Detail & Related papers  (2024-07-01T13:17:37Z)
• Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports [104.40202007324633]
  We introduce the first dataset, named Sports-QA, specifically designed for the sports VideoQA task.<n>Sports-QA dataset includes various types of questions, such as descriptions, chronologies, causalities, and counterfactual conditions.<n>We propose a new Auto-Focus Transformer (AFT) capable of automatically focusing on particular scales of temporal information for question answering.
  arXiv  Detail & Related papers  (2024-01-03T02:22:34Z)
• Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Method [64.40494830113286]
  We first introduce a large-scale AIAA dataset: Boldbrush Artistic Image dataset (BAID), which consists of 60,337 artistic images covering various art forms. We then propose a new method, SAAN, which can effectively extract and utilize style-specific and generic aesthetic information to evaluate artistic images. Experiments demonstrate that our proposed approach outperforms existing IAA methods on the proposed BAID dataset.
  arXiv  Detail & Related papers  (2023-03-27T12:59:15Z)
• A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications [60.3327085463545]
  We present a survey on video action recognition for sports analytics. We introduce more than ten types of sports, including team sports, such as football, basketball, volleyball, hockey and individual sports, such as figure skating, gymnastics, table tennis, diving and badminton. We develop a toolbox using PaddlePaddle, which supports football, basketball, table tennis and figure skating action recognition.
  arXiv  Detail & Related papers  (2022-06-02T13:19:36Z)
• Skating-Mixer: Multimodal MLP for Scoring Figure Skating [31.346611498891964]
  We introduce a multimodal architecture, named Skating-Mixer. It effectively learns long-term representations through our designed memory recurrent unit (MRU) Experiments show the proposed method outperforms SOTAs over all major metrics on the public Fis-V and our FS1000 dataset.
  arXiv  Detail & Related papers  (2022-03-08T10:36:55Z)
• FSD-10: A Dataset for Competitive Sports Content Analysis [29.62110021022271]
  Figure Skating dataset (FSD-10) is designed to have a large collection of finegrained actions. Each clip is at a rate of 30 frames per second with resolution 1080 $times$ 720. We evaluate state-of-the-art action recognition methods on FSD-10.
  arXiv  Detail & Related papers  (2020-02-09T08:04:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.