Learning Sparse Temporal Video Mapping for Action Quality Assessment in Floor Gymnastics

• URL: http://arxiv.org/abs/2301.06103v1
• Date: Sun, 15 Jan 2023 14:13:03 GMT
• Title: Learning Sparse Temporal Video Mapping for Action Quality Assessment in Floor Gymnastics
• Abstract summary: We introduce a new dataset, coined AGF-Olympics, that incorporates artistic gymnastic floor routines. We propose a discriminative attention module to map the dense feature space into a sparse representation by disentangling complex associations.
• Score: 26.717033245063092
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Athlete performance measurement in sports videos requires modeling long sequences since the entire spatio-temporal progression contributes dominantly to the performance. It is crucial to comprehend local discriminative spatial dependencies and global semantics for accurate evaluation. However, existing benchmark datasets mainly incorporate sports where the performance lasts only a few seconds. Consequently, state-ofthe-art sports quality assessment methods specifically focus on spatial structure. Although they achieve high performance in short-term sports, they are unable to model prolonged video sequences and fail to achieve similar performance in long-term sports. To facilitate such analysis, we introduce a new dataset, coined AGF-Olympics, that incorporates artistic gymnastic floor routines. AFG-Olympics provides highly challenging scenarios with extensive background, viewpoint, and scale variations over an extended sample duration of up to 2 minutes. In addition, we propose a discriminative attention module to map the dense feature space into a sparse representation by disentangling complex associations. Extensive experiments indicate that our proposed module provides an effective way to embed long-range spatial and temporal correlation semantics.

Related papers

• SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning [46.575904751578236]
  Sports video analysis is crucial for athletic analytics and broadcasting enhancement.<n>Current Large Multimodal Models (LMMs) inherently struggle with such dense visual complexities.<n>We propose textbfSportsGrounder, a framework that leverages an open-vocabulary visual expert to aid interleaved grounding.<n>SportsGrounder significantly improves fine-grained reasoning and achieves state-of-the-art accuracy.
  arXiv  Detail & Related papers  (2026-08-08T05:39:48Z)
• SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy [52.09081885158698]
  Vision-language models (VLMs) have recently shown strong potential in soccer video understanding.<n>Existing evaluation protocols focus on classification accuracy and do not assess visual grounding.<n>We introduce SoccerLens, a benchmark for grounded soccer video understanding.
  arXiv  Detail & Related papers  (2026-05-10T15:18:08Z)
• Towards Temporal Compositional Reasoning in Long-Form Sports Videos [5.5825182710791275]
  Chain-of-Time Reasoning (CoTR) treats reasoning as a process of temporally grounded evidence composition.<n>CoTR consistently improves temporal compositional reasoning and step-wise grounding quality over strong MLLM baselines.
  arXiv  Detail & Related papers  (2026-04-24T05:02:03Z)
• Towards Athlete Fatigue Assessment from Association Football Videos [53.20057980542362]
  This paper builds on state-of-theart Game State Reconstruction methods to extract player trajectories in pitch coordinates.<n>We then construct acceleration--speed profiles from these signals and analyze their behavior as fatigue-related performance indicators.<n>Our results indicate that monocular broadcast videos can recover kinematic patterns that are compatible with A-S-temporal while also revealing sensitivity to trajectory noise, calibration errors, and temporal discontinuities inherent to broadcast footage.
  arXiv  Detail & Related papers  (2026-04-07T09:36:28Z)
• Long-RVOS: A Comprehensive Benchmark for Long-term Referring Video Object Segmentation [51.2732688481343]
  We introduce Longtextbf-RVOS, a large-scale benchmark for long-term referring object segmentation.<n>Long-RVOS contains 2,000+ videos of an average duration exceeding 60 seconds, covering a variety of objects.<n>Unlike previous benchmarks that rely solely on the per-frame spatial evaluation, we introduce two metrics to assess the temporal andtemporal consistency.
  arXiv  Detail & Related papers  (2025-05-19T04:52:31Z)
• Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance [25.289420629683477]
  Event Spotting (PES) aims to identify events and their class from long, untrimmed videos, particularly in sports. Existing methods mainly rely on features from a large pre-trained network, which may not be ideal for the task. This paper demonstrates that an appropriately designed network, trained end-to-end, can outperform state-of-the-art (SOTA) methods.
  arXiv  Detail & Related papers  (2025-02-28T19:53:42Z)
• YourSkatingCoach: A Figure Skating Video Benchmark for Fine-Grained Element Analysis [10.444961818248624]
  dataset contains 454 videos of jump elements, the detected skater skeletons in each video, along with the gold labels of the start and ending frames of each jump, together as a video benchmark for figure skating. We propose air time detection, a novel motion analysis task, the goal of which is to accurately detect the duration of the air time of a jump. To verify the generalizability of the fine-grained labels, we apply the same process to other sports as cross-sports tasks but for coarse-grained task action classification.
  arXiv  Detail & Related papers  (2024-10-27T12:52:28Z)
• OSL-ActionSpotting: A Unified Library for Action Spotting in Sports Videos [56.393522913188704]
  We introduce OSL-ActionSpotting, a Python library that unifies different action spotting algorithms to streamline research and applications in sports video analytics. We successfully integrated three cornerstone action spotting methods into OSL-ActionSpotting, achieving performance metrics that match those of the original, disparates.
  arXiv  Detail & Related papers  (2024-07-01T13:17:37Z)
• Spatial-Temporal Multi-level Association for Video Object Segmentation [89.32226483171047]
  This paper proposes spatial-temporal multi-level association, which jointly associates reference frame, test frame, and object features. Specifically, we construct a spatial-temporal multi-level feature association module to learn better target-aware features.
  arXiv  Detail & Related papers  (2024-04-09T12:44:34Z)
• LOGO: A Long-Form Video Dataset for Group Action Quality Assessment [63.53109605625047]
  We construct a new multi-person long-form video dataset for action quality assessment named LOGO. Our dataset contains 200 videos from 26 artistic swimming events with 8 athletes in each sample along with an average duration of 204.2 seconds. As for richness in annotations, LOGO includes formation labels to depict group information of multiple athletes and detailed annotations on action procedures.
  arXiv  Detail & Related papers  (2024-04-07T17:51:53Z)
• SportsSloMo: A New Benchmark and Baselines for Human-centric Video Frame Interpolation [11.198172694893927]
  SportsSloMo is a benchmark consisting of more than 130K video clips and 1M video frames of high-resolution ($geq$720p) slow-motion sports videos crawled from YouTube. We re-train several state-of-the-art methods on our benchmark, and the results show a decrease in their accuracy compared to other datasets. We introduce two loss terms considering the human-aware priors, where we add auxiliary supervision to panoptic segmentation and human keypoints detection.
  arXiv  Detail & Related papers  (2023-08-31T17:23:50Z)
• Towards Active Learning for Action Spotting in Association Football Videos [59.84375958757395]
  Analyzing football videos is challenging and requires identifying subtle and diverse-temporal patterns. Current algorithms face significant challenges when learning from limited annotated data. We propose an active learning framework that selects the most informative video samples to be annotated next.
  arXiv  Detail & Related papers  (2023-04-09T11:50:41Z)
• MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actions [39.27858380391081]
  This paper aims to present a new multi-person dataset of atomic-temporal actions, coined as MultiSports. We build the dataset of MultiSports v1.0 by selecting 4 sports classes, collecting around 3200 video clips, and annotating around 37790 action instances with 907k bounding boxes.
  arXiv  Detail & Related papers  (2021-05-16T10:40:30Z)
• Unsupervised Domain Adaptation for Spatio-Temporal Action Localization [69.12982544509427]
  S-temporal action localization is an important problem in computer vision. We propose an end-to-end unsupervised domain adaptation algorithm. We show that significant performance gain can be achieved when spatial and temporal features are adapted separately or jointly.
  arXiv  Detail & Related papers  (2020-10-19T04:25:10Z)
• Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos [96.45804577283563]
  We present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. We learn the video dynamic information but also focus on the static postures of the detected athletes in specific frames. We combine the features of the two streams to regress the final video score, supervised by ground-truth scores given by experts.
  arXiv  Detail & Related papers  (2020-08-13T15:51:42Z)
• Event detection in coarsely annotated sports videos via parallel multi receptive field 1D convolutions [14.30009544149561]
  In problems such as sports video analytics, it is difficult to obtain accurate frame level annotations and exact event duration. We propose the task of event detection in coarsely annotated videos. We introduce a multi-tower temporal convolutional network architecture for the proposed task.
  arXiv  Detail & Related papers  (2020-04-13T19:51:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.