SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos

• URL: http://arxiv.org/abs/2011.13367v3
• Date: Mon, 19 Apr 2021 15:03:26 GMT
• Title: SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos
• Authors: Adrien Deli\`ege, Anthony Cioppa, Silvio Giancola, Meisam J. Seikavandi, Jacob V. Dueholm, Kamal Nasrollahi, Bernard Ghanem, Thomas B. Moeslund, Marc Van Droogenbroeck
• Abstract summary: SoccerNet-v2 is a novel large-scale corpus of manual annotations for the SoccerNet video dataset. We release around 300k annotations within SoccerNet's 500 untrimmed broadcast soccer videos. We extend current tasks in the realm of soccer to include action spotting, camera shot segmentation with boundary detection.
• Score: 71.72665910128975
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding broadcast videos is a challenging task in computer vision, as it requires generic reasoning capabilities to appreciate the content offered by the video editing. In this work, we propose SoccerNet-v2, a novel large-scale corpus of manual annotations for the SoccerNet video dataset, along with open challenges to encourage more research in soccer understanding and broadcast production. Specifically, we release around 300k annotations within SoccerNet's 500 untrimmed broadcast soccer videos. We extend current tasks in the realm of soccer to include action spotting, camera shot segmentation with boundary detection, and we define a novel replay grounding task. For each task, we provide and discuss benchmark results, reproducible with our open-source adapted implementations of the most relevant works in the field. SoccerNet-v2 is presented to the broader research community to help push computer vision closer to automatic solutions for more general video understanding and production purposes.

Related papers

• SoccerNet-Echoes: A Soccer Game Audio Commentary Dataset [46.60191376520379]
  This paper presents SoccerNet-Echoes, an augmentation of the SoccerNet dataset with automatically generated transcriptions of audio commentaries from soccer game broadcasts. By incorporating textual data alongside visual and auditory content, SoccerNet-Echoes aims to serve as a comprehensive resource for the development of algorithms specialized in capturing the dynamics of soccer games.
  arXiv  Detail & Related papers  (2024-05-12T18:25:38Z)
• SoccerNet 2023 Challenges Results [165.5977813812761]
  SoccerNet 2023 challenges were the third annual video understanding challenges organized by the SoccerNet team. For this third edition, the challenges were composed of seven vision-based tasks split into three main themes.
  arXiv  Detail & Related papers  (2023-09-12T07:03:30Z)
• GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation [75.60413443783953]
  We present GOAL, a benchmark of over 8.9k soccer video clips, 22k sentences, and 42k knowledge triples for proposing a challenging new task setting as Knowledge-grounded Video Captioning (KGVC) Our data and code are available at https://github.com/THU-KEG/goal.
  arXiv  Detail & Related papers  (2023-03-26T08:43:36Z)
• A Multi-stage deep architecture for summary generation of soccer videos [11.41978608521222]
  We propose a method to generate the summary of a soccer match exploiting both the audio and the event metadata. The results show that our method can detect the actions of the match, identify which of these actions should belong to the summary and then propose multiple candidate summaries.
  arXiv  Detail & Related papers  (2022-05-02T07:26:35Z)
• SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos [62.686484228479095]
  We propose a novel dataset for multiple object tracking composed of 200 sequences of 30s each. The dataset is fully annotated with bounding boxes and tracklet IDs. Our analysis shows that multiple player, referee and ball tracking in soccer videos is far from being solved.
  arXiv  Detail & Related papers  (2022-04-14T12:22:12Z)
• MMSys'22 Grand Challenge on AI-based Video Production for Soccer [2.14475390920102]
  This challenge aims to assist the automation of such a production pipeline using AI. In particular, we focus on the enhancement operations that take place after an event has been detected.
  arXiv  Detail & Related papers  (2022-02-02T13:53:42Z)
• Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detection [3.7709686875144337]
  We present a two-stage paradigm to detect what and when events happen in soccer broadcast videos. Specifically, we fine-tune multiple action recognition models on soccer data to extract high-level semantic features. This approach achieved the state-of-the-art performance in both two tasks, i.e., action spotting and replay grounding, in the SoccerNet-v2 Challenge.
  arXiv  Detail & Related papers  (2021-06-28T08:00:21Z)
• Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spotting [61.92132798351982]
  We distill a powerful commercial calibration tool in a recent neural network architecture on the large-scale SoccerNet dataset. We leverage it to provide 3 ways of representing the calibration results along with player localization. We exploit those representations within the current best architecture for the action spotting task of SoccerNet-v2.
  arXiv  Detail & Related papers  (2021-04-19T14:21:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.