Towards AI-Powered Video Assistant Referee System (VARS) for Association Football

• URL: http://arxiv.org/abs/2407.12483v2
• Date: Thu, 18 Jul 2024 07:18:23 GMT
• Title: Towards AI-Powered Video Assistant Referee System (VARS) for Association Football
• Authors: Jan Held, Anthony Cioppa, Silvio Giancola, Abdullah Hamdi, Christel Devue, Bernard Ghanem, Marc Van Droogenbroeck,
• Abstract summary: Video Assistant Referee ( VAR) is an innovation that enables backstage referees to review incidents on the pitch from multiple points of view. The VAR is currently limited to professional leagues due to its expensive infrastructure and the lack of referees worldwide. We present the semi-automated Video Assistant Referee System ( VARS) that leverages the latest findings in multi-view video analysis.
• Score: 58.04352163544319
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Over the past decade, the technology used by referees in football has improved substantially, enhancing the fairness and accuracy of decisions. This progress has culminated in the implementation of the Video Assistant Referee (VAR), an innovation that enables backstage referees to review incidents on the pitch from multiple points of view. However, the VAR is currently limited to professional leagues due to its expensive infrastructure and the lack of referees worldwide. In this paper, we present the semi-automated Video Assistant Referee System (VARS) that leverages the latest findings in multi-view video analysis. VARS sets a new state-of-the-art on the SoccerNet-MVFoul dataset, a multi-view video dataset of football fouls. Our VARS achieves a new state-of-the-art on the SoccerNet-MVFoul dataset by recognizing the type of foul in 50% of instances and the appropriate sanction in 46% of cases. Finally, we conducted a comparative study to investigate human performance in classifying fouls and their corresponding severity and compared these findings to our VARS. The results of our study highlight the potential of our VARS to reach human performance and support football refereeing across all levels of professional and amateur federations.

Related papers

• SoccerNet 2024 Challenges Results [152.8534707514927]
  SoccerNet 2024 challenges represent the fourth annual video understanding challenges organized by the SoccerNet team. The challenges aim to advance research across multiple themes in football, including broadcast video understanding, field understanding, and player understanding. This year, the challenges encompass four vision-based tasks.
  arXiv  Detail & Related papers  (2024-09-16T14:12:22Z)
• X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model [56.393522913188704]
  We introduce the Explainable Video Assistant Referee System, X- VARS, a multi-modal large language model designed for understanding football videos from the point of view of a referee. X- VARS can perform a multitude of tasks, including video description, question answering, action recognition, and conducting meaningful conversations. We validate X- VARS on our novel dataset, SoccerNet-XFoul, which consists of more than 22k video-question-answer triplets annotated by over 70 experienced football referees.
  arXiv  Detail & Related papers  (2024-04-07T12:42:02Z)
• VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Views [70.70161449930127]
  The Video Assistant Referee has revolutionized association football, enabling referees to review incidents on the pitch. However, due to the lack of referees in many countries and the high cost of the VAR infrastructure, only professional leagues can benefit from it. We propose a Video Assistant Referee System ( VARS) that can automate soccer decision-making.
  arXiv  Detail & Related papers  (2023-04-10T14:33:05Z)
• Video-based Analysis of Soccer Matches [15.328109388727997]
  This paper provides a comprehensive overview and categorization of the methods developed for the video-based visual analysis of soccer matches. We identify and discuss open research questions, soon enabling analysts to develop winning strategies more efficiently.
  arXiv  Detail & Related papers  (2021-05-11T09:01:02Z)
• Automated Tackle Injury Risk Assessment in Contact-Based Sports -- A Rugby Union Example [1.160208922584163]
  Video analysis in tackle-collision based sports is highly subjective and exposed to bias. This limitation of match analysis in tackle-collision based sports can be seen as an opportunity for computer vision applications. We present a system of objectively evaluating in-game tackle risk in rugby union matches.
  arXiv  Detail & Related papers  (2021-04-22T07:51:33Z)
• SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos [71.72665910128975]
  SoccerNet-v2 is a novel large-scale corpus of manual annotations for the SoccerNet video dataset. We release around 300k annotations within SoccerNet's 500 untrimmed broadcast soccer videos. We extend current tasks in the realm of soccer to include action spotting, camera shot segmentation with boundary detection.
  arXiv  Detail & Related papers  (2020-11-26T16:10:16Z)
• Game Plan: What AI can do for Football, and What Football can do for AI [83.79507996785838]
  Predictive and prescriptive football analytics require new developments and progress at the intersection of statistical learning, game theory, and computer vision. We illustrate that football analytics is a game changer of tremendous value, in terms of not only changing the game of football itself, but also in terms of what this domain can mean for the field of AI.
  arXiv  Detail & Related papers  (2020-11-18T10:26:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.