Automated player identification and indexing using two-stage deep learning network

• URL: http://arxiv.org/abs/2204.13809v2
• Date: Tue, 26 Dec 2023 23:22:20 GMT
• Title: Automated player identification and indexing using two-stage deep learning network
• Authors: Hongshan Liu, Colin Aderon, Noah Wagon, Abdul Latif Bamba, Xueshen Li, Huapu Liu, Steven MacCall, Yu Gan
• Abstract summary: We propose a deep learning-based player tracking system to automatically track players and index their participation per play in American football games. It is a two-stage network design to highlight areas of interest and identify jersey number information with high accuracy. We demonstrate the effectiveness and reliability of player tracking system by analyzing the qualitative and quantitative results on football videos.
• Score: 0.23610495849936355
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: American football games attract significant worldwide attention every year. Identifying players from videos in each play is also essential for the indexing of player participation. Processing football game video presents great challenges such as crowded settings, distorted objects, and imbalanced data for identifying players, especially jersey numbers. In this work, we propose a deep learning-based player tracking system to automatically track players and index their participation per play in American football games. It is a two-stage network design to highlight areas of interest and identify jersey number information with high accuracy. First, we utilize an object detection network, a detection transformer, to tackle the player detection problem in a crowded context. Second, we identify players using jersey number recognition with a secondary convolutional neural network, then synchronize it with a game clock subsystem. Finally, the system outputs a complete log in a database for play indexing. We demonstrate the effectiveness and reliability of player tracking system by analyzing the qualitative and quantitative results on football videos. The proposed system shows great potential for implementation in and analysis of football broadcast video.

Related papers

• Deep Understanding of Soccer Match Videos [20.783415560412003]
  Soccer is one of the most popular sport worldwide, with live broadcasts frequently available for major matches. Our system can detect key objects such as soccer balls, players and referees. It also tracks the movements of players and the ball, recognizes player numbers, classifies scenes, and identifies highlights such as goal kicks.
  arXiv  Detail & Related papers  (2024-07-11T05:54:13Z)
• SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap [102.5232204867158]
  We formalize the task of Game State Reconstruction and introduce SoccerNet-GSR, a novel Game State Reconstruction dataset focusing on football videos. SoccerNet-GSR is composed of 200 video sequences of 30 seconds, annotated with 9.37 million line points for pitch localization and camera calibration. Our experiments show that GSR is a challenging novel task, which opens the field for future research.
  arXiv  Detail & Related papers  (2024-04-17T12:53:45Z)
• Jersey Number Recognition using Keyframe Identification from Low-Resolution Broadcast Videos [7.776923607006088]
  Player identification is a crucial component in vision-driven soccer analytics, enabling various tasks such as player assessment, in-game analysis, and broadcast evaluations. Previous methods have shown success in image data but struggle with real-world video data, where jersey numbers are not visible in most frames. We propose a robust downstream identification module that extracts frames containing essential high-level information about the jersey number.
  arXiv  Detail & Related papers  (2023-09-12T14:43:50Z)
• SoccerNet 2023 Challenges Results [165.5977813812761]
  SoccerNet 2023 challenges were the third annual video understanding challenges organized by the SoccerNet team. For this third edition, the challenges were composed of seven vision-based tasks split into three main themes.
  arXiv  Detail & Related papers  (2023-09-12T07:03:30Z)
• A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classification [75.93186954061943]
  Action spotting involves understanding the dynamics of the game, the complexity of events, and the variation of video sequences. In this work, we focus on the former by (a) identifying and representing the players, referees, and goalkeepers as nodes in a graph, and by (b) modeling their temporal interactions as sequences of graphs. For the player identification task, our method obtains an overall performance of 57.83% average-mAP by combining it with other modalities.
  arXiv  Detail & Related papers  (2022-11-22T15:23:53Z)
• SoccerNet 2022 Challenges Results [167.6158475931228]
  SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team. In 2022, the challenges were composed of 6 vision-based tasks. Compared to last year's challenges, tasks (1-2) had their evaluation metrics redefined to consider tighter temporal accuracies, and tasks (3-6) were novel, including their underlying data and annotations.
  arXiv  Detail & Related papers  (2022-10-05T16:12:50Z)
• SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos [62.686484228479095]
  We propose a novel dataset for multiple object tracking composed of 200 sequences of 30s each. The dataset is fully annotated with bounding boxes and tracklet IDs. Our analysis shows that multiple player, referee and ball tracking in soccer videos is far from being solved.
  arXiv  Detail & Related papers  (2022-04-14T12:22:12Z)
• Collusion Detection in Team-Based Multiplayer Games [57.153233321515984]
  We propose a system that detects colluding behaviors in team-based multiplayer games. The proposed method analyzes the players' social relationships paired with their in-game behavioral patterns. We then automate the detection using Isolation Forest, an unsupervised learning technique specialized in highlighting outliers.
  arXiv  Detail & Related papers  (2022-03-10T02:37:39Z)
• Ice hockey player identification via transformers [11.28395713457468]
  We introduce a transformer network for recognizing players through their jersey numbers in broadcast National Hockey League (NHL) videos. The proposed network performs better than the previous benchmark on the dataset used. We also utilize player shifts available in the NHL play-by-play data by reading the game time using optical character recognition (OCR) to get the players on the ice rink at a certain game time.
  arXiv  Detail & Related papers  (2021-11-22T21:10:26Z)
• Player Tracking and Identification in Ice Hockey [9.577770317771087]
  This paper introduces an automated system to track and identify players in broadcast NHL hockey videos. The system is composed of three components (1) Player tracking, (2) Team identification and (3) Player identification. For team identification, the away-team jerseys are grouped into a single class and home-team jerseys are grouped in classes according to their jersey color. A novel player identification model is introduced that utilizes a temporal one-dimensional convolutional network to identify players from player bounding box sequences.
  arXiv  Detail & Related papers  (2021-10-06T22:37:08Z)
• Player Identification in Hockey Broadcast Videos [18.616544581429835]
  We present a deep convolutional neural network approach to solve the problem of hockey player identification in NHL broadcast. We employ a secondary 1-dimensional convolutional neural network as a late score-level fusion method to classify the output of the ResNet+LSTM network. This achieves an overall player identification accuracy score over 87% on the test split of our new dataset.
  arXiv  Detail & Related papers  (2020-09-05T01:30:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.