Ice hockey player identification via transformers

• URL: http://arxiv.org/abs/2111.11535v1
• Date: Mon, 22 Nov 2021 21:10:26 GMT
• Title: Ice hockey player identification via transformers
• Authors: Kanav Vats, William McNally, Pascale Walters, David A. Clausi, John S. Zelek
• Abstract summary: We introduce a transformer network for recognizing players through their jersey numbers in broadcast National Hockey League (NHL) videos. The proposed network performs better than the previous benchmark on the dataset used. We also utilize player shifts available in the NHL play-by-play data by reading the game time using optical character recognition (OCR) to get the players on the ice rink at a certain game time.
• Score: 11.28395713457468
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Identifying players in video is a foundational step in computer vision-based sports analytics. Obtaining player identities is essential for analyzing the game and is used in downstream tasks such as game event recognition. Transformers are the existing standard in Natural Language Processing (NLP) and are swiftly gaining traction in computer vision. Motivated by the increasing success of transformers in computer vision, in this paper, we introduce a transformer network for recognizing players through their jersey numbers in broadcast National Hockey League (NHL) videos. The transformer takes temporal sequences of player frames (also called player tracklets) as input and outputs the probabilities of jersey numbers present in the frames. The proposed network performs better than the previous benchmark on the dataset used. We implement a weakly-supervised training approach by generating approximate frame-level labels for jersey number presence and use the frame-level labels for faster training. We also utilize player shifts available in the NHL play-by-play data by reading the game time using optical character recognition (OCR) to get the players on the ice rink at a certain game time. Using player shifts improved the player identification accuracy by 6%.

Related papers

• A General Framework for Jersey Number Recognition in Sports Video [5.985204759362746]
  Jersey number recognition is an important task in sports video analysis, partly due to its importance for long-term player tracking. Here we introduce a novel public jersey number recognition dataset for hockey and study how scene text recognition methods can be adapted to this problem. We demonstrate high performance on image- and tracklet-level tasks, achieving 91.4% accuracy for hockey images and 87.4% for soccer tracklets.
  arXiv  Detail & Related papers  (2024-05-22T18:08:26Z)
• SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap [102.5232204867158]
  We formalize the task of Game State Reconstruction and introduce SoccerNet-GSR, a novel Game State Reconstruction dataset focusing on football videos. SoccerNet-GSR is composed of 200 video sequences of 30 seconds, annotated with 9.37 million line points for pitch localization and camera calibration. Our experiments show that GSR is a challenging novel task, which opens the field for future research.
  arXiv  Detail & Related papers  (2024-04-17T12:53:45Z)
• Domain-Guided Masked Autoencoders for Unique Player Identification [62.87054782745536]
  Masked autoencoders (MAEs) have emerged as a superior alternative to conventional feature extractors. Motivated by human vision, we devise a novel domain-guided masking policy for MAEs termed d-MAE. We conduct experiments on three large-scale sports datasets.
  arXiv  Detail & Related papers  (2024-03-17T20:14:57Z)
• Jersey Number Recognition using Keyframe Identification from Low-Resolution Broadcast Videos [7.776923607006088]
  Player identification is a crucial component in vision-driven soccer analytics, enabling various tasks such as player assessment, in-game analysis, and broadcast evaluations. Previous methods have shown success in image data but struggle with real-world video data, where jersey numbers are not visible in most frames. We propose a robust downstream identification module that extracts frames containing essential high-level information about the jersey number.
  arXiv  Detail & Related papers  (2023-09-12T14:43:50Z)
• Efficient Video Action Detection with Token Dropout and Context Refinement [67.10895416008911]
  We propose an end-to-end framework for efficient video action detection (ViTs) In a video clip, we maintain tokens from its perspective while preserving tokens relevant to actor motions from other frames. Second, we refine scene context by leveraging remaining tokens for better recognizing actor identities.
  arXiv  Detail & Related papers  (2023-04-17T17:21:21Z)
• SVFormer: Semi-supervised Video Transformer for Action Recognition [88.52042032347173]
  We introduce SVFormer, which adopts a steady pseudo-labeling framework to cope with unlabeled video samples. In addition, we propose a temporal warping to cover the complex temporal variation in videos. In particular, SVFormer outperforms the state-of-the-art by 31.5% with fewer training epochs under the 1% labeling rate of Kinetics-400.
  arXiv  Detail & Related papers  (2022-11-23T18:58:42Z)
• A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classification [75.93186954061943]
  Action spotting involves understanding the dynamics of the game, the complexity of events, and the variation of video sequences. In this work, we focus on the former by (a) identifying and representing the players, referees, and goalkeepers as nodes in a graph, and by (b) modeling their temporal interactions as sequences of graphs. For the player identification task, our method obtains an overall performance of 57.83% average-mAP by combining it with other modalities.
  arXiv  Detail & Related papers  (2022-11-22T15:23:53Z)
• A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications [60.3327085463545]
  We present a survey on video action recognition for sports analytics. We introduce more than ten types of sports, including team sports, such as football, basketball, volleyball, hockey and individual sports, such as figure skating, gymnastics, table tennis, diving and badminton. We develop a toolbox using PaddlePaddle, which supports football, basketball, table tennis and figure skating action recognition.
  arXiv  Detail & Related papers  (2022-06-02T13:19:36Z)
• Automated player identification and indexing using two-stage deep learning network [0.23610495849936355]
  We propose a deep learning-based player tracking system to automatically track players and index their participation per play in American football games. It is a two-stage network design to highlight areas of interest and identify jersey number information with high accuracy. We demonstrate the effectiveness and reliability of player tracking system by analyzing the qualitative and quantitative results on football videos.
  arXiv  Detail & Related papers  (2022-04-26T02:59:03Z)
• Player Tracking and Identification in Ice Hockey [9.577770317771087]
  This paper introduces an automated system to track and identify players in broadcast NHL hockey videos. The system is composed of three components (1) Player tracking, (2) Team identification and (3) Player identification. For team identification, the away-team jerseys are grouped into a single class and home-team jerseys are grouped in classes according to their jersey color. A novel player identification model is introduced that utilizes a temporal one-dimensional convolutional network to identify players from player bounding box sequences.
  arXiv  Detail & Related papers  (2021-10-06T22:37:08Z)
• Player Identification in Hockey Broadcast Videos [18.616544581429835]
  We present a deep convolutional neural network approach to solve the problem of hockey player identification in NHL broadcast. We employ a secondary 1-dimensional convolutional neural network as a late score-level fusion method to classify the output of the ResNet+LSTM network. This achieves an overall player identification accuracy score over 87% on the test split of our new dataset.
  arXiv  Detail & Related papers  (2020-09-05T01:30:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.