Game State and Spatio-temporal Action Detection in Soccer using Graph Neural Networks and 3D Convolutional Networks

• URL: http://arxiv.org/abs/2502.15462v1
• Date: Fri, 21 Feb 2025 13:41:38 GMT
• Title: Game State and Spatio-temporal Action Detection in Soccer using Graph Neural Networks and 3D Convolutional Networks
• Authors: Jeremie Ochin, Guillaume Devineau, Bogdan Stanciulescu, Sotiris Manitsaris,
• Abstract summary: Soccer rely on two data sources: the player positions on the pitch and the sequences of events they perform.<n>We propose atemporal action detection approach that combines visual and game state analytics via Graph Neural Networks trained end-to-end with state-of-the-art 3D CNNs.
• Score: 1.4249472316161877
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Soccer analytics rely on two data sources: the player positions on the pitch and the sequences of events they perform. With around 2000 ball events per game, their precise and exhaustive annotation based on a monocular video stream remains a tedious and costly manual task. While state-of-the-art spatio-temporal action detection methods show promise for automating this task, they lack contextual understanding of the game. Assuming professional players' behaviors are interdependent, we hypothesize that incorporating surrounding players' information such as positions, velocity and team membership can enhance purely visual predictions. We propose a spatio-temporal action detection approach that combines visual and game state information via Graph Neural Networks trained end-to-end with state-of-the-art 3D CNNs, demonstrating improved metrics through game state integration.

Related papers

• Action Anticipation from SoccerNet Football Video Broadcasts [84.87912817065506]
  We introduce the task of action anticipation for football broadcast videos. We predict future actions in unobserved future frames within a five- or ten-second anticipation window. Our work will enable applications in automated broadcasting, tactical analysis, and player decision-making.
  arXiv  Detail & Related papers  (2025-04-16T12:24:33Z)
• SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap [102.5232204867158]
  We formalize the task of Game State Reconstruction and introduce SoccerNet-GSR, a novel Game State Reconstruction dataset focusing on football videos. SoccerNet-GSR is composed of 200 video sequences of 30 seconds, annotated with 9.37 million line points for pitch localization and camera calibration. Our experiments show that GSR is a challenging novel task, which opens the field for future research.
  arXiv  Detail & Related papers  (2024-04-17T12:53:45Z)
• CNN-based Game State Detection for a Foosball Table [1.612440288407791]
  In the game of Foosball, a compact and comprehensive game state description consists of the positional shifts and rotations of the figures and the position of the ball over time. In this paper, a figure detection system to determine the game state in Foosball is presented. This dataset is utilized to train Convolutional Neural Network (CNN) based end-to-end regression models to predict the rotations and shifts of each rod.
  arXiv  Detail & Related papers  (2024-04-08T09:48:02Z)
• Incremental 3D Semantic Scene Graph Prediction from RGB Sequences [86.77318031029404]
  We propose a real-time framework that incrementally builds a consistent 3D semantic scene graph of a scene given an RGB image sequence. Our method consists of a novel incremental entity estimation pipeline and a scene graph prediction network. The proposed network estimates 3D semantic scene graphs with iterative message passing using multi-view and geometric features extracted from the scene entities.
  arXiv  Detail & Related papers  (2023-05-04T11:32:16Z)
• Event Detection in Football using Graph Convolutional Networks [0.0]
  We show how to model the players and the ball in each frame of the video sequence as a graph. We present the results for graph convolutional layers and pooling methods that can be used to model the temporal context present around each action.
  arXiv  Detail & Related papers  (2023-01-24T14:52:54Z)
• A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classification [75.93186954061943]
  Action spotting involves understanding the dynamics of the game, the complexity of events, and the variation of video sequences. In this work, we focus on the former by (a) identifying and representing the players, referees, and goalkeepers as nodes in a graph, and by (b) modeling their temporal interactions as sequences of graphs. For the player identification task, our method obtains an overall performance of 57.83% average-mAP by combining it with other modalities.
  arXiv  Detail & Related papers  (2022-11-22T15:23:53Z)
• Graph Neural Networks to Predict Sports Outcomes [0.0]
  We introduce a sport-agnostic graph-based representation of game states. We then use our proposed graph representation as input to graph neural networks to predict sports outcomes.
  arXiv  Detail & Related papers  (2022-07-28T14:45:02Z)
• SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos [62.686484228479095]
  We propose a novel dataset for multiple object tracking composed of 200 sequences of 30s each. The dataset is fully annotated with bounding boxes and tracklet IDs. Our analysis shows that multiple player, referee and ball tracking in soccer videos is far from being solved.
  arXiv  Detail & Related papers  (2022-04-14T12:22:12Z)
• Predicting the outcome of team movements -- Player time series analysis using fuzzy and deep methods for representation learning [0.0]
  We provide a framework for the useful encoding of short tactics and space occupations in a more extended sequence of movements or tactical plans. We discuss the effectiveness of the proposed approach for prediction and recognition tasks on the professional basketball SportVU dataset for the 2015-16 half-season.
  arXiv  Detail & Related papers  (2021-09-13T18:42:37Z)
• Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts [86.56462654572813]
  We focus our analysis on action spotting in soccer broadcast, which consists in temporally localizing the main actions in a soccer game. We propose a novel feature pooling method based on NetVLAD, dubbed NetVLAD++, that embeds temporally-aware knowledge. We train and evaluate our methodology on the recent large-scale dataset SoccerNet-v2, reaching 53.4% Average-mAP for action spotting.
  arXiv  Detail & Related papers  (2021-04-14T11:09:03Z)
• TTNet: Real-time temporal and spatial video analysis of table tennis [5.156484100374058]
  We present a neural network aimed at real-time processing of high-resolution table tennis videos. This approach gives core information for reasoning score updates by an auto-referee system. We publish a multi-task dataset OpenTTGames with videos of table tennis games in 120 fps labeled with events.
  arXiv  Detail & Related papers  (2020-04-21T11:57:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.