BasketEvent: Understanding Who Did What and When in Basketball Videos

• URL: http://arxiv.org/abs/2607.21267v1
• Date: Thu, 23 Jul 2026 12:39:56 GMT
• Title: BasketEvent: Understanding Who Did What and When in Basketball Videos
• Abstract summary: We introduce BasketEvent, a player- centric basketball event understanding dataset curated from real NBA broadcasts.<n>We propose PlayNet, a player-centric reasoning framework that maps basketball videos to player-level event predictions.<n>Our data, code, and models will be made publicly available.
• Score: 51.926771112716686
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Comprehensive basketball video understanding requires resolving not only what event occurs, but also who is responsible and when the key evidence appears. However, exist- ing methods typically treat spatial perception and semantic recognition as isolated tasks, failing to ground events to individual players or pinpoint their temporal boundaries within complex collective dynamics. To bridge this gap, we introduce BasketEvent, a player- centric basketball event understanding dataset curated from real NBA broadcasts. In BasketEvent, event labels are grounded to the responsible players, and a manually an- notated subset of 1,000 samples with precise event intervals is provided to evaluate tem- poral evidence localization. Based on this data, we propose PlayNet, a player-centric reasoning framework that maps basketball videos to player-level event predictions with temporal evidence. Concretely, PlayNet tracks key entities, associates player identities, and reasons about events by modeling player-player, player-ball, and global court inter- actions, while aggregating sparse temporal evidence via gated pooling. Extensive experi- ments demonstrate that PlayNet significantly outperforms representative video-level and crop-based baselines, proving the superiority of player-centric modeling for fine-grained sports video understanding. Our data, code, and models will be made publicly available.

Related papers

• PL-NBA: A Possession-level Universal Basketball Video Dataset Supporting Multiple Visual Understanding Tasks [53.77958773620005]
  This paper constructs the first possession-level basketball video dataset (PL-NBA)<n>PL-NBA contains 11,000 valid offensive possession clips and 31,567 annotated events with player names, captions, event types and timestamps.<n>Experiment is conducted on multiple visual understanding tasks, including event recognition, video captioning, temporal action localization and action anticipation.
  arXiv  Detail & Related papers  (2026-08-20T05:29:05Z)
• NBA_Streaming: A Large-Scale Benchmark for Fine-Grained Basketball Commentary Generation in Continuous Streams [17.027730382985236]
  We introduce NBA_Streaming, a benchmark for online fine-grained basketball commentary generation.<n>NBA_Streaming contains 307.5 hours of basketball broadcasts and approximately 35K temporally aligned events.<n>We propose a causal two-stage framework that combines completion-first localization with ball-centric semantic grounding.
  arXiv  Detail & Related papers  (2026-08-10T07:15:09Z)
• CourtMotion: Learning Event-Driven Motion Representations from Skeletal Data for Basketball [45.88028371034407]
  CourtMotion is atemporal modeling framework for analyzing and predicting game events and plays in professional basketball.<n>Our two-stage approach first processes skeletal tracking data through Graph Neural Networks to capture nuanced motion patterns.<n>We introduce event projection heads that explicitly connect player movements to basketball events like passes, shots, and steals, training the model to associate physical motion patterns with their purposes.
  arXiv  Detail & Related papers  (2025-12-01T09:58:24Z)
• Event-aware Video Corpus Moment Retrieval [79.48249428428802]
  Video Corpus Moment Retrieval (VCMR) is a practical video retrieval task focused on identifying a specific moment within a vast corpus of untrimmed videos. Existing methods for VCMR typically rely on frame-aware video retrieval, calculating similarities between the query and video frames to rank videos. We propose EventFormer, a model that explicitly utilizes events within videos as fundamental units for video retrieval.
  arXiv  Detail & Related papers  (2024-02-21T06:55:20Z)
• Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark [49.54265459763042]
  We construct a multimodal basketball game knowledge graph (KG_NBA_2022) to provide additional knowledge beyond videos. Then, a dataset that contains 9 types of fine-grained shooting events and 286 players' knowledge is constructed based on KG_NBA_2022. We develop a knowledge guided entity-aware video captioning network (KEANet) based on a candidate player list in encoder-decoder form for basketball live text broadcast.
  arXiv  Detail & Related papers  (2024-01-25T02:08:37Z)
• DeepSportLab: a Unified Framework for Ball Detection, Player Instance Segmentation and Pose Estimation in Team Sports Scenes [19.845244830593067]
  This paper presents a unified framework to (i) locate the ball, (ii) predict the pose, and (iii) segment the instance mask of players in team sports scenes.
  arXiv  Detail & Related papers  (2021-12-01T16:30:51Z)
• A Unified Taxonomy and Multimodal Dataset for Events in Invasion Games [3.7111751305143654]
  We present a universal taxonomy that covers a wide range of low and high-level events for invasion games. We release two multi-modal datasets comprising video and positional data with gold-standard annotations to foster research in fine-grained and ball-centered event spotting.
  arXiv  Detail & Related papers  (2021-08-25T10:09:28Z)
• Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts [86.56462654572813]
  We focus our analysis on action spotting in soccer broadcast, which consists in temporally localizing the main actions in a soccer game. We propose a novel feature pooling method based on NetVLAD, dubbed NetVLAD++, that embeds temporally-aware knowledge. We train and evaluate our methodology on the recent large-scale dataset SoccerNet-v2, reaching 53.4% Average-mAP for action spotting.
  arXiv  Detail & Related papers  (2021-04-14T11:09:03Z)
• Fusing Motion Patterns and Key Visual Information for Semantic Event Recognition in Basketball Videos [87.29451470527353]
  We propose a scheme to fuse global and local motion patterns (MPs) and key visual information (KVI) for semantic event recognition in basketball videos. An algorithm is proposed to estimate the global motions from the mixed motions based on the intrinsic property of camera adjustments. A two-stream 3D CNN framework is utilized for group activity recognition over the separated global and local motion patterns.
  arXiv  Detail & Related papers  (2020-07-13T10:15:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.