BasketLiDAR: The First LiDAR-Camera Multimodal Dataset for Professional Basketball MOT

• URL: http://arxiv.org/abs/2508.15299v1
• Date: Thu, 21 Aug 2025 06:40:51 GMT
• Title: BasketLiDAR: The First LiDAR-Camera Multimodal Dataset for Professional Basketball MOT
• Authors: Ryunosuke Hayashi, Kohei Torimi, Rokuto Nagata, Kazuma Ikeda, Ozora Sako, Taichi Nakamura, Masaki Tani, Yoshimitsu Aoki, Kentaro Yoshioka,
• Abstract summary: Real-time 3D trajectory player tracking in sports plays a crucial role in tactical analysis, performance evaluation, and enhancing spectator experience.<n>Traditional systems rely on multi-camera setups, but are constrained by the inherently two-dimensional nature of video data and the need for complex 3D reconstruction processing.<n>Basketball represents one of the most difficult scenarios in the MOT field, as ten players move rapidly and complexly within a confined court space.<n>This paper constructs BasketLiDAR, the first multimodal dataset in the sports MOT field that combines LiDAR point clouds with synchronized multi-view camera footage in a professional basketball environment.
• Score: 4.415279811637206
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Real-time 3D trajectory player tracking in sports plays a crucial role in tactical analysis, performance evaluation, and enhancing spectator experience. Traditional systems rely on multi-camera setups, but are constrained by the inherently two-dimensional nature of video data and the need for complex 3D reconstruction processing, making real-time analysis challenging. Basketball, in particular, represents one of the most difficult scenarios in the MOT field, as ten players move rapidly and complexly within a confined court space, with frequent occlusions caused by intense physical contact. To address these challenges, this paper constructs BasketLiDAR, the first multimodal dataset in the sports MOT field that combines LiDAR point clouds with synchronized multi-view camera footage in a professional basketball environment, and proposes a novel MOT framework that simultaneously achieves improved tracking accuracy and reduced computational cost. The BasketLiDAR dataset contains a total of 4,445 frames and 3,105 player IDs, with fully synchronized IDs between three LiDAR sensors and three multi-view cameras. We recorded 5-on-5 and 3-on-3 game data from actual professional basketball players, providing complete 3D positional information and ID annotations for each player. Based on this dataset, we developed a novel MOT algorithm that leverages LiDAR's high-precision 3D spatial information. The proposed method consists of a real-time tracking pipeline using LiDAR alone and a multimodal tracking pipeline that fuses LiDAR and camera data. Experimental results demonstrate that our approach achieves real-time operation, which was difficult with conventional camera-only methods, while achieving superior tracking performance even under occlusion conditions. The dataset is available upon request at: https://sites.google.com/keio.jp/keio-csg/projects/basket-lidar

Related papers

• Multi-View 3D Point Tracking [67.21282192436031]
  We introduce the first data-driven multi-view 3D point tracker, designed to track arbitrary points in dynamic scenes using multiple camera views.<n>Our model directly predicts 3D correspondences using a practical number of cameras.<n>We train on 5K synthetic multi-view Kubric sequences and evaluate on two real-world benchmarks.
  arXiv  Detail & Related papers  (2025-08-28T17:58:20Z)
• SpatialTrackerV2: 3D Point Tracking Made Easy [73.0350898700048]
  SpatialTrackerV2 is a feed-forward 3D point tracking method for monocular videos.<n>It decomposes world-space 3D motion into scene geometry, camera ego-motion, and pixel-wise object motion.<n>By learning geometry and motion jointly from such heterogeneous data, SpatialTrackerV2 outperforms existing 3D tracking methods by 30%.
  arXiv  Detail & Related papers  (2025-07-16T17:59:03Z)
• Real-time Localization of a Soccer Ball from a Single Camera [0.0]
  We propose a computationally efficient method for real-time three-dimensional football trajectory reconstruction from a single broadcast camera.<n>In contrast to previous work, our approach introduces a multi-mode state model with $W$ discrete modes to significantly accelerate optimization.<n>The system operates on standard CPUs and achieves low latency suitable for live broadcast settings.
  arXiv  Detail & Related papers  (2025-06-09T17:52:07Z)
• TrackID3x3: A Dataset and Algorithm for Multi-Player Tracking with Identification and Pose Estimation in 3x3 Basketball Full-court Videos [8.70594963462731]
  We propose the first dataset specifically designed for multi-player tracking, player identification, and pose estimation in 3x3 basketball scenarios.<n>The dataset comprises three distinct subsets (Indoor fixed-camera, Outdoor fixed-camera, and Drone camera footage), capturing diverse full-court camera perspectives and environments.<n>To evaluate performance, we propose a baseline algorithm called Track-ID algorithm, tailored to assess tracking and identification quality.
  arXiv  Detail & Related papers  (2025-03-24T01:55:46Z)
• Enhanced Multi-Object Tracking Using Pose-based Virtual Markers in 3x3 Basketball [3.072051066949152]
  We propose a novel virtual marker (VM) MOT method for team sports, named Sports-vmTracking.<n>Our approach achieved an average HOTA score of 72.3%, over 10 points higher than other state-of-theart methods without VM, and resulted in 0 ID switches.
  arXiv  Detail & Related papers  (2024-12-09T07:16:50Z)
• CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction [27.18612358750601]
  CrossTracker is a novel two-stage paradigm for online multi-modal 3D MOT.<n>Our experiments demonstrate the superior performance of our CrossTracker over its eighteen competitors.
  arXiv  Detail & Related papers  (2024-11-28T01:36:29Z)
• Multi-Modal Dataset Acquisition for Photometrically Challenging Object [56.30027922063559]
  This paper addresses the limitations of current datasets for 3D vision tasks in terms of accuracy, size, realism, and suitable imaging modalities for photometrically challenging objects. We propose a novel annotation and acquisition pipeline that enhances existing 3D perception and 6D object pose datasets.
  arXiv  Detail & Related papers  (2023-08-21T10:38:32Z)
• An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds [50.19288542498838]
  3D single object tracking in LiDAR point clouds (LiDAR SOT) plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching. We introduce a motion-centric paradigm to handle LiDAR SOT from a new perspective.
  arXiv  Detail & Related papers  (2023-03-21T17:28:44Z)
• DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotations [3.000319651350124]
  This paper introduces DeepSportradar-v1, a suite of computer vision tasks, datasets and benchmarks for automated sport understanding. The main purpose of this framework is to close the gap between academic research and real world settings.
  arXiv  Detail & Related papers  (2022-08-17T09:55:02Z)
• SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos [62.686484228479095]
  We propose a novel dataset for multiple object tracking composed of 200 sequences of 30s each. The dataset is fully annotated with bounding boxes and tracklet IDs. Our analysis shows that multiple player, referee and ball tracking in soccer videos is far from being solved.
  arXiv  Detail & Related papers  (2022-04-14T12:22:12Z)
• Monocular Quasi-Dense 3D Object Tracking [99.51683944057191]
  A reliable and accurate 3D tracking framework is essential for predicting future locations of surrounding objects and planning the observer's actions in numerous applications such as autonomous driving. We propose a framework that can effectively associate moving objects over time and estimate their full 3D bounding box information from a sequence of 2D images captured on a moving platform.
  arXiv  Detail & Related papers  (2021-03-12T15:30:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.