TrackNetV4: Enhancing Fast Sports Object Tracking with Motion Attention Maps

• URL: http://arxiv.org/abs/2409.14543v1
• Date: Sun, 22 Sep 2024 17:58:09 GMT
• Title: TrackNetV4: Enhancing Fast Sports Object Tracking with Motion Attention Maps
• Authors: Arjun Raj, Lei Wang, Tom Gedeon,
• Abstract summary: We introduce an enhancement to the TrackNet family by fusing high-level visual features with learnable motion attention maps. Our approach leverages frame differencing maps, modulated by a motion prompt layer, to highlight key motion regions over time. We refer to our lightweight, plug-and-play solution, built on top of the existing TrackNet, as TrackNetV4.
• Score: 6.548400020461624
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurately detecting and tracking high-speed, small objects, such as balls in sports videos, is challenging due to factors like motion blur and occlusion. Although recent deep learning frameworks like TrackNetV1, V2, and V3 have advanced tennis ball and shuttlecock tracking, they often struggle in scenarios with partial occlusion or low visibility. This is primarily because these models rely heavily on visual features without explicitly incorporating motion information, which is crucial for precise tracking and trajectory prediction. In this paper, we introduce an enhancement to the TrackNet family by fusing high-level visual features with learnable motion attention maps through a motion-aware fusion mechanism, effectively emphasizing the moving ball's location and improving tracking performance. Our approach leverages frame differencing maps, modulated by a motion prompt layer, to highlight key motion regions over time. Experimental results on the tennis ball and shuttlecock datasets show that our method enhances the tracking performance of both TrackNetV2 and V3. We refer to our lightweight, plug-and-play solution, built on top of the existing TrackNet, as TrackNetV4.

Related papers

• RaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloud [10.593320435411714]
  We introduce RaTrack, an innovative solution tailored for radar-based tracking. Our method focuses on motion segmentation and clustering, enriched by a motion estimation module. RaTrack showcases superior tracking precision of moving objects, largely surpassing the performance of the state of the art.
  arXiv  Detail & Related papers  (2023-09-18T13:02:29Z)
• BEVTrack: A Simple and Strong Baseline for 3D Single Object Tracking in Bird's-Eye View [56.77287041917277]
  3D Single Object Tracking (SOT) is a fundamental task of computer vision, proving essential for applications like autonomous driving. In this paper, we propose BEVTrack, a simple yet effective baseline method. By estimating the target motion in Bird's-Eye View (BEV) to perform tracking, BEVTrack demonstrates surprising simplicity from various aspects, i.e., network designs, training objectives, and tracking pipeline, while achieving superior performance.
  arXiv  Detail & Related papers  (2023-09-05T12:42:26Z)
• Delving into Motion-Aware Matching for Monocular 3D Object Tracking [81.68608983602581]
  We find that the motion cue of objects along different time frames is critical in 3D multi-object tracking. We propose MoMA-M3T, a framework that mainly consists of three motion-aware components. We conduct extensive experiments on the nuScenes and KITTI datasets to demonstrate our MoMA-M3T achieves competitive performance against state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-08-22T17:53:58Z)
• MotionTrack: Learning Motion Predictor for Multiple Object Tracking [68.68339102749358]
  We introduce a novel motion-based tracker, MotionTrack, centered around a learnable motion predictor. Our experimental results demonstrate that MotionTrack yields state-of-the-art performance on datasets such as Dancetrack and SportsMOT.
  arXiv  Detail & Related papers  (2023-06-05T04:24:11Z)
• An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds [50.19288542498838]
  3D single object tracking in LiDAR point clouds (LiDAR SOT) plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching. We introduce a motion-centric paradigm to handle LiDAR SOT from a new perspective.
  arXiv  Detail & Related papers  (2023-03-21T17:28:44Z)
• Observation Centric and Central Distance Recovery on Sports Player Tracking [24.396926939889532]
  We propose a motionbased tracking algorithm and three post-processing pipelines for three sports including basketball, football, and volleyball. Our method achieves a HOTA of 73.968, ranking 3rd place on the 2022 Sportsmot workshop final leaderboard.
  arXiv  Detail & Related papers  (2022-09-27T04:48:11Z)
• Learning to Track Objects from Unlabeled Videos [63.149201681380305]
  In this paper, we propose to learn an Unsupervised Single Object Tracker (USOT) from scratch. To narrow the gap between unsupervised trackers and supervised counterparts, we propose an effective unsupervised learning approach composed of three stages. Experiments show that the proposed USOT learned from unlabeled videos performs well over the state-of-the-art unsupervised trackers by large margins.
  arXiv  Detail & Related papers  (2021-08-28T22:10:06Z)
• Track without Appearance: Learn Box and Tracklet Embedding with Local and Global Motion Patterns for Vehicle Tracking [45.524183249765244]
  Vehicle tracking is an essential task in the multi-object tracking (MOT) field. In this paper, we try to explore the significance of motion patterns for vehicle tracking without appearance information. We propose a novel approach that tackles the association issue for long-term tracking with the exclusive fully-exploited motion information.
  arXiv  Detail & Related papers  (2021-08-13T02:27:09Z)
• TRAT: Tracking by Attention Using Spatio-Temporal Features [14.520067060603209]
  We propose a two-stream deep neural network tracker that uses both spatial and temporal features. Our architecture is developed over ATOM tracker and contains two backbones: (i) 2D-CNN network to capture appearance features and (ii) 3D-CNN network to capture motion features.
  arXiv  Detail & Related papers  (2020-11-18T20:11:12Z)
• Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks [62.836429958476735]
  We propose a Two-Stream Residual Convolutional Network (TS-RCN) for visual tracking. Our TS-RCN can be integrated with existing deep learning based visual trackers. To further improve the tracking performance, we adopt a "wider" residual network ResNeXt as its feature extraction backbone.
  arXiv  Detail & Related papers  (2020-05-13T19:05:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.