Event-based Gaze Control System for Accurate Real-time Spin Estimation in Professional Ball Games

• URL: http://arxiv.org/abs/2606.26780v2
• Date: Tue, 30 Jun 2026 12:04:09 GMT
• Title: Event-based Gaze Control System for Accurate Real-time Spin Estimation in Professional Ball Games
• Abstract summary: We propose an event-based active vision system that can track balls and measure their spin in real time.<n>The system consists of an event camera for its high temporal resolution and minimal motion blur, high-speed pan/tilt galvanometer mirrors to keep the ball in the field of view, and a low-tunable lens to increase the spatial resolution on the ball and keep it in focus.
• Score: 11.203086649949185
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Spin plays a crucial role in many ball sports due to its effect on the trajectory of the ball. Vision-based estimation of the ball's spin during a game with conventional cameras is challenging due to the ball's small size, high speed, and fast rotation. To address these challenges, we propose an event-based active vision system that can track unmodified balls and measure their spin in real time. The system consists of an event camera for its high temporal resolution and minimal motion blur, high-speed pan/tilt galvanometer mirrors to keep the ball in the field of view, and a low-latency focus-tunable telephoto lens to increase the spatial resolution on the ball and keep it in focus. To track the ball, we use a hybrid approach that combines 2D event-based detection for centering and 3D positions from a ball localization system for re-initialization. For high-accuracy spin estimation, we propose an offline method that performs contrast maximization on the sphere (s-CMax). This method achieves state-of-the-art accuracy on static balls across multiple sports (table tennis, baseball, tennis, and golf), with mean magnitude and axis errors of 1.2% and 1.5 degrees, respectively. We then develop a low-latency online method for table tennis as a case study in real-time applications. This method uses an uncertainty-aware convolutional neural network trained on pseudo-ground-truth spin labels from the offline approach, combined with a GPU-accelerated batch implementation of contrast maximization for refinement. We demonstrate reliable tracking and spin estimation with a three-view setup during professional table tennis matches, with high accuracy (8.8% magnitude and 6.4 degrees axis mismatch w.r.t. the offline method), 3 ms latency, and 750 Hz throughput.

Related papers

• 1000 Rallies: An Event-Camera Dataset and Real-Time Learned Ball-State Estimation for Robotic Table Tennis [9.183928190216532]
  We introduce the first large-scale event-camera dataset for table tennis, comprising over 1000 rallies from a diverse group of players.<n>We train a convolutional neural network robust to background player motion that jointly estimates the ball's position and velocity in the image-plane from events.<n>We close the perception-action loop by integrating the event-based system with a Stubli robotic arm.
  arXiv  Detail & Related papers  (2026-06-24T09:28:21Z)
• Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction [17.147140984254655]
  We present a real-time egocentric trajectory prediction system for table tennis using event cameras.<n>We collect a dataset of ping-pong game sequences, including 3D ground-truth trajectories of the ball, synchronized with sensor data from the Meta Project Aria glasses.<n>Our detection pipeline has a worst-case total latency of 4.5 ms, including computation and perception.
  arXiv  Detail & Related papers  (2025-06-09T15:22:55Z)
• TT3D: Table Tennis 3D Reconstruction [11.84899291358663]
  We propose a novel approach for reconstructing precise 3D ball trajectories from online table tennis match recordings.<n>Our method leverages the underlying physics of the ball's motion to identify the bounce state that minimizes the reprojection error of the ball's flying trajectory.<n>A key advantage of our approach is its ability to infer ball spin without relying on human pose estimation or racket tracking.
  arXiv  Detail & Related papers  (2025-04-14T09:37:47Z)
• FlashDepth: Real-time Streaming Video Depth Estimation at 2K Resolution [50.55876151973996]
  A versatile video depth estimation model should (1) be accurate across frames, (2) produce high-resolution depth maps, and (3) support real-time streaming.<n>We propose FlashDepth, a method that satisfies all three requirements, performing depth estimation on a 2044x1148 streaming video at 24 FPS.<n>We evaluate our approach across multiple unseen datasets against state-of-the-art depth models, and find that ours outperforms them in terms of boundary sharpness and speed by a significant margin, while maintaining competitive accuracy.
  arXiv  Detail & Related papers  (2025-04-09T17:59:31Z)
• MATE: Motion-Augmented Temporal Consistency for Event-based Point Tracking [58.719310295870024]
  This paper presents an event-based framework for tracking any point.<n>To resolve ambiguities caused by event sparsity, a motion-guidance module incorporates kinematic vectors into the local matching process.<n>The method improves the $Survival_50$ metric by 17.9% over event-only tracking of any point baseline.
  arXiv  Detail & Related papers  (2024-12-02T09:13:29Z)
• Table tennis ball spin estimation with an event camera [11.735290341808064]
  In table tennis, the combination of high velocity and spin renders traditional low frame rate cameras inadequate. We present the first method for table tennis spin estimation using an event camera. We achieve a spin magnitude mean error of $10.7 pm 17.3$ rps and a spin axis mean error of $32.9 pm 38.2deg$ in real time for a flying ball.
  arXiv  Detail & Related papers  (2024-04-15T15:36:38Z)
• EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks [107.62975594230687]
  We demonstrate an application where event cameras excel: accurately estimating the impact location of fast-moving objects. We introduce a lightweight event representation called Binary Event History Image (BEHI) to encode event data at low latency. We show that the system is capable of achieving a success rate of 81% in catching balls targeted at different locations, with a velocity of up to 13 m/s even on compute-constrained embedded platforms.
  arXiv  Detail & Related papers  (2023-04-14T15:23:28Z)
• Minimum Latency Deep Online Video Stabilization [77.68990069996939]
  We present a novel camera path optimization framework for the task of online video stabilization. In this work, we adopt recent off-the-shelf high-quality deep motion models for motion estimation to recover the camera trajectory. Our approach significantly outperforms state-of-the-art online methods both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2022-12-05T07:37:32Z)
• Ball 3D localization from a single calibrated image [1.2891210250935146]
  We propose to address the task on a single image by estimating ball diameter in pixels and use the knowledge of real ball diameter in meters. This approach is suitable for any game situation where the ball is (even partly) visible. validations on 3 basketball datasets reveals that our model gives remarkable predictions on ball 3D localization.
  arXiv  Detail & Related papers  (2022-03-30T19:38:14Z)
• ESL: Event-based Structured Light [62.77144631509817]
  Event cameras are bio-inspired sensors providing significant advantages over standard cameras. We propose a novel structured-light system using an event camera to tackle the problem of accurate and high-speed depth sensing.
  arXiv  Detail & Related papers  (2021-11-30T15:47:39Z)
• Motion-from-Blur: 3D Shape and Motion Estimation of Motion-blurred Objects in Videos [115.71874459429381]
  We propose a method for jointly estimating the 3D motion, 3D shape, and appearance of highly motion-blurred objects from a video. Experiments on benchmark datasets demonstrate that our method outperforms previous methods for fast moving object deblurring and 3D reconstruction.
  arXiv  Detail & Related papers  (2021-11-29T11:25:14Z)
• Monocular Visual Analysis for Electronic Line Calling of Tennis Games [57.14812636359967]
  Electronic Line Calling is an auxiliary referee system used for tennis matches based on binocular vision technology. We propose a monocular vision technology based ELC method. We find out whether the bouncing point of the ball is out of bounds or not according to the relative position between the bouncing point and the court side line in the two dimensional image.
  arXiv  Detail & Related papers  (2021-07-20T04:23:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.