Table tennis ball spin estimation with an event camera

• URL: http://arxiv.org/abs/2404.09870v1
• Date: Mon, 15 Apr 2024 15:36:38 GMT
• Title: Table tennis ball spin estimation with an event camera
• Authors: Thomas Gossard, Julian Krismer, Andreas Ziegler, Jonas Tebbe, Andreas Zell,
• Abstract summary: In table tennis, the combination of high velocity and spin renders traditional low frame rate cameras inadequate. We present the first method for table tennis spin estimation using an event camera. We achieve a spin magnitude mean error of $10.7 pm 17.3$ rps and a spin axis mean error of $32.9 pm 38.2deg$ in real time for a flying ball.
• Score: 11.735290341808064
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Spin plays a pivotal role in ball-based sports. Estimating spin becomes a key skill due to its impact on the ball's trajectory and bouncing behavior. Spin cannot be observed directly, making it inherently challenging to estimate. In table tennis, the combination of high velocity and spin renders traditional low frame rate cameras inadequate for quickly and accurately observing the ball's logo to estimate the spin due to the motion blur. Event cameras do not suffer as much from motion blur, thanks to their high temporal resolution. Moreover, the sparse nature of the event stream solves communication bandwidth limitations many frame cameras face. To the best of our knowledge, we present the first method for table tennis spin estimation using an event camera. We use ordinal time surfaces to track the ball and then isolate the events generated by the logo on the ball. Optical flow is then estimated from the extracted events to infer the ball's spin. We achieved a spin magnitude mean error of $10.7 \pm 17.3$ rps and a spin axis mean error of $32.9 \pm 38.2\deg$ in real time for a flying ball.

Related papers

• Deblur e-NeRF: NeRF from Motion-Blurred Events under High-speed or Low-light Conditions [56.84882059011291]
  We propose Deblur e-NeRF, a novel method to reconstruct blur-minimal NeRFs from motion-red events. We also introduce a novel threshold-normalized total variation loss to improve the regularization of large textureless patches.
  arXiv  Detail & Related papers  (2024-09-26T15:57:20Z)
• Investigating Event-Based Cameras for Video Frame Interpolation in Sports [59.755469098797406]
  We present a first investigation of event-based Video Frame Interpolation (VFI) models for generating sports slow-motion videos. Particularly, we design and implement a bi-camera recording setup, including an RGB and an event-based camera to capture sports videos, to temporally align and spatially register both cameras. Our experimental validation demonstrates that TimeLens, an off-the-shelf event-based VFI model, can effectively generate slow-motion footage for sports videos.
  arXiv  Detail & Related papers  (2024-07-02T15:39:08Z)
• A multi-modal table tennis robot system [12.590158763556186]
  We present an improved table tennis robot system with high accuracy vision detection and fast robot reaction. Based on previous work, our system contains a KUKA robot arm with 6 DOF, with four frame-based cameras and two additional event-based cameras.
  arXiv  Detail & Related papers  (2023-10-29T16:35:29Z)
• Black-Box vs. Gray-Box: A Case Study on Learning Table Tennis Ball Trajectory Prediction with Spin and Impacts [12.103456313315764]
  We present a method for table tennis ball trajectory filtering and prediction. We use data to learn parameters of the dynamics model, of an extended Kalman filter, and of a neural model that infers the ball's initial condition.
  arXiv  Detail & Related papers  (2023-05-24T14:28:22Z)
• EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks [107.62975594230687]
  We demonstrate an application where event cameras excel: accurately estimating the impact location of fast-moving objects. We introduce a lightweight event representation called Binary Event History Image (BEHI) to encode event data at low latency. We show that the system is capable of achieving a success rate of 81% in catching balls targeted at different locations, with a velocity of up to 13 m/s even on compute-constrained embedded platforms.
  arXiv  Detail & Related papers  (2023-04-14T15:23:28Z)
• EvConv: Fast CNN Inference on Event Camera Inputs For High-Speed Robot Perception [1.3869227429939426]
  Event cameras capture visual information with a high temporal resolution and a wide dynamic range. Current convolutional neural network inference on event camera streams cannot currently perform real-time inference at the high speeds at which event cameras operate. This paper presents EvConv, a new approach to enable fast inference on CNNs for inputs from event cameras.
  arXiv  Detail & Related papers  (2023-03-08T15:47:13Z)
• SpinDOE: A ball spin estimation method for table tennis robot [15.28960454647216]
  Spin plays a considerable role in table tennis, making a shot's trajectory harder to read and predict. Existing methods either require extremely high framerate cameras or are unreliable because they use the ball's logo. This paper proposes an easily implementable and reliable spin estimation method.
  arXiv  Detail & Related papers  (2023-03-07T13:24:40Z)
• 3D Moments from Near-Duplicate Photos [67.15199743223332]
  3D Moments is a new computational photography effect. We produce a video that smoothly interpolates the scene motion from the first photo to the second. Our system produces photorealistic space-time videos with motion parallax and scene dynamics.
  arXiv  Detail & Related papers  (2022-05-12T17:56:18Z)
• TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolation [78.99283105497489]
  Event camera is a new device to enable video at the presence of arbitrarily complex motion. This paper proposes a novel TimeReplayer algorithm to interpolate videos captured by commodity cameras with events.
  arXiv  Detail & Related papers  (2022-03-25T18:57:42Z)
• Learning to Play Cup-and-Ball with Noisy Camera Observations [2.6931502677545947]
  We present a learning model based control strategy for the cup-and-ball game. A Universal Robots UR5e manipulator arm learns to catch a ball in one of the cups on a Kendama.
  arXiv  Detail & Related papers  (2020-07-19T02:22:36Z)
• Event-Based Angular Velocity Regression with Spiking Networks [51.145071093099396]
  Spiking Neural Networks (SNNs) process information conveyed as temporal spikes rather than numeric values. We propose, for the first time, a temporal regression problem of numerical values given events from an event camera. We show that we can successfully train an SNN to perform angular velocity regression.
  arXiv  Detail & Related papers  (2020-03-05T17:37:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.