SpinDOE: A ball spin estimation method for table tennis robot

• URL: http://arxiv.org/abs/2303.03879v1
• Date: Tue, 7 Mar 2023 13:24:40 GMT
• Title: SpinDOE: A ball spin estimation method for table tennis robot
• Authors: Thomas Gossard, Jonas Tebbe, Andreas Ziegler and Andreas Zell
• Abstract summary: Spin plays a considerable role in table tennis, making a shot's trajectory harder to read and predict. Existing methods either require extremely high framerate cameras or are unreliable because they use the ball's logo. This paper proposes an easily implementable and reliable spin estimation method.
• Score: 15.28960454647216
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Spin plays a considerable role in table tennis, making a shot's trajectory harder to read and predict. However, the spin is challenging to measure because of the ball's high velocity and the magnitude of the spin values. Existing methods either require extremely high framerate cameras or are unreliable because they use the ball's logo, which may not always be visible. Because of this, many table tennis-playing robots ignore the spin, which severely limits their capabilities. This paper proposes an easily implementable and reliable spin estimation method. We developed a dotted-ball orientation estimation (DOE) method, that can then be used to estimate the spin. The dots are first localized on the image using a CNN and then identified using geometric hashing. The spin is finally regressed from the estimated orientations. Using our algorithm, the ball's orientation can be estimated with a mean error of 2.4{\deg} and the spin estimation has an relative error lower than 1%. Spins up to 175 rps are measurable with a camera of 350 fps in real time. Using our method, we generated a dataset of table tennis ball trajectories with position and spin, available on our project page.

Related papers

• Pose2Trajectory: Using Transformers on Body Pose to Predict Tennis Player's Trajectory [6.349503549199403]
  We propose Pose2Trajectory, which predicts a tennis player's future trajectory as a sequence derived from their body joints' data and ball position. We use encoder-decoder Transformer architecture trained on the joints and trajectory information of the players with ball positions. We generate a high-quality dataset from multiple videos to assist tennis player movement prediction using object detection and human pose estimation methods.
  arXiv  Detail & Related papers  (2024-11-07T07:50:58Z)
• Lessons from Learning to Spin "Pens" [51.9182692233916]
  In this work, we push the boundaries of learning-based in-hand manipulation systems by demonstrating the capability to spin pen-like objects. We first use reinforcement learning to train an oracle policy with privileged information and generate a high-fidelity trajectory dataset in simulation. We then fine-tune the sensorimotor policy using these real-world trajectories to adapt it to the real world dynamics.
  arXiv  Detail & Related papers  (2024-07-26T17:56:01Z)
• Table tennis ball spin estimation with an event camera [11.735290341808064]
  In table tennis, the combination of high velocity and spin renders traditional low frame rate cameras inadequate. We present the first method for table tennis spin estimation using an event camera. We achieve a spin magnitude mean error of $10.7 pm 17.3$ rps and a spin axis mean error of $32.9 pm 38.2deg$ in real time for a flying ball.
  arXiv  Detail & Related papers  (2024-04-15T15:36:38Z)
• A multi-modal table tennis robot system [12.590158763556186]
  We present an improved table tennis robot system with high accuracy vision detection and fast robot reaction. Based on previous work, our system contains a KUKA robot arm with 6 DOF, with four frame-based cameras and two additional event-based cameras.
  arXiv  Detail & Related papers  (2023-10-29T16:35:29Z)
• Black-Box vs. Gray-Box: A Case Study on Learning Table Tennis Ball Trajectory Prediction with Spin and Impacts [12.103456313315764]
  We present a method for table tennis ball trajectory filtering and prediction. We use data to learn parameters of the dynamics model, of an extended Kalman filter, and of a neural model that infers the ball's initial condition.
  arXiv  Detail & Related papers  (2023-05-24T14:28:22Z)
• Monocular Visual Analysis for Electronic Line Calling of Tennis Games [57.14812636359967]
  Electronic Line Calling is an auxiliary referee system used for tennis matches based on binocular vision technology. We propose a monocular vision technology based ELC method. We find out whether the bouncing point of the ball is out of bounds or not according to the relative position between the bouncing point and the court side line in the two dimensional image.
  arXiv  Detail & Related papers  (2021-07-20T04:23:11Z)
• Back to the Feature: Learning Robust Camera Localization from Pixels to Pose [114.89389528198738]
  We introduce PixLoc, a scene-agnostic neural network that estimates an accurate 6-DoF pose from an image and a 3D model. The system can localize in large environments given coarse pose priors but also improve the accuracy of sparse feature matching.
  arXiv  Detail & Related papers  (2021-03-16T17:40:12Z)
• Sample-efficient Reinforcement Learning in Robotic Table Tennis [14.552652489374761]
  Reinforcement learning (RL) has achieved some impressive recent successes in various computer games and simulations. We present a sample-efficient RL algorithm applied to the example of a table tennis robot. Our approach performs competitively both in a simulation and on the real robot in a number of challenging scenarios.
  arXiv  Detail & Related papers  (2020-11-06T10:42:41Z)
• Position and spin in relativistic quantum mechanics [68.8204255655161]
  The position and spin operators in the Foldy-Wouthuysen representation are quantum-mechanical counterparts of the classical position and spin variables. The spin-orbit interaction does not exist for a free particle if the conventional operators of the orbital angular momentum and the rest-frame spin are used.
  arXiv  Detail & Related papers  (2020-03-14T07:49:40Z)
• Robust 6D Object Pose Estimation by Learning RGB-D Features [59.580366107770764]
  We propose a novel discrete-continuous formulation for rotation regression to resolve this local-optimum problem. We uniformly sample rotation anchors in SO(3), and predict a constrained deviation from each anchor to the target, as well as uncertainty scores for selecting the best prediction. Experiments on two benchmarks: LINEMOD and YCB-Video, show that the proposed method outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-02-29T06:24:55Z)
• Pedestrian orientation dynamics from high-fidelity measurements [65.06084067891364]
  We propose a novel measurement method based on a deep neural architecture that we train on the basis of generic physical properties of the motion of pedestrians. We show that our method is capable of estimating orientation with an error as low as 7.5 degrees. This tool opens up new possibilities in the studies of human crowd dynamics where orientation is key.
  arXiv  Detail & Related papers  (2020-01-14T07:08:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.