LATTE-MV: Learning to Anticipate Table Tennis Hits from Monocular Videos

• URL: http://arxiv.org/abs/2503.20936v1
• Date: Wed, 26 Mar 2025 19:11:22 GMT
• Title: LATTE-MV: Learning to Anticipate Table Tennis Hits from Monocular Videos
• Authors: Daniel Etaat, Dvij Kalaria, Nima Rahmanian, Shankar Sastry,
• Abstract summary: This paper contributes a scalable system for reconstructing monocular video of table tennis matches in 3D and an uncertainty-aware controller that anticipates opponent actions.<n>We demonstrate in simulation that our policy improves the ball return rate against high-speed hits from 49.9% to 59.0% as compared to a baseline non-anticipatory policy.
• Score: 1.8499314936771563
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Physical agility is a necessary skill in competitive table tennis, but by no means sufficient. Champions excel in this fast-paced and highly dynamic environment by anticipating their opponent's intent - buying themselves the necessary time to react. In this work, we take one step towards designing such an anticipatory agent. Previous works have developed systems capable of real-time table tennis gameplay, though they often do not leverage anticipation. Among the works that forecast opponent actions, their approaches are limited by dataset size and variety. Our paper contributes (1) a scalable system for reconstructing monocular video of table tennis matches in 3D and (2) an uncertainty-aware controller that anticipates opponent actions. We demonstrate in simulation that our policy improves the ball return rate against high-speed hits from 49.9% to 59.0% as compared to a baseline non-anticipatory policy.

Related papers

• Action Anticipation from SoccerNet Football Video Broadcasts [84.87912817065506]
  We introduce the task of action anticipation for football broadcast videos. We predict future actions in unobserved future frames within a five- or ten-second anticipation window. Our work will enable applications in automated broadcasting, tactical analysis, and player decision-making.
  arXiv  Detail & Related papers  (2025-04-16T12:24:33Z)
• An Event-Based Perception Pipeline for a Table Tennis Robot [12.101426862186072]
  We present the first real-time perception pipeline for a table tennis robot that uses only event-based cameras.<n>We show that compared to a frame-based pipeline, event-based perception pipelines have an update rate which is an order of magnitude higher.
  arXiv  Detail & Related papers  (2025-02-02T10:56:37Z)
• Match Point AI: A Novel AI Framework for Evaluating Data-Driven Tennis Strategies [46.1232919707345]
  We present the tennis match simulation environment textitMatch Point AI, in which different agents can compete against real-world data-driven bot strategies. First experiments show that generated shot-by-shot data of simulated tennis matches show realistic characteristics when compared to real-world data. At the same time, reasonable shot placement strategies emerge, which share similarities to the ones found in real-world tennis matches.
  arXiv  Detail & Related papers  (2024-08-12T07:22:46Z)
• Expected Possession Value of Control and Duel Actions for Soccer Player's Skills Estimation [0.0]
  This paper introduces multiple extensions to a widely used model, expected possession value (EPV) We assign greater weights to events occurring immediately prior to the shot rather than those preceding them (decay effect) Our model incorporates possession risk more accurately by considering the decay effect and effective playing time.
  arXiv  Detail & Related papers  (2024-06-02T17:29:42Z)
• Predicting Outcomes in Video Games with Long Short Term Memory Networks [0.39723189359605243]
  Our work attempts to enhance audience engagement within video game tournaments by introducing a real-time method of predicting wins. As a proof of concept, we evaluate our model's performance within a classic, two-player arcade game, Super Street Fighter II Turbo.
  arXiv  Detail & Related papers  (2024-02-24T22:36:23Z)
• Engineering Features to Improve Pass Prediction in Soccer Simulation 2D Games [0.0]
  Soccer Simulation 2D (SS2D) is a simulation of a real soccer game in two dimensions. We have tried to address the modeling of passing behavior of soccer 2D players using Deep Neural Networks (DNN) and Random Forest (RF) We evaluate the trained models' performance playing against 6 top teams of RoboCup 2019 that have distinctive playing strategies.
  arXiv  Detail & Related papers  (2024-01-07T08:01:25Z)
• All by Myself: Learning Individualized Competitive Behaviour with a Contrastive Reinforcement Learning optimization [57.615269148301515]
  In a competitive game scenario, a set of agents have to learn decisions that maximize their goals and minimize their adversaries' goals at the same time. We propose a novel model composed of three neural layers that learn a representation of a competitive game, learn how to map the strategy of specific opponents, and how to disrupt them. Our experiments demonstrate that our model achieves better performance when playing against offline, online, and competitive-specific models, in particular when playing against the same opponent multiple times.
  arXiv  Detail & Related papers  (2023-10-02T08:11:07Z)
• Nash Equilibria and Pitfalls of Adversarial Training in Adversarial Robustness Games [51.90475640044073]
  We study adversarial training as an alternating best-response strategy in a 2-player zero-sum game. On the other hand, a unique pure Nash equilibrium of the game exists and is provably robust.
  arXiv  Detail & Related papers  (2022-10-23T03:21:01Z)
• L2E: Learning to Exploit Your Opponent [66.66334543946672]
  We propose a novel Learning to Exploit framework for implicit opponent modeling. L2E acquires the ability to exploit opponents by a few interactions with different opponents during training. We propose a novel opponent strategy generation algorithm that produces effective opponents for training automatically.
  arXiv  Detail & Related papers  (2021-02-18T14:27:59Z)
• Interpretable Real-Time Win Prediction for Honor of Kings, a Popular Mobile MOBA Esport [51.20042288437171]
  We propose a Two-Stage Spatial-Temporal Network (TSSTN) that can provide accurate real-time win predictions. Experiment results and applications in real-world live streaming scenarios showed that the proposed TSSTN model is effective both in prediction accuracy and interpretability.
  arXiv  Detail & Related papers  (2020-08-14T12:00:58Z)
• Learning to Play Sequential Games versus Unknown Opponents [93.8672371143881]
  We consider a repeated sequential game between a learner, who plays first, and an opponent who responds to the chosen action. We propose a novel algorithm for the learner when playing against an adversarial sequence of opponents. Our results include algorithm's regret guarantees that depend on the regularity of the opponent's response.
  arXiv  Detail & Related papers  (2020-07-10T09:33:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.