Offline Imitation of Badminton Player Behavior via Experiential Contexts and Brownian Motion

• URL: http://arxiv.org/abs/2403.12406v2
• Date: Sat, 3 Aug 2024 06:36:17 GMT
• Title: Offline Imitation of Badminton Player Behavior via Experiential Contexts and Brownian Motion
• Authors: Kuang-Da Wang, Wei-Yao Wang, Ping-Chun Hsieh, Wen-Chih Peng,
• Abstract summary: RallyNet is a hierarchical offline imitation learning model for badminton player behaviors. We extensively validate RallyNet with the largest available real-world badminton dataset. Results reveal RallyNet's superiority over offline imitation learning methods and state-of-the-art turn-based approaches.
• Score: 19.215240805688836
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the dynamic and rapid tactic involvements of turn-based sports, badminton stands out as an intrinsic paradigm that requires alter-dependent decision-making of players. While the advancement of learning from offline expert data in sequential decision-making has been witnessed in various domains, how to rally-wise imitate the behaviors of human players from offline badminton matches has remained underexplored. Replicating opponents' behavior benefits players by allowing them to undergo strategic development with direction before matches. However, directly applying existing methods suffers from the inherent hierarchy of the match and the compounding effect due to the turn-based nature of players alternatively taking actions. In this paper, we propose RallyNet, a novel hierarchical offline imitation learning model for badminton player behaviors: (i) RallyNet captures players' decision dependencies by modeling decision-making processes as a contextual Markov decision process. (ii) RallyNet leverages the experience to generate context as the agent's intent in the rally. (iii) To generate more realistic behavior, RallyNet leverages Geometric Brownian Motion (GBM) to model the interactions between players by introducing a valuable inductive bias for learning player behaviors. In this manner, RallyNet links player intents with interaction models with GBM, providing an understanding of interactions for sports analytics. We extensively validate RallyNet with the largest available real-world badminton dataset consisting of men's and women's singles, demonstrating its ability to imitate player behaviors. Results reveal RallyNet's superiority over offline imitation learning methods and state-of-the-art turn-based approaches, outperforming them by at least 16% in mean rule-based agent normalization score. Furthermore, we discuss various practical use cases to highlight RallyNet's applicability.

Related papers

• Playpen: An Environment for Exploring Learning Through Conversational Interaction [81.67330926729015]
  We investigate whether Dialogue Games can also serve as a source of feedback signals for learning.<n>We introduce Playpen, an environment for off- and online learning through Dialogue Game self-play.<n>We find that imitation learning through SFT improves performance on unseen instances, but negatively impacts other skills.
  arXiv  Detail & Related papers  (2025-04-11T14:49:33Z)
• player2vec: A Language Modeling Approach to Understand Player Behavior in Games [2.2216044069240657]
  Methods for learning latent user representations from historical behavior logs have gained traction for recommendation tasks in e-commerce, content streaming, and other settings. We present a novel method for overcoming this limitation by extending a long-range Transformer model to player behavior data. We discuss specifics of behavior tracking in games and propose preprocessing and tokenization approaches by viewing in-game events in an analogous way to words in sentences.
  arXiv  Detail & Related papers  (2024-04-05T17:29:47Z)
• Feint Behaviors and Strategies: Formalization, Implementation and Evaluation [6.61661097573508]
  Feint behaviors are crucial tactics in most competitive multi-player games.<n>We introduce the first comprehensive formalization of Feint behaviors at both action-level and strategy-level.<n>We provide concrete implementation and quantitative evaluation of them in multi-player games.
  arXiv  Detail & Related papers  (2024-03-04T03:43:45Z)
• ShuttleSHAP: A Turn-Based Feature Attribution Approach for Analyzing Forecasting Models in Badminton [52.21869064818728]
  Deep learning approaches for player tactic forecasting in badminton show promising performance partially attributed to effective reasoning about rally-player interactions. We propose a turn-based feature attribution approach, ShuttleSHAP, for analyzing forecasting models in badminton based on variants of Shapley values.
  arXiv  Detail & Related papers  (2023-12-18T05:37:51Z)
• All by Myself: Learning Individualized Competitive Behaviour with a Contrastive Reinforcement Learning optimization [57.615269148301515]
  In a competitive game scenario, a set of agents have to learn decisions that maximize their goals and minimize their adversaries' goals at the same time. We propose a novel model composed of three neural layers that learn a representation of a competitive game, learn how to map the strategy of specific opponents, and how to disrupt them. Our experiments demonstrate that our model achieves better performance when playing against offline, online, and competitive-specific models, in particular when playing against the same opponent multiple times.
  arXiv  Detail & Related papers  (2023-10-02T08:11:07Z)
• Who You Play Affects How You Play: Predicting Sports Performance Using Graph Attention Networks With Temporal Convolution [29.478765505215538]
  This study presents a novel deep learning method, called GATv2-GCN, for predicting player performance in sports. We use a graph attention network to capture the attention that each player pays to each other, allowing for more accurate modeling. We evaluate the performance of our model using real-world sports data, demonstrating its effectiveness in predicting player performance.
  arXiv  Detail & Related papers  (2023-03-29T14:48:51Z)
• Where Will Players Move Next? Dynamic Graphs and Hierarchical Fusion for Movement Forecasting in Badminton [6.2405734957622245]
  We focus on predicting what types of returning strokes will be made, and where players will move to based on previous strokes. Existing sequence-based models neglect the effects of interactions between players, and graph-based models still suffer from multifaceted perspectives. We propose a novel Dynamic Graphs and Hierarchical Fusion for Movement Forecasting model (DyMF) with interaction style extractors.
  arXiv  Detail & Related papers  (2022-11-22T12:21:24Z)
• Incorporating Rivalry in Reinforcement Learning for a Competitive Game [65.2200847818153]
  This work proposes a novel reinforcement learning mechanism based on the social impact of rivalry behavior. Our proposed model aggregates objective and social perception mechanisms to derive a rivalry score that is used to modulate the learning of artificial agents.
  arXiv  Detail & Related papers  (2022-08-22T14:06:06Z)
• ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badminton [18.524164548051417]
  This paper focuses on objectively judging what and where to return strokes in turn-based sports. We propose a novel Position-aware Fusion of Rally Progress and Player Styles framework (ShuttleNet) that incorporates rally progress and information of the players.
  arXiv  Detail & Related papers  (2021-12-02T08:14:23Z)
• Exploring the Long Short-Term Dependencies to Infer Shot Influence in Badminton Matches [9.553207911311926]
  We introduce a badminton language to fully describe the process of the shot. We propose a deep learning model composed of a novel short-term extractor and a long-term encoder. Our model incorporates an attention mechanism to enable the transparency of the action sequence to the rally result.
  arXiv  Detail & Related papers  (2021-09-14T04:44:40Z)
• Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts [86.56462654572813]
  We focus our analysis on action spotting in soccer broadcast, which consists in temporally localizing the main actions in a soccer game. We propose a novel feature pooling method based on NetVLAD, dubbed NetVLAD++, that embeds temporally-aware knowledge. We train and evaluate our methodology on the recent large-scale dataset SoccerNet-v2, reaching 53.4% Average-mAP for action spotting.
  arXiv  Detail & Related papers  (2021-04-14T11:09:03Z)
• Moody Learners -- Explaining Competitive Behaviour of Reinforcement Learning Agents [65.2200847818153]
  In a competitive scenario, the agent does not only have a dynamic environment but also is directly affected by the opponents' actions. Observing the Q-values of the agent is usually a way of explaining its behavior, however, do not show the temporal-relation between the selected actions.
  arXiv  Detail & Related papers  (2020-07-30T11:30:42Z)
• Learning to Play Sequential Games versus Unknown Opponents [93.8672371143881]
  We consider a repeated sequential game between a learner, who plays first, and an opponent who responds to the chosen action. We propose a novel algorithm for the learner when playing against an adversarial sequence of opponents. Our results include algorithm's regret guarantees that depend on the regularity of the opponent's response.
  arXiv  Detail & Related papers  (2020-07-10T09:33:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.