A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games

• URL: http://arxiv.org/abs/2507.20670v1
• Date: Mon, 28 Jul 2025 09:51:49 GMT
• Title: A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games
• Abstract summary: This paper presents a multimodal architecture for predicting future player locations on a dynamic time horizon.<n>The architecture makes efficient use of the multimodal game state including image inputs, numerical and categorical features, as well as dynamic game data.
• Score: 42.059466998190224
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding and predicting player movement in multiplayer games is crucial for achieving use cases such as player-mimicking bot navigation, preemptive bot control, strategy recommendation, and real-time player behavior analytics. However, the complex environments allow for a high degree of navigational freedom, and the interactions and team-play between players require models that make effective use of the available heterogeneous input data. This paper presents a multimodal architecture for predicting future player locations on a dynamic time horizon, using a U-Net-based approach for calculating endpoint location probability heatmaps, conditioned using a multimodal feature encoder. The application of a multi-head attention mechanism for different groups of features allows for communication between agents. In doing so, the architecture makes efficient use of the multimodal game state including image inputs, numerical and categorical features, as well as dynamic game data. Consequently, the presented technique lays the foundation for various downstream tasks that rely on future player positions such as the creation of player-predictive bot behavior or player anomaly detection.

Related papers

• Multi-Task Learning for Heterogeneous Prediction from Video Game State with Transfer Learning [41.132061576291065]
  Multi-task learning is a promising approach for prediction tasks derived from video game state data.<n>We study whether a shared model trained jointly across tasks in team-based multiplayer games can improve generalization.
  arXiv  Detail & Related papers  (2026-07-23T13:12:51Z)
• GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents [76.60994803070436]
  GameWorld is a benchmark for evaluation of Multimodal Large Language Model (MLLM) game agents in browser environments.<n>Two game agent interfaces are studied: (i) computer-use agents that directly emit keyboard and mouse controls, and (ii) generalist multimodal agents that act in a semantic action space.<n>Results across 18 model-interface pairs suggest that even the best performing agent is far from achieving human capabilities on video games.
  arXiv  Detail & Related papers  (2026-04-08T17:49:03Z)
• Learning Controllable and Diverse Player Behaviors in Multi-Agent Environments [0.0]
  This paper introduces a reinforcement learning framework that enables controllable and diverse player behaviors without relying on human gameplay data.<n>We define player behavior in an N-dimensional continuous space and uniformly sample target behavior vectors from a region that encompasses a subset representing real human styles.<n>A single PPO-based multi-agent policy can reproduce new or unseen play styles without retraining.
  arXiv  Detail & Related papers  (2025-12-11T17:26:24Z)
• FOOTPASS: A Multi-Modal Multi-Agent Tactical Context Dataset for Play-by-Play Action Spotting in Soccer Broadcast Videos [1.264619835497501]
  We introduce Footovision Play-by-Play Spot Actionting in Soccer dataset (FOOTPASS)<n>It is the first benchmark for play-by-play action spotting over entire soccer matches in a multi-agent tactical context.<n>It enables the development of methods for player-centric action spotting that exploit both outputs from computer-vision tasks and prior knowledge of soccer.
  arXiv  Detail & Related papers  (2025-11-20T09:42:28Z)
• Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agents [56.25101378553328]
  We present Game-TARS, a generalist game agent trained with a unified, scalable action space anchored to human-aligned keyboard-mouse inputs.<n>Game-TARS is pre-trained on over 500B tokens with diverse trajectories and multimodal data.<n> Experiments show that Game-TARS achieves about 2 times the success rate over the previous sota model on open-world Minecraft tasks.
  arXiv  Detail & Related papers  (2025-10-27T17:43:51Z)
• Expandable Decision-Making States for Multi-Agent Deep Reinforcement Learning in Soccer Tactical Analysis [6.8055385768376615]
  Invasion team sports such as soccer produce a high-dimensional, strongly coupled state space as many players interact on a shared field.<n>Traditional rule-based analyses are intuitive, while modern predictive machine learning models often perform pattern-matching without explicit agent representations.<n>Here, we propose Expandable Decision-Making States (EDMS), a semantically enriched state representation that augments raw positions and velocities with relational variables.
  arXiv  Detail & Related papers  (2025-10-01T04:01:51Z)
• Multi-Transmotion: Pre-trained Model for Human Motion Prediction [68.87010221355223]
  Multi-Transmotion is an innovative transformer-based model designed for cross-modality pre-training. Our methodology demonstrates competitive performance across various datasets on several downstream tasks.
  arXiv  Detail & Related papers  (2024-11-04T23:15:21Z)
• DeepInteraction++: Multi-Modality Interaction for Autonomous Driving [80.8837864849534]
  We introduce a novel modality interaction strategy that allows individual per-modality representations to be learned and maintained throughout.<n>DeepInteraction++ is a multi-modal interaction framework characterized by a multi-modal representational interaction encoder and a multi-modal predictive interaction decoder.<n>Experiments demonstrate the superior performance of the proposed framework on both 3D object detection and end-to-end autonomous driving tasks.
  arXiv  Detail & Related papers  (2024-08-09T14:04:21Z)
• Sports-Traj: A Unified Trajectory Generation Model for Multi-Agent Movement in Sports [53.637837706712794]
  We propose a Unified Trajectory Generation model, UniTraj, that processes arbitrary trajectories as masked inputs.<n>Specifically, we introduce a Ghost Spatial Masking (GSM) module, embedded within a Transformer encoder, for spatial feature extraction.<n>We benchmark three practical sports datasets, Basketball-U, Football-U, and Soccer-U, for evaluation.
  arXiv  Detail & Related papers  (2024-05-27T22:15:23Z)
• Who You Play Affects How You Play: Predicting Sports Performance Using Graph Attention Networks With Temporal Convolution [29.478765505215538]
  This study presents a novel deep learning method, called GATv2-GCN, for predicting player performance in sports. We use a graph attention network to capture the attention that each player pays to each other, allowing for more accurate modeling. We evaluate the performance of our model using real-world sports data, demonstrating its effectiveness in predicting player performance.
  arXiv  Detail & Related papers  (2023-03-29T14:48:51Z)
• Graph Neural Networks to Predict Sports Outcomes [0.0]
  We introduce a sport-agnostic graph-based representation of game states. We then use our proposed graph representation as input to graph neural networks to predict sports outcomes.
  arXiv  Detail & Related papers  (2022-07-28T14:45:02Z)
• Collusion Detection in Team-Based Multiplayer Games [57.153233321515984]
  We propose a system that detects colluding behaviors in team-based multiplayer games. The proposed method analyzes the players' social relationships paired with their in-game behavioral patterns. We then automate the detection using Isolation Forest, an unsupervised learning technique specialized in highlighting outliers.
  arXiv  Detail & Related papers  (2022-03-10T02:37:39Z)
• Predicting the outcome of team movements -- Player time series analysis using fuzzy and deep methods for representation learning [0.0]
  We provide a framework for the useful encoding of short tactics and space occupations in a more extended sequence of movements or tactical plans. We discuss the effectiveness of the proposed approach for prediction and recognition tasks on the professional basketball SportVU dataset for the 2015-16 half-season.
  arXiv  Detail & Related papers  (2021-09-13T18:42:37Z)
• Time-series Imputation of Temporally-occluded Multiagent Trajectories [18.862173210927658]
  We study the problem of multiagent time-series imputation, where available past and future observations of subsets of agents are used to estimate missing observations for other agents. Our approach, called the Graph Imputer, uses forward- and backward-information in combination with graph networks and variational autoencoders. We evaluate our approach on a dataset of football matches, using a projective camera module to train and evaluate our model for the off-screen player state estimation setting.
  arXiv  Detail & Related papers  (2021-06-08T09:58:43Z)
• Learning to Simulate Dynamic Environments with GameGAN [109.25308647431952]
  In this paper, we aim to learn a simulator by simply watching an agent interact with an environment. We introduce GameGAN, a generative model that learns to visually imitate a desired game by ingesting screenplay and keyboard actions during training.
  arXiv  Detail & Related papers  (2020-05-25T14:10:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.