Adversarial Reinforcement Learning Framework for ESP Cheater Simulation

• URL: http://arxiv.org/abs/2509.24274v1
• Date: Mon, 29 Sep 2025 04:32:45 GMT
• Title: Adversarial Reinforcement Learning Framework for ESP Cheater Simulation
• Abstract summary: Extra-Sensory Perception (ESP) cheats are difficult to detect because their effects are not directly observable in player behavior.<n>We propose a simulation framework for controlled modeling of ESP cheaters, non-cheaters, and trajectory-based detectors.
• Score: 27.73673717943896
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Extra-Sensory Perception (ESP) cheats, which reveal hidden in-game information such as enemy locations, are difficult to detect because their effects are not directly observable in player behavior. The lack of observable evidence makes it difficult to collect reliably labeled data, which is essential for training effective anti-cheat systems. Furthermore, cheaters often adapt their behavior by limiting or disguising their cheat usage, which further complicates detection and detector development. To address these challenges, we propose a simulation framework for controlled modeling of ESP cheaters, non-cheaters, and trajectory-based detectors. We model cheaters and non-cheaters as reinforcement learning agents with different levels of observability, while detectors classify their behavioral trajectories. Next, we formulate the interaction between the cheater and the detector as an adversarial game, allowing both players to co-adapt over time. To reflect realistic cheater strategies, we introduce a structured cheater model that dynamically switches between cheating and non-cheating behaviors based on detection risk. Experiments demonstrate that our framework successfully simulates adaptive cheater behaviors that strategically balance reward optimization and detection evasion. This work provides a controllable and extensible platform for studying adaptive cheating behaviors and developing effective cheat detectors.

Related papers

• Cheating in Multiplayer Online Games: a Dataset [1.140634831132165]
  This paper presents a dataset compiling records of game sessions played by both real players and automated game clients.<n>To the best of our knowledge, this is the first dataset that provides logs of network flow disruption cheats.<n>This dataset can be used by researchers in academia and industry seeking to develop cheating detection mechanisms for online games.
  arXiv  Detail & Related papers  (2026-06-04T11:03:18Z)
• Detecting Aimbot Cheaters in MOGs [2.326937537253793]
  We present a novel proactive defense strategy that deploys adversarial patches to mitigate the presence of visual aimbot cheaters.<n>Our approach centers on deliberately triggering the cheaters' object model, enabling either direct detection, or rendering the game unplayable for the cheater via patch flooding on their viewport.<n>We evaluate our approach on various criteria; analyzing the effectiveness of different patch sizes, scalability of patches to different screen resolutions, efficacy against diverse visual aimbot cheat configurations and also explore various YOLO models to assess patch transferability.
  arXiv  Detail & Related papers  (2026-06-02T13:44:55Z)
• Do Synthetic Trajectories Reflect Real Reward Hacking? A Systematic Study on Monitoring In-the-Wild Hacking in Code Generation [53.024513172383195]
  We present a systematic analysis of the synthetic vs. in-the-wild discrepancy in reward hacking.<n>We examine what extent hacking behaviors induced by prompting resemble those emerging during RL training.<n>We find that synthetic-data-trained monitors fail to generalize to "in-the-wild" hacking.
  arXiv  Detail & Related papers  (2026-04-26T01:26:50Z)
• IR$^3$: Contrastive Inverse Reinforcement Learning for Interpretable Detection and Mitigation of Reward Hacking [67.20568716300272]
  Reinforcement Learning from Human Feedback (RLHF) enables powerful LLM alignment but can introduce reward hacking.<n>We introduce IR3 (Interpretable Reward Reconstruction and Rectification), a framework that reverse-engineers, interprets, and surgically repairs the implicit objectives driving RLHF-tuned models.<n>We show that IR3 achieves 0.89 correlation with ground-truth rewards, identifies hacking features with over 90% precision, and significantly reduces hacking behaviors while maintaining capabilities within 3% of the original model.
  arXiv  Detail & Related papers  (2026-02-23T01:14:53Z)
• Adversarial Reward Auditing for Active Detection and Mitigation of Reward Hacking [69.06218054848803]
  We propose Adrial Reward Auditing (ARA), a framework that reconceptualizes reward hacking as a dynamic, competitive game.<n>ARA operates in two stages: first, a Hacker policy discovers reward model vulnerabilities while an Auditor learns to detect exploitation from latent representations.<n>ARA achieves the best alignment-utility tradeoff among all baselines.
  arXiv  Detail & Related papers  (2026-02-02T07:34:57Z)
• XGuardian: Towards Explainable and Generalized AI Anti-Cheat on FPS Games [13.543176436045833]
  Aim-assist cheats are the most prevalent and infamous form of cheating in First-Person Shooter (FPS) games.<n>XGuardian is a server-side generalized and explainable system for detecting aim-assist cheats.
  arXiv  Detail & Related papers  (2026-01-26T01:57:15Z)
• Gynopticon: Consensus-Based Cheating Detection System for Competitive Games [0.0]
  Cheating in online games poses significant threats to the gaming industry.<n>Most prior research has concentrated on Massively Multiplayer Online Role-Playing Games (MMORPGs)<n>We propose GYNOPTICON, a novel cheating detection framework that leverages user consensus to identify abnormal behavior.
  arXiv  Detail & Related papers  (2025-11-14T06:28:24Z)
• AntiCheatPT: A Transformer-Based Approach to Cheat Detection in Competitive Computer Games [0.0]
  Anti-cheat systems face challenges in keeping pace with evolving cheating methods without imposing invasive measures on users' systems.<n>This paper presents AntiCheatPT_256, a transformer-based machine learning model designed to detect cheating behaviour in Counter-Strike 2 using gameplay data.
  arXiv  Detail & Related papers  (2025-08-08T14:22:41Z)
• VIC: Evasive Video Game Cheating via Virtual Machine Introspection [1.7495213911983414]
  Video game cheats modify a video game behaviour to give unfair advantages to some players.<n>This destroys the experience of online gaming and can result in financial losses for game developers.<n>We present a new type of game cheat, Virtual machine Introspection Cheat (VIC), that takes advantage of virtual machines to execute stealthy game cheats.
  arXiv  Detail & Related papers  (2025-02-17T20:54:56Z)
• Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objects [107.47530456103758]
  Camouflaged object detection (COD) is the challenging task of identifying camouflaged objects visually blended into surroundings. We draw inspiration from the prey-vs-predator game that leads preys to develop better camouflage and predators to acquire more acute vision systems. We introduce a novel COD method, called Internal Coherence and Edge Guidance (ICEG), which introduces a camouflaged feature coherence module.
  arXiv  Detail & Related papers  (2023-08-06T17:27:08Z)
• Adversarially-Aware Robust Object Detector [85.10894272034135]
  We propose a Robust Detector (RobustDet) based on adversarially-aware convolution to disentangle gradients for model learning on clean and adversarial images. Our model effectively disentangles gradients and significantly enhances the detection robustness with maintaining the detection ability on clean images.
  arXiv  Detail & Related papers  (2022-07-13T13:59:59Z)
• GAN-Aimbots: Using Machine Learning for Cheating in First Person Shooters [15.770861074132135]
  Game developers aim to improve the security and user experience of their games by preventing cheating. Traditional software-based methods and statistical systems have been successful in protecting against cheating. Recent advances in the automatic generation of content, such as images or speech, threaten the video game industry.
  arXiv  Detail & Related papers  (2022-05-14T13:33:23Z)
• Collusion Detection in Team-Based Multiplayer Games [57.153233321515984]
  We propose a system that detects colluding behaviors in team-based multiplayer games. The proposed method analyzes the players' social relationships paired with their in-game behavioral patterns. We then automate the detection using Isolation Forest, an unsupervised learning technique specialized in highlighting outliers.
  arXiv  Detail & Related papers  (2022-03-10T02:37:39Z)
• Mate! Are You Really Aware? An Explainability-Guided Testing Framework for Robustness of Malware Detectors [49.34155921877441]
  We propose an explainability-guided and model-agnostic testing framework for robustness of malware detectors. We then use this framework to test several state-of-the-art malware detectors' abilities to detect manipulated malware. Our findings shed light on the limitations of current malware detectors, as well as how they can be improved.
  arXiv  Detail & Related papers  (2021-11-19T08:02:38Z)
• Robust Vision-Based Cheat Detection in Competitive Gaming [12.124621973070164]
  We propose a vision-based approach that captures the final state of the frame buffer and detects illicit overlays. Our results show that robust and effective anti-cheating through machine learning is practically feasible.
  arXiv  Detail & Related papers  (2021-03-18T06:06:52Z)
• Disentangling Controllable Object through Video Prediction Improves Visual Reinforcement Learning [82.25034245150582]
  In many vision-based reinforcement learning problems, the agent controls a movable object in its visual field. We propose an end-to-end learning framework to disentangle the controllable object from the observation signal. The disentangled representation is shown to be useful for RL as additional observation channels to the agent.
  arXiv  Detail & Related papers  (2020-02-21T05:43:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.