Towards Human Engagement with Realistic AI Combat Pilots

• URL: http://arxiv.org/abs/2509.26002v1
• Date: Tue, 30 Sep 2025 09:34:10 GMT
• Title: Towards Human Engagement with Realistic AI Combat Pilots
• Abstract summary: We present a system that enables real-time interaction between human users and agents trained to control fighter jets in simulated 3D air combat scenarios.<n>The agents are trained in a dedicated environment using Multi-Agent Reinforcement Learning.<n>A communication link is developed to allow seamless deployment of trained agents into VR-Forces, a widely used defense simulation tool for realistic tactical scenarios.
• Score: 39.38793354038274
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present a system that enables real-time interaction between human users and agents trained to control fighter jets in simulated 3D air combat scenarios. The agents are trained in a dedicated environment using Multi-Agent Reinforcement Learning. A communication link is developed to allow seamless deployment of trained agents into VR-Forces, a widely used defense simulation tool for realistic tactical scenarios. This integration allows mixed simulations where human-controlled entities engage with intelligent agents exhibiting distinct combat behaviors. Our interaction model creates new opportunities for human-agent teaming, immersive training, and the exploration of innovative tactics in defense contexts.

Related papers

• Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning [22.65712097455206]
  We show that multi-agent reinforcement learning provides the safety scaffolding required for real-world interaction.<n>We train agents to navigate complex aerodynamic interactions and strategic maneuvering with a variable number of racers.<n>Our agents outperform reducing collision rates by 50 % compared to state-of-the-art single-agent baselines.
  arXiv  Detail & Related papers  (2026-05-21T17:15:54Z)
• RESCUE: Crowd Evacuation Simulation via Controlling SDM-United Characters [48.21227099856613]
  Current evacuation models overlook the complex human behaviors that occur during evacuation.<n>We propose a real-time 3D crowd evacuation simulation framework that integrates a 3D-adaptive SFM (Social Force Model) Decision Mechanism and a Personalized Gait Control Motor.
  arXiv  Detail & Related papers  (2025-07-27T03:50:18Z)
• Learning to Communicate in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence [4.267944967869789]
  We propose a game design where defender agents learn to communicate and defend against imminent cyber threats by playing training games in the Cyber Operations Research Gym.<n>The tactical policies learned by these autonomous agents are akin to those of human experts during incident responses to avert cyber threats.
  arXiv  Detail & Related papers  (2025-07-19T15:16:24Z)
• Improving Human-AI Coordination through Online Adversarial Training and Generative Models [36.54154192505703]
  Generalizing to novel humans requires training on data that captures the diversity of human behaviors.<n>Adversarial training is a promising method that allows dynamic data generation and ensures that agents are robust.<n>We propose a novel strategy that combines a pretrained generative model to simulate valid cooperative agent policies with adversarial training to maximize regret.
  arXiv  Detail & Related papers  (2025-04-21T21:53:00Z)
• AVA: Attentive VLM Agent for Mastering StarCraft II [56.07921367623274]
  We introduce Attentive VLM Agent (AVA), a multimodal StarCraft II agent that aligns artificial agent perception with the human gameplay experience.<n>Our agent addresses this limitation by incorporating RGB visual inputs and natural language observations that more closely simulate human cognitive processes during gameplay.
  arXiv  Detail & Related papers  (2025-03-07T12:54:25Z)
• Exploring reinforcement learning for incident response in autonomous military vehicles [0.62914438169038]
  Research on this topic points to autonomous cyber defence as one of the capabilities that may be needed to accelerate the adoption of these vehicles for military purposes. Here, we explore reinforcement learning to train an agent that can autonomously respond to cyber attacks on unmanned vehicles in the context of a military operation. A key contribution of our work is demonstrating that reinforcement learning is a viable approach to train an agent that can be used for autonomous cyber defence on a real unmanned ground vehicle, even when trained in a simple simulation environment.
  arXiv  Detail & Related papers  (2024-10-28T18:08:23Z)
• War Elephants: Rethinking Combat AI and Human Oversight [0.5898893619901381]
  We look beyond the substitution of AI for experts to an approach where complementary human and machine abilities are blended. By basing our approach on the principles of complementation, we provide for a flexible and dynamic approach to managing lethal autonomous systems. This approach enables the development of combat systems that are likely to be more ethical, operate at machine speed, and are capable of responding to a broader range of dynamic battlefield conditions.
  arXiv  Detail & Related papers  (2024-04-30T14:07:57Z)
• Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
  "Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data. We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
  arXiv  Detail & Related papers  (2024-01-07T19:11:18Z)
• Autonomous Agent for Beyond Visual Range Air Combat: A Deep Reinforcement Learning Approach [0.2578242050187029]
  This work contributes to developing an agent based on deep reinforcement learning capable of acting in a beyond visual range (BVR) air combat simulation environment. The paper presents an overview of building an agent representing a high-performance fighter aircraft that can learn and improve its role in BVR combat over time. It also hopes to examine a real pilot's ability, using virtual simulation, to interact in the same environment with the trained agent and compare their performances.
  arXiv  Detail & Related papers  (2023-04-19T13:54:37Z)
• Automating Privilege Escalation with Deep Reinforcement Learning [71.87228372303453]
  In this work, we exemplify the potential threat of malicious actors using deep reinforcement learning to train automated agents. We present an agent that uses a state-of-the-art reinforcement learning algorithm to perform local privilege escalation. Our agent is usable for generating realistic attack sensor data for training and evaluating intrusion detection systems.
  arXiv  Detail & Related papers  (2021-10-04T12:20:46Z)
• Visual Navigation Among Humans with Optimal Control as a Supervisor [72.5188978268463]
  We propose an approach that combines learning-based perception with model-based optimal control to navigate among humans. Our approach is enabled by our novel data-generation tool, HumANav. We demonstrate that the learned navigation policies can anticipate and react to humans without explicitly predicting future human motion.
  arXiv  Detail & Related papers  (2020-03-20T16:13:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.