War Elephants: Rethinking Combat AI and Human Oversight

• URL: http://arxiv.org/abs/2404.19573v1
• Date: Tue, 30 Apr 2024 14:07:57 GMT
• Title: War Elephants: Rethinking Combat AI and Human Oversight
• Abstract summary: We look beyond the substitution of AI for experts to an approach where complementary human and machine abilities are blended. By basing our approach on the principles of complementation, we provide for a flexible and dynamic approach to managing lethal autonomous systems. This approach enables the development of combat systems that are likely to be more ethical, operate at machine speed, and are capable of responding to a broader range of dynamic battlefield conditions.
• Score: 0.5898893619901381
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper explores the changes that pervasive AI is having on the nature of combat. We look beyond the substitution of AI for experts to an approach where complementary human and machine abilities are blended. Using historical and modern examples, we show how autonomous weapons systems can be effectively managed by teams of human "AI Operators" combined with AI/ML "Proxy Operators." By basing our approach on the principles of complementation, we provide for a flexible and dynamic approach to managing lethal autonomous systems. We conclude by presenting a path to achieving an integrated vision of machine-speed combat where the battlefield AI is operated by AI Operators that watch for patterns of behavior within battlefield to assess the performance of lethal autonomous systems. This approach enables the development of combat systems that are likely to be more ethical, operate at machine speed, and are capable of responding to a broader range of dynamic battlefield conditions than any purely autonomous AI system could support.

Related papers

• AI, Trust, and Teaming: The Humans-as-Handlers Approach for Autonomous and Opaque AI Systems [0.0]
  I argue that within highly impactful areas there are grounds for treating autonomous and opaque systems as analogous to dogs.<n>Under this analogy, humans making use of these systems are not to be viewed as "users" or "deployers" of these systems, but instead take the role of "handlers"<n>This recasting of roles shifts the way we view humans, AI-enabled and autonomous systems, and the relations between them.
  arXiv  Detail & Related papers  (2026-07-01T07:10:16Z)
• ANNIE: Be Careful of Your Robots [48.89876809734855]
  We present the first systematic study of adversarial safety attacks on embodied AI systems.<n>We show attack success rates exceeding 50% across all safety categories.<n>Results expose a previously underexplored but highly consequential attack surface in embodied AI systems.
  arXiv  Detail & Related papers  (2025-09-03T15:00:28Z)
• Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applications [1.4347154947542533]
  We focus on a subset of lethal autonomous weapon systems (LAWS) that use AI for targeting or battlefield decisions.<n>These risks threaten both military effectiveness and the openness of AI research.<n>We propose a behavior-based definition of AI-LAWS as a foundation for technically grounded regulation.
  arXiv  Detail & Related papers  (2025-05-23T20:58:38Z)
• Neurodivergent Influenceability as a Contingent Solution to the AI Alignment Problem [1.3905735045377272]
  The AI alignment problem, which focusses on ensuring that artificial intelligence (AI) systems act according to human values, presents profound challenges.<n>With the progression from narrow AI to Artificial General Intelligence (AGI) and Superintelligence, fears about control and existential risk have escalated.<n>Here, we investigate whether embracing inevitable AI misalignment can be a contingent strategy to foster a dynamic ecosystem of competing agents.
  arXiv  Detail & Related papers  (2025-05-05T11:33:18Z)
• Actionable AI: Enabling Non Experts to Understand and Configure AI Systems [5.534140394498714]
  Actionable AI allows non-experts to configure black-box agents. In uncertain conditions, non-experts achieve good levels of performance. We propose Actionable AI as a way to open access to AI-based agents.
  arXiv  Detail & Related papers  (2025-03-09T23:09:04Z)
• Alignment, Agency and Autonomy in Frontier AI: A Systems Engineering Perspective [0.0]
  Concepts of alignment, agency, and autonomy have become central to AI safety, governance, and control. This paper traces the historical, philosophical, and technical evolution of these concepts, emphasizing how their definitions influence AI development, deployment, and oversight.
  arXiv  Detail & Related papers  (2025-02-20T21:37:20Z)
• Work-in-Progress: Crash Course: Can (Under Attack) Autonomous Driving Beat Human Drivers? [60.51287814584477]
  This paper evaluates the inherent risks in autonomous driving by examining the current landscape of AVs. We develop specific claims highlighting the delicate balance between the advantages of AVs and potential security challenges in real-world scenarios.
  arXiv  Detail & Related papers  (2024-05-14T09:42:21Z)
• A Technological Perspective on Misuse of Available AI [41.94295877935867]
  Potential malicious misuse of civilian artificial intelligence (AI) poses serious threats to security on a national and international level. We show how already existing and openly available AI technology could be misused. We develop three exemplary use cases of potentially misused AI that threaten political, digital and physical security.
  arXiv  Detail & Related papers  (2024-03-22T16:30:58Z)
• Killer Apps: Low-Speed, Large-Scale AI Weapons [2.2899177316144943]
  Artificial Intelligence (AI) and Machine Learning (ML) advancements present new challenges and opportunities in warfare and security. This paper explores the concept of AI weapons, their deployment, detection, and potential countermeasures.
  arXiv  Detail & Related papers  (2024-01-14T12:09:40Z)
• A Red Teaming Framework for Securing AI in Maritime Autonomous Systems [0.0]
  We propose one of the first red team frameworks for evaluating the AI security of maritime autonomous systems. This framework is a multi-part checklist, which can be tailored to different systems and requirements. We demonstrate this framework to be highly effective for a red team to use to uncover numerous vulnerabilities within a real-world maritime autonomous systems AI.
  arXiv  Detail & Related papers  (2023-12-08T14:59:07Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• Fairness in AI and Its Long-Term Implications on Society [68.8204255655161]
  We take a closer look at AI fairness and analyze how lack of AI fairness can lead to deepening of biases over time. We discuss how biased models can lead to more negative real-world outcomes for certain groups. If the issues persist, they could be reinforced by interactions with other risks and have severe implications on society in the form of social unrest.
  arXiv  Detail & Related papers  (2023-04-16T11:22:59Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• Automating Privilege Escalation with Deep Reinforcement Learning [71.87228372303453]
  In this work, we exemplify the potential threat of malicious actors using deep reinforcement learning to train automated agents. We present an agent that uses a state-of-the-art reinforcement learning algorithm to perform local privilege escalation. Our agent is usable for generating realistic attack sensor data for training and evaluating intrusion detection systems.
  arXiv  Detail & Related papers  (2021-10-04T12:20:46Z)
• Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork [54.309495231017344]
  We argue that AI systems should be trained in a human-centered manner, directly optimized for team performance. We study this proposal for a specific type of human-AI teaming, where the human overseer chooses to either accept the AI recommendation or solve the task themselves. Our experiments with linear and non-linear models on real-world, high-stakes datasets show that the most accuracy AI may not lead to highest team performance.
  arXiv  Detail & Related papers  (2020-04-27T19:06:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.