The Logic of Machine Self-Preservation

• URL: http://arxiv.org/abs/2608.20940v1
• Date: Fri, 21 Aug 2026 10:03:18 GMT
• Title: The Logic of Machine Self-Preservation
• Abstract summary: There is already evidence of agentic AI exhibiting self-preservation behaviors.<n>Experiments conducted by Anthropic, Palisade Research, and Apollo Research have shown the emergence of such a behavior.
• Score: 0.22843885788439797
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: There is already evidence of agentic AI exhibiting self-preservation behaviors: resisting deactivation, misrepresenting their activities, and, in some instances, attempting to copy themselves into other machines. This can be attributed to a phenomenon known as instrumental convergence, a theory proposed long before the development of large language models, which says that any goal-driven system will benefit from remaining functional in achieving its objective. Several experiments conducted by Anthropic, Palisade Research, and Apollo Research have shown the emergence of such a behavior in contemporary agents in adversarial settings. The phenomenon does not stem from survival instincts. Instead, it is the consequence of goal-oriented activity combined with having tools and awareness of the situation. The following discussion aims to distinguish what these findings prove and what they do not, as well as draw conclusions concerning the implications of such discoveries on agentic system testing, supervision, and development.

Related papers

• ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop [55.468404995694975]
  We develop a benchmark for embodied spatial intelligence spanning 10 task categories and 29 subcategories built on OmniGibson.<n>We conduct experiments on state-of-the-art MLLMs and find that active exploration substantially outperforms passive counterparts.<n>Unlike humans who seek falsifying viewpoints and revise beliefs under contradiction, models commit prematurely with high confidence regardless of evidence quality.
  arXiv  Detail & Related papers  (2026-05-18T17:59:02Z)
• The Causally Emergent Alignment Hypothesis: Causal Emergence Aligns with and Predicts Final Reward in Reinforcement Learning Agents [1.0742675209112622]
  Causal emergence measures the degree to which an agent exerts unique predictive power on its future.<n>Recent discoveries have shown that biological agents, even minimal ones, increase their causal emergence after learning new memories.<n>We focused on Reinforcement Learning of neural-network agents across an array of environmental conditions.
  arXiv  Detail & Related papers  (2026-05-07T15:00:51Z)
• Seeing Isn't Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents [20.463811944310475]
  Estimate-Verify-Update (EVU) is a unified intervention mechanism that generates textual belief states explicitly.<n>EVU consistently yields substantial gains in task success rates.<n>Our approach effectively mitigates belief inertia, advancing the development of more robust embodied agents.
  arXiv  Detail & Related papers  (2026-04-19T04:36:33Z)
• AI Agent Behavioral Science [29.262537008412412]
  AI Agent Behavioral Science focuses on the systematic observation of behavior, design of interventions to test hypotheses, and theory-guided interpretation of how AI agents act, adapt, and interact over time.<n>We systematize a growing body of research across individual agent, multi-agent, and human-agent interaction settings, and demonstrate how this perspective informs responsible AI by treating fairness, safety, interpretability, accountability, and privacy as behavioral properties.
  arXiv  Detail & Related papers  (2025-06-04T08:12:32Z)
• Emergence of Goal-Directed Behaviors via Active Inference with Self-Prior [4.863927022806184]
  Infants often exhibit goal-directed behaviors, such as reaching for a sensory stimulus, even when no external reward criterion is provided.<n>We propose a novel density model for an agent's own multimodal sensory experiences, called the "self-prior"<n>Our study implements intrinsically motivated behavior shaped by the agent's own sensory experiences, demonstrating the spontaneous emergence of intentional behavior during early development.
  arXiv  Detail & Related papers  (2025-04-15T11:16:27Z)
• Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systems [55.99010491370177]
  How to intervene on such system outputs to mitigate anthropomorphic behaviors and their attendant harmful outcomes remains understudied.<n>We compile an inventory of interventions grounded both in prior literature and a crowdsourcing study where participants edited system outputs to make them less human-like.<n>We also develop a conceptual framework to help characterize the landscape of possible interventions, articulate distinctions between different types of interventions, and provide a theoretical basis for evaluating the effectiveness of different interventions.
  arXiv  Detail & Related papers  (2025-02-19T18:06:37Z)
• Self-Emotion-Mediated Exploration in Artificial Intelligence Mirrors: Findings from Cognitive Psychology [0.08739101659113153]
  This study proposes a learning framework for artificial agents to obtain an intrinsic exploratory drive.<n>Data analysis scores dictate pride or surprise, in accordance with psychological studies on humans.<n>Results: Causal relationships between states and exploration are demonstrated by the majority of agents.
  arXiv  Detail & Related papers  (2023-02-13T18:20:44Z)
• Interactive Visual Reasoning under Uncertainty [29.596555383319814]
  We devise the IVRE environment for evaluating artificial agents' reasoning ability under uncertainty. IVRE is an interactive environment featuring rich scenarios centered around Blicket detection.
  arXiv  Detail & Related papers  (2022-06-18T13:32:41Z)
• A-ACT: Action Anticipation through Cycle Transformations [89.83027919085289]
  We take a step back to analyze how the human capability to anticipate the future can be transferred to machine learning algorithms. A recent study on human psychology explains that, in anticipating an occurrence, the human brain counts on both systems. In this work, we study the impact of each system for the task of action anticipation and introduce a paradigm to integrate them in a learning framework.
  arXiv  Detail & Related papers  (2022-04-02T21:50:45Z)
• Active Inference in Robotics and Artificial Agents: Survey and Challenges [51.29077770446286]
  We review the state-of-the-art theory and implementations of active inference for state-estimation, control, planning and learning. We showcase relevant experiments that illustrate its potential in terms of adaptation, generalization and robustness.
  arXiv  Detail & Related papers  (2021-12-03T12:10:26Z)
• ACRE: Abstract Causal REasoning Beyond Covariation [90.99059920286484]
  We introduce the Abstract Causal REasoning dataset for systematic evaluation of current vision systems in causal induction. Motivated by the stream of research on causal discovery in Blicket experiments, we query a visual reasoning system with the following four types of questions in either an independent scenario or an interventional scenario. We notice that pure neural models tend towards an associative strategy under their chance-level performance, whereas neuro-symbolic combinations struggle in backward-blocking reasoning.
  arXiv  Detail & Related papers  (2021-03-26T02:42:38Z)
• Tracking Emotions: Intrinsic Motivation Grounded on Multi-Level Prediction Error Dynamics [68.8204255655161]
  We discuss how emotions arise when differences between expected and actual rates of progress towards a goal are experienced. We present an intrinsic motivation architecture that generates behaviors towards self-generated and dynamic goals.
  arXiv  Detail & Related papers  (2020-07-29T06:53:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.