More Is Different: Toward a Theory of Emergence in AI-Native Software Ecosystems

• URL: http://arxiv.org/abs/2604.19827v1
• Date: Mon, 20 Apr 2026 15:09:55 GMT
• Title: More Is Different: Toward a Theory of Emergence in AI-Native Software Ecosystems
• Abstract summary: Multi-agent AI systems fail in ways that defy explanation by traditional theories.<n>This paper argues that AI-native software ecosystems must be studied as complex adaptive systems.
• Score: 3.362633173562401
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Software engineering faces a fundamental challenge: multi-agent AI systems fail in ways that defy explanation by traditional theories. While individual agents perform correctly, their interactions degrade entire ecosystems, revealing a gap in our understanding of software evolution. This paper argues that AI-native software ecosystems must be studied as complex adaptive systems (CAS), where emergent properties like architectural entropy, cascade failures, and comprehension debt arise not from individual components, but from their interactions. We map Holland's six CAS properties onto observable ecosystem dynamics, distinguishing these systems from microservices or open-source networks. To measure causal emergence, we define micro-level state variables, coarse-graining functions, and a tractable measurement framework. Seven falsifiable propositions link CAS theory to software evolution, challenging or extending Lehman's laws where agent-level assumptions fail. If confirmed, these findings would demand a radical shift: ecosystem-level monitoring as the primary governance mechanism for AI-native systems. If refuted, existing theories may only need incremental updates. Either way, this work forces us to ask: Can software engineering's core assumptions survive the age of autonomous agents?

Related papers

• Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence [115.91847478507736]
  LLMs have evolved from language generators to autonomous agents capable of complex, long-horizon tasks.<n>Many tasks require heterogeneous expertise, interdependent subtasks, parallel execution, independent verification, and persistent state.<n>We call this System Intelligence: an agent system's ability to organize and coordinate multiple intelligent components into a coherent, adaptive whole.
  arXiv  Detail & Related papers  (2026-08-21T14:27:57Z)
• Cognitive Atrophy and Systemic Collapse in AI-Dependent Software Engineering [0.0]
  This paper introduces "Epistemological Debt," the hidden carrying cost incurred when engineers substitute logical derivation with passive AI verification.<n>This debt erodes the mental models essential for root-cause analysis, widening the gap between system complexity and human comprehension.<n>Using the 2026 Amazon outages as a case study, this research illustrates how "mechanized convergence" leads to systemic fragility.
  arXiv  Detail & Related papers  (2026-04-29T16:20:25Z)
• Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond [209.35045331678043]
  We introduce a "levels x laws" taxonomy organized along two axes.<n>The first defines three capability levels: L1 Predictor, which learns one-step local transition operators; L2 Simulator, which composes them into multi-step, action-conditioned rollouts that respect domain laws; and L3 Evolver, which autonomously revises its own model when predictions fail against new evidence.<n>We synthesize over 400 works and summarize more than 100 representative systems spanning model-based reinforcement learning, video generation, web and GUI agents, multi-agent social simulation, and AI-driven scientific discovery.
  arXiv  Detail & Related papers  (2026-04-24T17:48:47Z)
• A Mathematical Theory of Agency and Intelligence [0.0]
  We show how much of the total information a system deploys is actually shared between its observations, actions, and outcomes.<n>We prove this shared fraction, which we term bipredictability, P, is intrinsic to any interaction, derivable from first principles.<n>We demonstrate a feedback architecture that monitors P in real time, establishing a prerequisite for adaptive, resilient AI.
  arXiv  Detail & Related papers  (2026-02-26T01:26:21Z)
• Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents [14.448267395835721]
  We propose a unified taxonomy that breaks agents into Perception, Brain, Planning, Action, Tool Use, and Collaboration.<n>We also group the environments in which these agents operate, including digital operating systems, embodied robotics, and other specialized domains.
  arXiv  Detail & Related papers  (2026-01-18T19:51:16Z)
• AI Deception: Risks, Dynamics, and Controls [153.71048309527225]
  This project provides a comprehensive and up-to-date overview of the AI deception field.<n>We identify a formal definition of AI deception, grounded in signaling theory from studies of animal deception.<n>We organize the landscape of AI deception research as a deception cycle, consisting of two key components: deception emergence and deception treatment.
  arXiv  Detail & Related papers  (2025-11-27T16:56:04Z)
• Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems? [0.0]
  The concept of the 'agent' has profoundly shaped Artificial Intelligence (AI) research.<n>This paper critically re-evaluates the necessity and optimality of this agent-centric paradigm.
  arXiv  Detail & Related papers  (2025-09-13T16:11:27Z)
• A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems [53.37728204835912]
  Most existing AI systems rely on manually crafted configurations that remain static after deployment.<n>Recent research has explored agent evolution techniques that aim to automatically enhance agent systems based on interaction data and environmental feedback.<n>This survey aims to provide researchers and practitioners with a systematic understanding of self-evolving AI agents.
  arXiv  Detail & Related papers  (2025-08-10T16:07:32Z)
• Agentic Web: Weaving the Next Web with AI Agents [109.13815627467514]
  The emergence of AI agents powered by large language models (LLMs) marks a pivotal shift toward the Agentic Web.<n>In this paradigm, agents interact directly with one another to plan, coordinate, and execute complex tasks on behalf of users.<n>We present a structured framework for understanding and building the Agentic Web.
  arXiv  Detail & Related papers  (2025-07-28T17:58:12Z)
• An Outlook on the Opportunities and Challenges of Multi-Agent AI Systems [32.48561526824382]
  A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models.<n>This paper outlines a formal framework for analyzing MAS, focusing on two core aspects: effectiveness and safety.
  arXiv  Detail & Related papers  (2025-05-23T22:05:19Z)
• Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning [50.47568731994238]
  Key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL) This paper presents a general framework model for integrating and learning structured reasoning into AI agents' policies.
  arXiv  Detail & Related papers  (2023-12-22T17:57:57Z)
• Core and Periphery as Closed-System Precepts for Engineering General Intelligence [62.997667081978825]
  It is unclear if an AI system's inputs will be independent of its outputs, and, therefore, if AI systems can be treated as traditional components. This paper posits that engineering general intelligence requires new general systems precepts, termed the core and periphery.
  arXiv  Detail & Related papers  (2022-08-04T18:20:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.