EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments

• URL: http://arxiv.org/abs/2606.13681v2
• Date: Wed, 17 Jun 2026 04:10:52 GMT
• Title: EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
• Abstract summary: EvoArena is a benchmark suite that models environment changes as sequences of progressive updates across terminal, software, and social domains.<n>EvoMem is a patch-based memory paradigm that records memory evolution as structured update histories.
• Score: 100.23277774720928
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large language model (LLM) agents have achieved strong performance on a wide range of benchmarks, yet most evaluations assume static environments. In contrast, real-world deployment is inherently dynamic, requiring agents to continually align their knowledge, skills, and behavior with changing environments and updated task conditions. To address this gap, we introduce EvoArena, a benchmark suite that models environment changes as sequences of progressive updates across terminal, software, and social domains. We further propose EvoMem, a patch-based memory paradigm that records memory evolution as structured update histories, enabling agents to reason about environmental evolution through changes in their memory. Experiments show that current agents struggle on EvoArena, achieving an average accuracy of 39.6% across evolving terminal, software, and social-preference domains. EvoMem consistently improves performance, yielding an average gain of 1.5% on EvoArena and also improving standard benchmarks such as GAIA and LoCoMo by 6.1% and 4.8%. Beyond individual tasks, EvoMem further improves chain-level accuracy by 3.7% on EvoArena, where success requires completing a consecutive sequence of related evolutionary subtasks. Mechanistic analysis shows that EvoMem improves evidence capture in the memory, indicating better preservation of complete evolving environment states. Our results highlight the importance of modeling evolution in both evaluation and memory for reliable agent deployment.

Related papers

• OpenART: Scaling Agent Red Teaming via Open-Ended Environment Evolution [71.06848799741152]
  AI agents operate in persistent environments where early state changes can influence decisions far into the future.<n>Current safety benchmarks often fail to capture cumulative risks because they focus on short, static tasks.<n>We introduce OpenART, an open-ended arena for scalable agent red teaming through environment evolution.
  arXiv  Detail & Related papers  (2026-08-01T13:51:55Z)
• Teaching LLMs to Self-Evolve: Cultivating Core Meta-Skills with Reinforcement Learning [51.17262419591891]
  Test-time scaling through iterative self-evolution with environment feedback, as demonstrated by AlphaEvolve, shows remarkable performance gains.<n>We present MetaEvolve, a framework designed to develop these meta-skills via a data synthesis pipeline, evolution-aware reinforcement learning, and inference-time evolutionary search.
  arXiv  Detail & Related papers  (2026-07-24T04:35:29Z)
• Harnessing Agentic Evolution [32.567492765277855]
  Agentic evolution is a powerful paradigm for improving programs, iteration, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search.<n>Existing methods are typically instantiated either as fixed hand-designed procedures that are modular but rigid, or as general-purpose agents that flexibly integrate feedback but can drift in long-horizon evolution.<n>We introduce AEvo, a harnessed meta-editing framework in which a meta-agent observes this state and acts not by directly proposing the next candidate, but by editing the procedure or agent context that controls future evolution.
  arXiv  Detail & Related papers  (2026-05-13T17:45:16Z)
• EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents [80.59925936278162]
  We present EvolveMem, a self-evolving memory architecture that exposes its full retrieval configuration as a structured action space optimized by an LLM-powered diagnosis module.<n>This closedloop selfevolution realizes an AutoResearch process: the system autonomously conducts iterative research cycles on its own architecture, replacing manual configuration tuning.
  arXiv  Detail & Related papers  (2026-05-13T17:12:44Z)
• AVO: Agentic Variation Operators for Autonomous Evolutionary Search [38.64857334672555]
  Agentic Variation Operators (AVO) are evolutionary variation operators that replace the fixed mutation, crossover, and hand-designeds of classical evolutionary search.<n>We evaluate AVO on attention, among the most aggressively optimized kernel targets in AI, on NVIDIA Blackwell (B200)<n>AVO instantiates variation as a self-directed agent loop that can consult the current lineage, a domain-specific knowledge base, and execution feedback.
  arXiv  Detail & Related papers  (2026-03-25T16:55:04Z)
• The World Won't Stay Still: Programmable Evolution for Agent Benchmarks [44.36372545284675]
  LLM-powered agents fulfill user requests by interacting with environments, querying data, and invoking tools in a multi-turn process.<n>Most existing benchmarks assume static environments with fixed schemas and toolsets, neglecting the evolutionary nature of the real world and agents' robustness to environmental changes.<n>We propose ProEvolve, a graph-based framework that makes environment evolution programmable.
  arXiv  Detail & Related papers  (2026-03-06T04:56:18Z)
• Evolutionary Generation of Multi-Agent Systems [49.47969796873096]
  Large language model (LLM)-based multi-agent systems (MAS) show strong promise for complex reasoning, planning, and tool-augmented tasks.<n>EvoMAS formulates MAS generation as structured configuration generation.<n>EvoMAS consistently improves task performance over both human-designed MAS and prior automatic MAS generation methods.
  arXiv  Detail & Related papers  (2026-02-06T09:01:35Z)
• Position: Agentic Evolution is the Path to Evolving LLMs [56.733933092220845]
  We argue that addressing this limitation requires a new scaling axis-evolution.<n>Existing deployment-time adaptation methods lack the strategic agency needed to diagnose failures and produce durable improvements.
  arXiv  Detail & Related papers  (2026-01-30T22:15:58Z)
• EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience [44.734653745434834]
  We introduce EvoCUA, a native computer use agentic model.<n>Unlike static imitation, EvoCUA integrates data generation and policy optimization into a self-sustaining evolutionary cycle.<n>EvoCUA significantly outperforms the previous best open-source model, OpenCUA-72B.
  arXiv  Detail & Related papers  (2026-01-22T11:36:43Z)
• MemEvolve: Meta-Evolution of Agent Memory Systems [66.09735157017558]
  Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents.<n>MemeEvolve is a meta-evolutionary framework that jointly evolves agents' experiential knowledge and their memory architecture.<n> EvolveLab is a unified self-evolving memory that distills twelve representative memory systems into a modular design space.
  arXiv  Detail & Related papers  (2025-12-21T14:26:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.