Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation

• URL: http://arxiv.org/abs/2604.10923v1
• Date: Mon, 13 Apr 2026 02:44:54 GMT
• Title: Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
• Abstract summary: Large language model--powered agents can self-evolve by accumulating experience or by dynamically creating new assets.<n>Existing frameworks typically treat these two evolutionary processes in isolation.<n>We introduce a novel paradigm of co-evolutionary Capability Expansion and Experience Distillation.
• Score: 42.09919382465098
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: While large language model--powered agents can self-evolve by accumulating experience or by dynamically creating new assets (i.e., tools or expert agents), existing frameworks typically treat these two evolutionary processes in isolation. This separation overlooks their intrinsic interdependence: the former is inherently bounded by a manually predefined static toolset, while the latter generates new assets from scratch without experiential guidance, leading to limited capability growth and unstable evolution. To address this limitation, we introduce a novel paradigm of co-evolutionary Capability Expansion and Experience Distillation. Guided by this paradigm, we propose the \textbf{Mem$^{\textbf{2}}$Evolve}, which integrates two core components: \textbf{Experience Memory} and \textbf{Asset Memory}. Specifically, Mem$^{2}$Evolve leverages accumulated experience to guide the dynamic creation of assets, thereby expanding the agent's capability space while simultaneously acquiring new experience to achieve co-evolution. Extensive experiments across 6 task categories and 8 benchmarks demonstrate that Mem$^{2}$Evolve achieves improvement of 18.53\% over standard LLMs, 11.80\% over agents evolving solely through experience, and 6.46\% over those evolving solely through asset creation, establishing it as a substantially more effective and stable self-evolving agent framework. Code is available at: https://buaa-irip-llm.github.io/Mem2Evolve.

Related papers

• EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement [70.68218215070745]
  Existing approaches assume that all execution experience can be routed to a single harness.<n>We introduce EvolveNet, a paradigm of harness evolution that moves experience extraction to the data.
  arXiv  Detail & Related papers  (2026-08-05T15:37:18Z)
• OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation [71.57258488733974]
  Memory has become a standard substrate for self-evolving agents, yet retaining experience is not the same as learning how to evolve through it.<n>We introduce OPD-Evolver, a slow-fast co-evolution framework that cultivates such an agent evolver through on-policy self-distillation.
  arXiv  Detail & Related papers  (2026-06-16T07:33:53Z)
• Evolving-RL: End-to-End Optimization of Experience-Driven Self-Evolving Capability within Agents [31.6974589324286]
  Self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactions.<n>We propose Evolving-RL, an efficient algorithmic framework that jointly improves the experience extraction and utilization capabilities required for self-evolution.<n> Experiments on ALFWorld and Mind2Web show that Evolving-RL effectively enhances LLMs' ability to extract and reuse experience.
  arXiv  Detail & Related papers  (2026-05-11T14:43:56Z)
• Squeeze Evolve: Unified Multi-Model Orchestration for Verifier-Free Evolution [81.46210789228296]
  We introduce Squeeze Evolve, a unified multi-model orchestration framework for verifier-free evolutionary inference.<n>Our approach is guided by a simple principle: allocate model capability where it has the highest marginal utility.
  arXiv  Detail & Related papers  (2026-04-09T02:14:45Z)
• EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience [44.734653745434834]
  We introduce EvoCUA, a native computer use agentic model.<n>Unlike static imitation, EvoCUA integrates data generation and policy optimization into a self-sustaining evolutionary cycle.<n>EvoCUA significantly outperforms the previous best open-source model, OpenCUA-72B.
  arXiv  Detail & Related papers  (2026-01-22T11:36:43Z)
• Towards AGI A Pragmatic Approach Towards Self Evolving Agent [0.0]
  Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment.<n>This work introduces a hierarchical self-evolving multi-agent framework that integrates a Base LLM, an operational SLM agent, a Code-Generation LLM, and a Teacher-LLM.
  arXiv  Detail & Related papers  (2026-01-15T20:43:44Z)
• MemEvolve: Meta-Evolution of Agent Memory Systems [66.09735157017558]
  Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents.<n>MemeEvolve is a meta-evolutionary framework that jointly evolves agents' experiential knowledge and their memory architecture.<n> EvolveLab is a unified self-evolving memory that distills twelve representative memory systems into a modular design space.
  arXiv  Detail & Related papers  (2025-12-21T14:26:14Z)
• EvoLMM: Self-Evolving Large Multimodal Models with Continuous Rewards [52.42920996842378]
  We propose a self-evolving framework, named EvoLMM, that instantiates two cooperative agents from a single backbone model.<n>This dynamic feedback encourages both the generation of informative queries and the refinement of structured reasoning.<n>Our code and models are available at https://github.com/mbzuai-oryx/EvoLMM.
  arXiv  Detail & Related papers  (2025-11-20T18:59:54Z)
• FLEX: Continuous Agent Evolution via Forward Learning from Experience [54.796367711967754]
  Autonomous agents driven by Large Language Models (LLMs) have revolutionized reasoning and problem-solving but remain static after training.<n>We introduce Forward Learning with EXperience (FLEX), a gradient-free learning paradigm that enables LLM agents to continuously evolve through accumulated experience.
  arXiv  Detail & Related papers  (2025-11-09T16:31:39Z)
• EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle [26.048906477714937]
  Current Large Language Model (LLM) agents show strong performance in tool use, but lack the capability to systematically learn from their own experiences.<n>We introduce EvolveR, a framework designed to enable agent to self-improve through a complete, closed-loop experience lifecycle.<n>We demonstrate the effectiveness of EvolveR on complex multi-hop question-answering benchmarks, where it achieves superior performance over strong agentic baselines.
  arXiv  Detail & Related papers  (2025-10-17T12:03:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.