WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

• URL: http://arxiv.org/abs/2608.27454v1
• Date: Thu, 27 Aug 2026 17:59:11 GMT
• Title: WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
• Abstract summary: We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki)<n>We find that WikiSkill consistently outperforms state-of-the-art skill-evolution methods.<n>We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills.
• Score: 16.55630974027974
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.

Related papers

• VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experience [12.60845363300573]
  Existing skill self-evolution methods primarily revise skills using execution trajectories collected from current tasks.<n>We propose VCE-Skill, which distills noisy and implementation-specific public skill changes into reusable, structured version-change experience.<n>Our work highlights public skill version changes as a previously underexplored yet effective source of prior knowledge and advances trajectory-driven skill self-evolution.
  arXiv  Detail & Related papers  (2026-08-17T13:16:59Z)
• Evo-Harness: Context-to-Harness Skill Compilation for Self-Evolving Agents [67.97365535829098]
  Learning from experience is critical for developing capable, self-improving large language model (LLM) agents.<n>We propose Evo-Harness, which distills noisy, single-shot executions into reusable skill harnesses for cross-domain and topic-level adaptation.<n>Our analysis demonstrates the effectiveness of Evo-Harness and provides a principled understanding of how LLM agents can effectively learn on the fly.
  arXiv  Detail & Related papers  (2026-08-15T06:43:56Z)
• ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities? [42.712923465058786]
  We introduce ContinualSkillBench, a dynamic evaluation framework for in-context continual skill learning.<n>We show that sequential execution generally improves performance, but the gains vary substantially across models and domains.<n>We further find that less capable models tend to accumulate larger, more fragmented collections of task-specific skills.
  arXiv  Detail & Related papers  (2026-08-04T16:15:02Z)
• SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization [99.18305770138677]
  Agent skills are reusable strategies that guide agent reasoning and action.<n>Current skill construction methods treat the problem as one-shot extraction.<n>We introduce SkillComposer, a framework that decomposes skill construction into three learnable operations.
  arXiv  Detail & Related papers  (2026-06-04T12:16:08Z)
• SkillGen: Verified Inference-Time Agent Skill Synthesis [60.927977774369516]
  SkillGen is a framework that synthesizes a single auditable skill from trajectories generated by a base agent.<n>It identifies reusable success patterns, recurring failure modes, and behaviors that appear in nearby successes but are missing from failures.<n>A key novelty in SkillGen is that we model agent skills as interventions to empirically verify the net effect of skills on the overall performance.
  arXiv  Detail & Related papers  (2026-05-09T19:24:11Z)
• SkillOS: Learning Skill Curation for Self-Evolving Agents [67.94374107466957]
  We propose SkillOS, an experience-driven RL training recipe for learning skill curation in self-evolving agents.<n>SkillOS pairs a frozen agent executor that retrieves and applies skills with a trainable skill curator that updates an external SkillRepo from accumulated experience.<n>We show that SkillOS consistently outperforms memory-free and strong memory-based baselines in both effectiveness and efficiency.
  arXiv  Detail & Related papers  (2026-05-07T17:31:50Z)
• SkillClaw: Let Skills Evolve Collectively with Agentic Evolver [18.942639318503062]
  We present SkillClaw, a framework for collective skill evolution in multi-user agent ecosystems.<n> SkillClaw treats cross-user and over-time interactions as the primary signal for improving skills.<n>It continuously aggregates trajectories generated during use and processes them with an autonomous evolver.<n>The resulting skills are maintained in a shared repository and synchronized across users.
  arXiv  Detail & Related papers  (2026-04-09T15:38:27Z)
• EvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification [85.3692584167951]
  Anthropic proposes the concept of skills for LLM agents to tackle multi-step professional tasks.<n>A tool is a single, self-contained function, whereas a skill is a structured bundle of interdependent multi-file artifacts.<n>EvoSkills is a self-evolving skills framework that enables agents to autonomously construct complex, multi-file skill packages.
  arXiv  Detail & Related papers  (2026-04-02T06:43:20Z)
• SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning [83.98129545309277]
  We propose SkillRL, a framework that bridges the gap between raw experience and policy improvement.<n>Our approach introduces an experience-based distillation mechanism to build a hierarchical skill library SkillBank.<n> Experimental results on ALF, WebShop and seven search-augmented tasks demonstrate that SkillRL achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-02-09T03:17:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.