SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion

• URL: http://arxiv.org/abs/2608.15165v1
• Date: Sat, 15 Aug 2026 11:03:07 GMT
• Title: SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion
• Abstract summary: We propose SkillCommit, an online skill evolution framework that transforms experience into a hierarchical library of reusable skills.<n>As related skills accumulate, SkillCommit abstracts those sharing a common behavioral mechanism into higher-level skills.<n> Experiments on RuleArena, OpenExempt and KOR-Bench demonstrate that SkillCommit consistently improves agent performance across diverse domains.
• Score: 15.498568310060229
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large language model (LLM) agents can continually improve without parameter updates by converting historical experience into reusable procedural knowledge. However, existing methods often consolidate experience based on semantic similarity or LLM judgments, which may merge superficially related but behaviorally incompatible strategies and thereby degrade performance. To address the issue, we propose SkillCommit, an online skill evolution framework that continuously transforms experience into a hierarchical library of reusable skills. Each new experience is initially preserved as an instance-specific patch, retaining the behavior validated in its local context. As related skills accumulate, SkillCommit abstracts those sharing a common behavioral mechanism into higher-level skills. Specifically, for each incoming skill, embedding-based retrieval first identifies candidate related skills. Cross-instance replay and an LLM-based mechanism check determine whether these skills transfer across cases and share a common underlying mechanism. Candidates that pass both checks are abstracted into a higher-level skill and committed only if it preserves the validated behavior of all constituent skills. Experiments on RuleArena, OpenExempt and KOR-Bench demonstrate that SkillCommit consistently improves agent performance across diverse domains. Moreover, the learned skills transfer across model scales and families, enabling cross-model experience transfer.

Related papers

• Coalition-Aware Skill Reliability for Self-Evolving Agents [49.43736235959317]
  We investigate whether accumulated skills in an agent's skill bank actually make positive mechanistic contributions.<n>We show that coalition pollution, where bank-level gains conceal negative coalition-level skill contributions, and cross-domain utility reversal, where source-beneficial skills reverse their effects after transfer.<n>These findings motivate two reliability interventions: coalition-aware skill selection during skill accumulation and label-free skill masking after transfer.
  arXiv  Detail & Related papers  (2026-08-23T21:35:22Z)
• Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfitting [20.811638832981178]
  Large language model (LLM) agents need to accumulate and reuse experience from past interactions.<n>Data-driven skill optimization is prone to overfitting to the limited trajectories collected from real environments.<n>We propose SkillBoost, a three-stage framework that mitigates both risks.
  arXiv  Detail & Related papers  (2026-07-29T09:05:40Z)
• Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills [53.15216425100295]
  We introduce Skill Self-Play (Skill-SP), a co-evolutionary framework comprising a proposer, a solver, and a skill controller.<n>The proposer generates challenging tasks conditioned on dynamically sampled skills; the solver explores candidate solutions to push its capability boundaries; and the skill controller collects execution feedback to update and expand the skill library.<n>This interactive co-evolution effectively bridges the gap between structured verification and open-ended exploration.
  arXiv  Detail & Related papers  (2026-07-24T17:59:22Z)
• Offline Multi-agent Continual Cooperation via Skill Partition and Reuse [5.758813772286136]
  COMAD is a principled framework for Continual Offline Multi-agent Skill Discovery via Skill Partition and Reuse.<n>We first discover skills from mixed multi-agent behavior data with an auto-encoder to transform coordination knowledge into reusable coordination skills.<n>We construct a skill-augmented policy learning objective with multi-head architectures, explicitly guiding the advantage function with reusable skills identified.
  arXiv  Detail & Related papers  (2026-06-24T04:40:21Z)
• SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization [99.18305770138677]
  Agent skills are reusable strategies that guide agent reasoning and action.<n>Current skill construction methods treat the problem as one-shot extraction.<n>We introduce SkillComposer, a framework that decomposes skill construction into three learnable operations.
  arXiv  Detail & Related papers  (2026-06-04T12:16:08Z)
• SkillEvolBench: Benchmarking the Evolution from Episodic Experience to Procedural Skills [31.23929961213889]
  Large language model (LLM) agents accumulate rich episodic trajectories while solving real-world tasks.<n>We introduce SkillEvolBench, a diagnostic benchmark for evaluating this step from experience reuse to skill formation.<n>We find that current agents often adapt locally but rarely form robust reusable skills.
  arXiv  Detail & Related papers  (2026-05-22T18:23:31Z)
• SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphs [70.1970574147839]
  We propose SKILLGRAPH, a framework that represents reusable skills as nodes in a directed graph.<n>SKILLGRAPH retrieves not just individual skills, but an ordered skill subgraph that can guide multi-step decision making.<n> Experiments show that SKILLGRAPH achieves state-of-the-art performance against memory-augmented RL methods.
  arXiv  Detail & Related papers  (2026-05-12T12:21:49Z)
• Skill-R1: Agent Skill Evolution via Reinforcement Learning [84.35984979949502]
  Skill-R1 is a reinforcement learning framework for instance-level recurrent skill optimization from verifiable rewards.<n>It preserves black-box compatibility with both open- and closed-source models while making adaptation substantially cheaper than model-level updates.
  arXiv  Detail & Related papers  (2026-05-10T06:19:15Z)
• SkillGen: Verified Inference-Time Agent Skill Synthesis [60.927977774369516]
  SkillGen is a framework that synthesizes a single auditable skill from trajectories generated by a base agent.<n>It identifies reusable success patterns, recurring failure modes, and behaviors that appear in nearby successes but are missing from failures.<n>A key novelty in SkillGen is that we model agent skills as interventions to empirically verify the net effect of skills on the overall performance.
  arXiv  Detail & Related papers  (2026-05-09T19:24:11Z)
• SkillOS: Learning Skill Curation for Self-Evolving Agents [67.94374107466957]
  We propose SkillOS, an experience-driven RL training recipe for learning skill curation in self-evolving agents.<n>SkillOS pairs a frozen agent executor that retrieves and applies skills with a trainable skill curator that updates an external SkillRepo from accumulated experience.<n>We show that SkillOS consistently outperforms memory-free and strong memory-based baselines in both effectiveness and efficiency.
  arXiv  Detail & Related papers  (2026-05-07T17:31:50Z)
• SkillClaw: Let Skills Evolve Collectively with Agentic Evolver [18.942639318503062]
  We present SkillClaw, a framework for collective skill evolution in multi-user agent ecosystems.<n> SkillClaw treats cross-user and over-time interactions as the primary signal for improving skills.<n>It continuously aggregates trajectories generated during use and processes them with an autonomous evolver.<n>The resulting skills are maintained in a shared repository and synchronized across users.
  arXiv  Detail & Related papers  (2026-04-09T15:38:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.