HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memory
- URL: http://arxiv.org/abs/2608.16114v1
- Date: Mon, 17 Aug 2026 05:10:27 GMT
- Title: HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memory
- Abstract summary: HyperSkill represents memory as a hypergraph with two node types, subtask steps and reusable skills, where each hyperedge links the subtasks and skills from a single trajectory.<n> Periodic structure-informed maintenance prunes low-utility nodes and redundant merges skills via quality-weighted propagation.<n>Across xBench, GAIA, and WebWalkerQA with GPT-4o and Qwen3-30B-A3B, HyperSkill outperforms ten memory baselines, yielding gains of up to +11.51 on GAIA and +11.18 on WebWalkerQA.
- Score: 3.6156240053949866
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As agentic tasks grow in complexity, LLM agents increasingly rely on experiential memory to reuse procedural knowledge across tasks. Effective memory design must jointly address what to store, how memory is structured and retrieved, and how memory evolves. Existing systems tackle each only partially: they store trajectories, insights, or workflows as isolated entries, discarding compositional relationships among subtasks and reusable skills; retrieve by flat embedding similarity that ignores relational signals; and maintain memory without leveraging its relational structure. We propose HyperSkill, a hypergraph-based memory framework that jointly improves all three. HyperSkill represents memory as a hypergraph with two node types, subtask steps and reusable skills, where each hyperedge links the subtasks and skills from a single trajectory. Dual-path retrieval queries both subtask and trajectory levels, ranking skills by co-occurrence across retrieved trajectories. Periodic structure-informed maintenance prunes low-utility nodes and merges redundant skills via quality-weighted propagation. Across xBench, GAIA, and WebWalkerQA with GPT-4o and Qwen3-30B-A3B, HyperSkill outperforms ten memory baselines, yielding gains of up to +11.51 on GAIA and +11.18 on WebWalkerQA.
Related papers
- ERSkill: Evolving for Skill-Guided Adaptive Memory Retrieval [8.099546846655196]
ERSkill is a retrieval-centric framework for self-evolving, skill-guided memory access.<n>It co-evolves the skill set and the router during training to enable continuous improvement.<n>It substantially outperforms strong non-evolving and self-evolving baselines.
arXiv Detail & Related papers (2026-08-13T02:06:01Z) - Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory [49.6908961629532]
Agent Memory Distillation (AMD) is a training-free framework that transfers structured knowledge from a large teacher agent to a small student agent through hierarchical memory.<n>AMD constructs three complementary memory types from successful teacher trajectories: memory encodes task-level strategies, Subtask memory provides concrete behavioral examples, and Function memory captures per-function calling conventions.<n>We evaluate AMD on three tool-use benchmarks using four student models (4B-8B parameters) with GPT-5-mini as the teacher, achieving average accuracy gains of 27.2%p, 11.2%p, and 3.4%p on AppWorld, BFCL V
arXiv Detail & Related papers (2026-08-07T12:43:00Z) - Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents [72.3752981234916]
Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks.<n>We present Memory as a Controlled Process (MemCon), a framework that models memory operations as a Markov Decision Process.<n>MemCon consistently outperforms multiple memory baselines by up to 15.2 points in task success while reducing token consumption by 5-20%.
arXiv Detail & Related papers (2026-07-15T08:32:40Z) - AutoMem: Automated Learning of Memory as a Cognitive Skill [63.07128029793901]
We show that memory expertise is a learned skill.<n>We introduce AutoMem, a framework that automates the two axes of memory management.<n>Our results show that memory management is an independently learnable skill.
arXiv Detail & Related papers (2026-07-01T17:57:03Z) - Mandol: An Agglomerative Agent Memory System for Long-Term Conversations [19.51654277630379]
Mandol is an agglomerative memory system that consolidates fragmented memory representations and storage into a unified memory-native architecture.<n>Mandol achieves the best overall accuracy among representative agent memory systems.
arXiv Detail & Related papers (2026-06-29T04:43:29Z) - HAGE: Harnessing Agentic Memory via RL-Driven Weighted Graph Evolution [4.180315687162217]
HAGE is a weighted multi-relational memory framework for agentic large language model (LLM) systems.<n>Given a query, an LLM-based classifier identifies the relational intent, and a routing network dynamically modulates the corresponding dimensions of the edge embedding.<n>Traversal scores are computed via a learned combination of semantic similarity and these query-conditioned edge representations.
arXiv Detail & Related papers (2026-05-11T03:41:18Z) - HyperMem: Hypergraph Memory for Long-Term Conversations [26.215990473973665]
Long-term memory is essential for conversational agents to maintain coherence, track persistent tasks, and provide personalized interactions across extended dialogues.<n>We propose HyperMem, a hypergraph-based hierarchical memory architecture that explicitly models such associations using hyperedges.<n>We show that HyperMem achieves state-of-the-art performance with 92.73% LLM-as-a-judge accuracy, demonstrating the effectiveness of HyperMem for long-term conversations.
arXiv Detail & Related papers (2026-04-09T13:43:23Z) - PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agents [74.4491017652226]
We propose PlugMem, a task-agnostic memory module that can be attached to arbitrary LLM agents without task-specific redesign.<n>Motivated by the fact that decision-relevant information is concentrated as abstract knowledge rather than raw experience, we draw on cognitive science to structure episodic memories into a compact, knowledge-centric memory graph.<n>We evaluate PlugMem unchanged across three benchmarks (long-horizon conversational question answering, multi-hop knowledge retrieval, and web agent tasks)
arXiv Detail & Related papers (2026-02-06T18:55:38Z) - Learning to Share: Selective Memory for Efficient Parallel Agentic Systems [49.78267008828593]
Agentic systems solve complex tasks by coordinating multiple agents that iteratively reason, invoke tools, and exchange intermediate results.<n>Recent approaches deploy multiple agent teams running in parallel to explore diverse reasoning trajectories.<n>We propose Learning to Share (LTS), a learned shared-memory mechanism for parallel agentic frameworks.
arXiv Detail & Related papers (2026-02-05T18:20:21Z) - AMA: Adaptive Memory via Multi-Agent Collaboration [54.490349689939166]
We propose Adaptive Memory via Multi-Agent Collaboration (AMA), a novel framework that leverages coordinated agents to manage memory across multiple granularities.<n>AMA significantly outperforms state-of-the-art baselines while reducing token consumption by approximately 80% compared to full-context methods.
arXiv Detail & Related papers (2026-01-28T08:09:49Z) - G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems [44.844636264484905]
Large language model (LLM)-powered multi-agent systems (MAS) have demonstrated cognitive and execution capabilities that far exceed those of single LLM agents.<n>We introduce G-Memory, a hierarchical, agentic memory system for MAS inspired by organizational memory theory.<n>G-Memory improves success rates in embodied action and accuracy in knowledge QA by up to $20.89%$ and $10.12%$, respectively.
arXiv Detail & Related papers (2025-06-09T03:43:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.