Imagine Before Retrieval: Prospective Skill Retrieval for LLM Agents
- URL: http://arxiv.org/abs/2609.01642v1
- Date: Fri, 28 Aug 2026 13:19:50 GMT
- Title: Imagine Before Retrieval: Prospective Skill Retrieval for LLM Agents
- Abstract summary: We propose SkillDreamer, a novel framework to alleviate the negative impact of Query--Skill Misalignment (QSM) problem.<n>In brief, SkillDreamer infers the capabilities necessary for task execution, then imagines how to realize these capabilities by generating pseudo skills.<n> Extensive experiments on SkillRet and SkillUsage prove the effectiveness of SkillDreamer in both skill retrieval and end-to-end task execution.
- Score: 19.57498769577715
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Skill retrieval has recently emerged as a promising paradigm for identifying the desirable execution guidelines from the skill gallery, thus equipping large language model (LLM) agents with the procedural knowledge to accomplish the specified task. To this end, most existing methods customize the retrieval model or reconfigure the retrieval pipeline to prioritize skills that are most semantically relevant to the task query. However, we empirically reveal that task queries and skills are naturally formulated from different perspectives, namely, objective-oriented and procedural-oriented, leading to an under-explored problem termed Query--Skill Misalignment (QSM). Clearly, it is daunting and even impossible to associate the desirable skills in the context of QSM, thus hindering the agent from correctly executing the task. As a remedy, inspired by human prospective cognition, we propose SkillDreamer, a novel framework to alleviate the negative impact of QSM problem. In brief, SkillDreamer first infers the capabilities necessary for task execution, then imagines how to realize these capabilities by generating pseudo skills, and finally leverages such prospective information to bridge the gap between objective-oriented task queries and execution-oriented skills. Extensive experiments on SkillRet and SkillUsage not only verify the effectiveness of SkillDreamer in both skill retrieval and end-to-end task execution, but also demonstrate its generalizability across diverse retrieval models and pipelines. The code will be released upon acceptance.
Related papers
- Break It Down, Pass It On: Cross-Task Skill Transfer in LLM Agents [17.291924088593408]
Large language model (LLM) agents can induce skills from completed tasks and reuse them later to grow more capable with experience.<n>In practice, induced skills may transfer unreliably and can even harm the agent that retrieves them.<n>We conduct a comprehensive and controlled study of how the way skills are induced shapes their transfer across tasks.
arXiv Detail & Related papers (2026-08-20T17:12:08Z) - SkillReason: Reasoning-Enhanced Agent Skill Retrieval for Implicit User Requests [13.420494836976033]
We introduce SkillReason-Bench, a large-scale cross-domain benchmark containing 3,729 queries and a retrieval corpus of 61,228 skills spanning nine domains.<n>We propose SkillRea- son, a two-stage framework that uses chain-of-thought rea- soning as training-time supervision for skill retrieval.<n>Experiments on SkillReason-Bench, SkillRet, and SRA-Bench show that Skill- Reason achieves state-of-the-art performance across all three benchmarks.
arXiv Detail & Related papers (2026-08-09T11:19:20Z) - SkillAligner: Treating Retrieved Skills as Adaptable Drafts at Execution Time [14.34844805305673]
General-purpose skills promise reusable procedural knowledge for language agents.<n>But semantic relevance does not guarantee execution utility.<n>We propose SkillAligner, a training-free execution-time skill adaptation framework.
arXiv Detail & Related papers (2026-08-07T07:05:53Z) - Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills [53.15216425100295]
We introduce Skill Self-Play (Skill-SP), a co-evolutionary framework comprising a proposer, a solver, and a skill controller.<n>The proposer generates challenging tasks conditioned on dynamically sampled skills; the solver explores candidate solutions to push its capability boundaries; and the skill controller collects execution feedback to update and expand the skill library.<n>This interactive co-evolution effectively bridges the gap between structured verification and open-ended exploration.
arXiv Detail & Related papers (2026-07-24T17:59:22Z) - Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrieval [16.270741233471107]
We propose SkillReranker, an inference-time reranking framework for adaptive skill selection.<n>We show that SkillReranker effectively improves task performance, reduces environment interaction steps, and lowers token consumption.
arXiv Detail & Related papers (2026-07-07T13:49:08Z) - SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization [99.18305770138677]
Agent skills are reusable strategies that guide agent reasoning and action.<n>Current skill construction methods treat the problem as one-shot extraction.<n>We introduce SkillComposer, a framework that decomposes skill construction into three learnable operations.
arXiv Detail & Related papers (2026-06-04T12:16:08Z) - Decompose and Recompose: Reasoning New Skills from Existing Abilities for Cross-Task Robotic Manipulation [45.91196295385836]
Cross-task generalization is a core challenge in open-world robotic manipulation.<n>We propose Decompose and Recompose, a skill reasoning framework using atomic skill-action pairs as intermediate representations.<n>Our approach decomposes seen demonstrations into interpretable skill--action alignments, enabling the model to recompose these skills for unseen tasks.
arXiv Detail & Related papers (2026-05-02T13:55:28Z) - Learning Task Representations from In-Context Learning [67.66042137487287]
Large language models (LLMs) have demonstrated remarkable proficiency in in-context learning (ICL)<n>We introduce an automated formulation for encoding task information in ICL prompts as a function of attention heads.<n>The proposed method successfully extracts task-specific information from in-context demonstrations and excels in both text and regression tasks.
arXiv Detail & Related papers (2025-02-08T00:16:44Z) - Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks [71.19560970717495]
Recent language models show impressive performance across a wide range of tasks.
Are these skills general and transferable, or specialized to specific tasks seen during pretraining?
We propose an evaluation framework based on "counterfactual" task variants that deviate from the default assumptions underlying standard tasks.
arXiv Detail & Related papers (2023-07-05T17:50:42Z) - Learning Options via Compression [62.55893046218824]
We propose a new objective that combines the maximum likelihood objective with a penalty on the description length of the skills.
Our objective learns skills that solve downstream tasks in fewer samples compared to skills learned from only maximizing likelihood.
arXiv Detail & Related papers (2022-12-08T22:34:59Z) - Hierarchical Few-Shot Imitation with Skill Transition Models [66.81252581083199]
Few-shot Imitation with Skill Transition Models (FIST) is an algorithm that extracts skills from offline data and utilizes them to generalize to unseen tasks.
We show that FIST is capable of generalizing to new tasks and substantially outperforms prior baselines in navigation experiments.
arXiv Detail & Related papers (2021-07-19T15:56:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.