Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
- URL: http://arxiv.org/abs/2602.08004v1
- Date: Sun, 08 Feb 2026 15:14:12 GMT
- Title: Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
- Abstract summary: Agent skills extend large language model (LLM) agents with reusable, program-like modules.<n>We conduct a large-scale, data-driven analysis of 40,285 publicly listed skills from a major marketplace.<n>Our results show that skill publication tends to occur in short bursts that track shifts in community attention.
- Score: 9.192260493061754
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Agent skills extend large language model (LLM) agents with reusable, program-like modules that define triggering conditions, procedural logic, and tool interactions. As these skills proliferate in public marketplaces, it is unclear what types are available, how users adopt them, and what risks they pose. To answer these questions, we conduct a large-scale, data-driven analysis of 40,285 publicly listed skills from a major marketplace. Our results show that skill publication tends to occur in short bursts that track shifts in community attention. We also find that skill content is highly concentrated in software engineering workflows, while information retrieval and content creation account for a substantial share of adoption. Beyond content trends, we uncover a pronounced supply-demand imbalance across categories, and we show that most skills remain within typical prompt budgets despite a heavy-tailed length distribution. Finally, we observe strong ecosystem homogeneity, with widespread intent-level redundancy, and we identify non-trivial safety risks, including skills that enable state-changing or system-level actions. Overall, our findings provide a quantitative snapshot of agent skills as an emerging infrastructure layer for agents and inform future work on skill reuse, standardization, and safety-aware design.
Related papers
- Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluation [0.0]
We present SkillSec-Eval, a lifecycle-aware framework for evaluating the security of reusable agent skills.<n>We first characterize the skill lifecycle and develop a threat taxonomy spanning repository admission, semantic retrieval, planner selection, execution, and skill evolution.<n>We then instantiate this taxonomy in SkillSec-Eval and conduct a comprehensive empirical evaluation using a repository of 327 real-world skills.
arXiv Detail & Related papers (2026-07-15T16:15:46Z) - SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization [99.18305770138677]
Agent skills are reusable strategies that guide agent reasoning and action.<n>Current skill construction methods treat the problem as one-shot extraction.<n>We introduce SkillComposer, a framework that decomposes skill construction into three learnable operations.
arXiv Detail & Related papers (2026-06-04T12:16:08Z) - From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skills [46.76651106969111]
We show that model-generated skills are beneficial on average but exhibit non-trivial negative transfer.<n>A model can be a strong extractor yet a weak consumer, or vice versa, with skill utility independent of model scale or baseline task strength.<n>We translate these findings into a concrete emphmeta-skill that guides skill extraction.
arXiv Detail & Related papers (2026-05-22T17:59:12Z) - Red Skills or Blue Skills? A Dive Into Skills Published on ClawHub [6.900491771165292]
We study the functionality, ecosystem structure, and security risks of public skill registries.<n>We build and normalize a dataset of 26,502 skills, and conduct a systematic analysis of their language distribution, functional organization, popularity, and security signals.<n>Our findings position public skill registries as both a key enabler of agent capability reuse and a new surface for ecosystem-scale security risk.
arXiv Detail & Related papers (2026-03-19T14:31:22Z) - SoK: Agentic Skills -- Beyond Tool Use in LLM Agents [6.356997609995175]
Agentic systems increasingly rely on reusable procedural capabilities, textita.k.a., agentic skills, to execute long-horizon reliably.<n>This paper maps the skill layer across the full lifecycle (discovery, practice, distillation, storage, composition, evaluation, and update)<n>We analyze the security and governance implications of skill-based agents, covering supply-chain risks, prompt injection via skill payloads, and trust-tiered execution.
arXiv Detail & Related papers (2026-02-24T13:11:38Z) - Agent Skill Framework: Perspectives on the Potential of Small Language Models in Industrial Environments [14.079091139464175]
This work introduces a formal mathematical definition of the Agent Skill process, followed by a systematic evaluation of language models of varying sizes.<n>Results show that tiny models struggle with reliable skill selection, while moderately sized SLMs (approximately 12B - 30B) benefit substantially from the Agent Skill approach.
arXiv Detail & Related papers (2026-02-18T17:52:17Z) - Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward [5.124116559484265]
The transition from monolithic language models to modular, skill-equipped agents marks a defining shift in how large language models (LLMs) are deployed in practice.<n>Rather than encoding all procedural knowledge within model weights, agent skills enable dynamic capability extension without retraining.<n>This survey provides a comprehensive treatment of the agent skills landscape, as it has rapidly evolved during the last few months.
arXiv Detail & Related papers (2026-02-12T21:33:25Z) - Auxiliary Metrics Help Decoding Skill Neurons in the Wild [52.148049490080496]
We introduce a simple, lightweight, and broadly applicable method for isolating neurons that encode specific skills.<n>We correlate neuron activations with auxiliary metrics, such as external labels and the model's own confidence score.<n>We empirically validate our method on tasks spanning open-ended text generation and natural language inference.
arXiv Detail & Related papers (2025-11-26T17:31:53Z) - WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning [73.91893534088798]
WebSailor is a complete post-training methodology designed to instill this crucial capability.<n>Our approach involves generating novel, high-uncertainty tasks through structured sampling and information obfuscation.<n>WebSailor significantly outperforms all open-source agents in complex information-seeking tasks.
arXiv Detail & Related papers (2025-09-16T17:57:03Z) - Data to Decisions: A Computational Framework to Identify skill requirements from Advertorial Data [1.5621498886998335]
The proposed framework uses techniques of statistical analysis, data mining and natural language processing for the purpose.<n>The analytical results not only provide useful insights about current state of skill needs in CS&IT industry but also provide practical implications to prospective job applicants, training agencies, and institutions of higher education & professional training.
arXiv Detail & Related papers (2025-03-21T09:49:31Z) - Tec-Habilidad: Skill Classification for Bridging Education and Employment [0.7373617024876725]
This paper develops a Spanish language dataset for skill extraction and classification.<n>It provides annotation methodology to distinguish between knowledge, skill, and abilities.<n>It also provides deep learning baselines to advance robust solutions for skill classification.
arXiv Detail & Related papers (2025-03-05T22:05:42Z) - An Overview of Large Language Models for Statisticians [109.38601458831545]
Large Language Models (LLMs) have emerged as transformative tools in artificial intelligence (AI)<n>This paper explores potential areas where statisticians can make important contributions to the development of LLMs.<n>We focus on issues such as uncertainty quantification, interpretability, fairness, privacy, watermarking and model adaptation.
arXiv Detail & Related papers (2025-02-25T03:40:36Z) - Acquiring Diverse Skills using Curriculum Reinforcement Learning with Mixture of Experts [58.220879689376744]
Reinforcement learning (RL) is a powerful approach for acquiring a good-performing policy.
We propose textbfDiverse textbfSkill textbfLearning (Di-SkilL) for learning diverse skills.
We show on challenging robot simulation tasks that Di-SkilL can learn diverse and performant skills.
arXiv Detail & Related papers (2024-03-11T17:49:18Z) - ExpeL: LLM Agents Are Experiential Learners [57.13685954854463]
We introduce the Experiential Learning (ExpeL) agent to allow learning from agent experiences without requiring parametric updates.<n>Our agent autonomously gathers experiences and extracts knowledge using natural language from a collection of training tasks.<n>At inference, the agent recalls its extracted insights and past experiences to make informed decisions.
arXiv Detail & Related papers (2023-08-20T03:03:34Z) - A Theory for Emergence of Complex Skills in Language Models [56.947273387302616]
A major driver of AI products today is the fact that new skills emerge in language models when their parameter set and training corpora are scaled up.
This paper takes a different approach, analysing emergence using the famous (and empirical) Scaling Laws of LLMs and a simple statistical framework.
arXiv Detail & Related papers (2023-07-29T09:22:54Z) - Design of Negative Sampling Strategies for Distantly Supervised Skill
Extraction [19.43668931500507]
We propose an end-to-end system for skill extraction, based on distant supervision through literal matching.
We observe that using the ESCO taxonomy to select negative examples from related skills yields the biggest improvements.
We release the benchmark dataset for research purposes to stimulate further research on the task.
arXiv Detail & Related papers (2022-09-13T13:37:06Z) - "FIJO": a French Insurance Soft Skill Detection Dataset [0.0]
This article proposes a new public dataset, FIJO, containing insurance job offers, including many soft skill annotations.
We present the results of skill detection algorithms using a named entity recognition approach and show that transformers-based models have good token-wise performances on this dataset.
arXiv Detail & Related papers (2022-04-11T15:54:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.