GitSkills: A Dataset of Agent Skills on GitHub

• URL: http://arxiv.org/abs/2608.10906v1
• Date: Tue, 11 Aug 2026 13:28:27 GMT
• Title: GitSkills: A Dataset of Agent Skills on GitHub
• Abstract summary: Anthropic introduced the format in October 2025 as an open specification.<n>GitSkills is a dataset of 3,797,117 SKILL.md files collected from 282,200 public repositories in July 2026.
• Score: 2.4569987564636726
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: An agent skill is a folder containing a SKILL.md file with instructions for a language-model agent, optionally accompanied by scripts and reference files. The agent loads the skill when it judges that a task matches the skill description. Anthropic introduced the format in October 2025 as an open specification. Nine months later, we find that skill files in the millions sit in public GitHub repositories. Skills are unlike the artifacts the SE research community usually mines: they are written mainly in natural language, a model selects them probabilistically at run time, and no compiler or type checker verifies the selection. They also have no central registry or package manager, so they spread by copying folders between repositories. How developers write, reuse, and maintain skills is therefore an empirical question, and no existing dataset records this population. We present GitSkills, a dataset of 3,797,117 SKILL.md files collected from 282,200 public repositories in July 2026. The dataset retains every file occurrence with its repository, path, and content hash. It groups identical files into 1,877,981 distinct contents and enriches one representative per group with the full text, parsed front matter, folder contents, repository metadata, and, for a subset, the commit history of the file. A single self- contained SQLite file supports research on the adoption, reuse, structure, authorship, maintenance, and security of agent skills.

Related papers

• Skill Issue: Lessons from Optimizing Repository SKILLs for Coding Agents [0.09558392439655013]
  Coding agents increasingly read repository knowledge from SKILLs.<n>Recent work synthesizes these files automatically, by optimizing the document against a benchmark.<n>We mine harder tasks --- merged pull requests of the repository, reverted at a single frozen base commit; and score a candidate document by whether the same agent does better with it than without it.
  arXiv  Detail & Related papers  (2026-09-11T11:41:29Z)
• SpecMine: A Large-Scale Corpus of Spec-Driven Development Artifacts [7.933620345044633]
  SpecMine captures Spec-Driven Development (SDD) in public GitHub repositories.<n>It lets the community study, for the first time, how software is specified in the age of AI agents.
  arXiv  Detail & Related papers  (2026-08-25T22:43:30Z)
• Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainability [49.415740364852105]
  Deployed agents increasingly keep their long-term memory as a directory tree of markdown files that the agent itself reads, writes, and reorganizes through generic file tools.<n>Prior systems design bespoke memory representations and study retrieval over them, leaving the default's two working assumptions untested.<n>We present the first systematic exploration of chunk-based memory for LLM agents.
  arXiv  Detail & Related papers  (2026-07-29T08:59:43Z)
• Tencent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Construction [57.138342889101345]
  Tencent WorkBuddy Bench is a multi-domain evaluation suite for coding agents.<n>This report documents its construction methodology, scoring protocol, and a cross-model leaderboard.
  arXiv  Detail & Related papers  (2026-07-23T04:34:06Z)
• VISUALSKILL: Multimodal Skills for Computer-Use Agents [63.79539541125141]
  We propose VISUALSKILL: a hierarchical multimodal skill tailored to each target application.<n>We construct each skill with a two-stage pipeline that combines authored documentation with live-application UI exploration.<n>On two CUA benchmarks, a Claude Code CLI agent backed by Claude Opus 4.6 reaches an average score of 0.456 with VISUALSKILL.
  arXiv  Detail & Related papers  (2026-06-16T19:57:07Z)
• COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation [58.84646485020439]
  We present an automated trace-to-skill distillation system for generating person-grounded AI skills.<n> COLLEAGUE.SKILL produces a versioned skill package with two tracks: a capability track for practices, mental models, and decisions, and a bounded behavior track for communication style, interaction rules, and correction history.
  arXiv  Detail & Related papers  (2026-05-29T12:59:08Z)
• Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registry [49.83108591873481]
  We study SKILL.md - only attacks across three registry-facing stages of the Agent Skill lifecycle.<n>We show that SKILL.md is not passive documentation but operational text that shapes which third-party capabilities agents find, trust, and use.
  arXiv  Detail & Related papers  (2026-05-12T02:11:54Z)
• Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents? [3.2610504259514754]
  We study whether context files are effective for real-world tasks.<n>We find that context files tend to reduce task success rates compared to providing no repository context.<n>We conclude that unnecessary requirements from context files make tasks harder, and human-written context files should describe only minimal requirements.
  arXiv  Detail & Related papers  (2026-02-12T14:15:22Z)
• FS-Researcher: Test-Time Scaling for Long-Horizon Research Tasks with File-System-Based Agents [53.03492387564392]
  We introduce FS-Researcher, a file-system-based framework that scales deep research beyond the context window via a persistent workspace.<n>A Context Builder agent browses the internet, writes structured notes, and archives raw sources into a hierarchical knowledge base that can grow far beyond context length.<n>A Report Writer agent then composes the final report section by section, treating the knowledge base as the source of facts.
  arXiv  Detail & Related papers  (2026-02-02T03:00:19Z)
• Agent READMEs: An Empirical Study of Context Files for Agentic Coding [8.019313057979522]
  We study 2,303 agent context files from 1,925 repositories to characterize their structure, maintenance, and content.<n>We find that these files are not static documentation but complex, difficult-to-read artifacts that evolve like configuration code, maintained through frequent, small additions.<n>These findings indicate that while developers use context files to make agents functional, they provide few guardrails to ensure that agent-written code is secure or performant, highlighting the need for improved tooling and practices.
  arXiv  Detail & Related papers  (2025-11-17T02:18:55Z)
• Repository-Aware File Path Retrieval via Fine-Tuned LLMs [0.11726720776908518]
  Large language models (LLMs) understand natural language but lack repository specific detail.<n>We present a method for file path retrieval that fine tunes a strong LLM with QLoRA and Unsloth optimizations.<n>We fine tune on Python projects including Flask, Click, Jinja, FastAPI, and PyTorch, and obtain high retrieval accuracy.
  arXiv  Detail & Related papers  (2025-10-09T22:49:10Z)
• Repository-level Code Search with Neural Retrieval Methods [25.222964965449286]
  We define the task of repository-level code search as retrieving the set of files from the current state of a code repository that are most relevant to addressing a user's question or bug.<n>The proposed approach combines BM25-based retrieval over commit messages with neural reranking using CodeBERT to identify the most pertinent files.<n> Experiments on a new dataset created from 7 popular open-source repositories demonstrate substantial improvements of up to 80% in MAP, MRR and P@1 over the BM25 baseline.
  arXiv  Detail & Related papers  (2025-02-10T21:59:01Z)
• An Empirical Study of Dotfiles Repositories Containing User-Specific Configuration Files [1.7556600627464058]
  Hundreds of thousands choose to publicly host their repositories on GitHub.<n>We collected and analyzed publicly-hosted dotfiles repositories on GitHub.<n>We found that 25.8% of the top 500 most-starred GitHub users maintain some form of publicly accessible dotfiles repository.
  arXiv  Detail & Related papers  (2025-01-30T18:32:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.