Beyond Domains: Reusing Web Skills via Transferable Interaction Patterns

• URL: http://arxiv.org/abs/2606.17645v1
• Date: Tue, 16 Jun 2026 08:04:35 GMT
• Title: Beyond Domains: Reusing Web Skills via Transferable Interaction Patterns
• Abstract summary: SkillMigrator learns reusable web skills and transfers them across sites by matching layout structure rather than specific element references.<n>It reduces the average LLM-action count on successful trajectories by 8-10% across both WebArena and Mind2Web at matched success rate.
• Score: 68.0603867264595
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large language model (LLM) web agents are usually deployed as tool callers: each turn, the model reads a fresh page observation and emits one structured tool action. When every action is a low-level primitive, horizons grow quickly and so do policy-facing LLM completions, dominating latency and cost on benchmarks such as Mind2Web and WebArena. Recent systems therefore wrap repeated interaction fragments as web skills: callable tools built from successful trajectories or induced programs, so one call can replace several primitives. However, prior skill libraries are still triggered mainly by instruction similarity or coarse site metadata, which yields low skill reuse on held-out sites and leaves much of the potential step and token reduction on the table. We present SkillMigrator, an agent that learns reusable web skills and transfers them across sites by matching layout structure rather than specific element references. Each induced skill is stored as a transferable interaction pattern (TIP): the skill paired with a structural sketch of the snapshot at induction time. At test time, SkillMigrator retrieves TIPs by layout similarity and grounds their references on the live page. The rest of the stack is standard: accessibility-snapshot observations with stable references, and fixed tool calling over primitives plus skill invocations. Compared with the state-of-the-art approaches, SkillMigrator reduces the average LLM-action count on successful trajectories by 8-10% across both WebArena and Mind2Web at matched success rate.

Related papers

• PRACTICE: From Experience to Expertise in Self-Evolving Embodied Agents [8.367852606377419]
  We train a skill learner to discover and maintain a persistent skill library from past interaction trajectories.<n>We apply online skill-edit distillation to align the skill learner with a stronger teacher on its current edit distribution.<n>Experiments demonstrate that a compact skill learner delivers consistent performance improvements across successive library-update rounds.
  arXiv  Detail & Related papers  (2026-08-31T13:26:16Z)
• SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction [13.7368753473801]
  textscScaffold is a self-improving framework for visual web agents.<n>It induces parametric, executable skills from successful trajectories under a multi-instance abstraction constraint.<n>textscScaffold improves success rate by $11.1$--$17.2$ absolute points over the strongest skill-augmented baseline.
  arXiv  Detail & Related papers  (2026-08-31T08:16:56Z)
• HiSkill: Empowering LLM Agents with Hierarchical Skill Graphs [27.33052401264838]
  HiSkill is a hierarchical skill graph framework that organizes interaction trajectories into a directed graph with skill nodes, AtomicOp nodes, and typed edges.<n>It connects reusable high-level skills with executable action templates, while also capturing decomposition, temporal transition, compatibility, support, and recovery relations.<n>Experiments show that HiSkill outperforms state-of-the-art baselines while reducing inference token consumption.
  arXiv  Detail & Related papers  (2026-07-28T15:25:47Z)
• Online Skill Learning for Web Agents via State-Grounded Dynamic Retrieval [41.11944743292013]
  State-Grounded Dynamic Retrieval (SGDR) is an online skill learning method that enables stepwise skill reuse for web agents.<n>SGDR consists of three components: a sliding-window extraction process that turns completed trajectories into reusable sub-procedures invokable at intermediate execution states, a dual text-code representation that connects skill retrieval with executable action, and a state-grounded dynamic retrieval mechanism that matches skills to both the task goal and the current webpage state.
  arXiv  Detail & Related papers  (2026-06-03T03:11:50Z)
• GTA: Generating Long-Horizon Tasks for Web Agents at Scale [82.43869456830664]
  We introduce a scalable framework, GTA, that integrates crawling, retrieval-based seeding, in-context generation, and automated quality control.<n>We instantiate the pipeline on over 50 websites covering e-commerce, government, forums, and news, with multilingual and multi-hop coverage.<n>Our contributions are three-fold: (i) formalizing multi-hop web-agent task generation, (ii) proposing an efficient and validated pipeline for automatic data creation, and (iii) releasing a dynamic benchmark with reproducible evaluation.
  arXiv  Detail & Related papers  (2026-05-28T01:05:50Z)
• SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphs [70.1970574147839]
  We propose SKILLGRAPH, a framework that represents reusable skills as nodes in a directed graph.<n>SKILLGRAPH retrieves not just individual skills, but an ordered skill subgraph that can guide multi-step decision making.<n> Experiments show that SKILLGRAPH achieves state-of-the-art performance against memory-augmented RL methods.
  arXiv  Detail & Related papers  (2026-05-12T12:21:49Z)
• DRIVE: Modeling Skills at the Reasoning and Interaction Levels for Web Agents under Continual Learning [17.92660876001036]
  Web agents require both high-level reasoning and low-level interactions to conduct different tasks.<n>We propose DRIVE, a dual-level skill modeling framework separating historical experience into natural language reasoning skills.<n>Experiments show DRIVE attains an average task success rate of 52.8%, exceeding the skill-free baseline by 7.3 percentage points.
  arXiv  Detail & Related papers  (2026-04-28T11:39:20Z)
• WebXSkill: Skill Learning for Autonomous Web Agents [104.76374637691212]
  WebXSkill is a framework that bridges the gap between code-based skills and natural language guidance.<n>On WebArena and WebVoyager, WebXSkill improves task success rate by up to 9.8 and 12.9 points over the baseline.
  arXiv  Detail & Related papers  (2026-04-14T21:48:15Z)
• PAFFA: Premeditated Actions For Fast Agents [19.576180667174366]
  We introduce PAFFA, a method that makes LLMs faster and more accurate in completing tasks on the internet using a novel inference-time technique.<n>PAFFA drastically reduces inference time tokens by 87% while maintaining robust performance.<n>Unravel's ability to update its action library based on explorations allows generalization and adaptation to unseen websites.
  arXiv  Detail & Related papers  (2024-12-10T22:51:31Z)
• AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generation [54.17246674188208]
  Web scraping is a powerful technique that extracts data from websites, enabling automated data collection, enhancing data analysis capabilities, and minimizing manual data entry efforts. Existing methods, wrappers-based methods suffer from limited adaptability and scalability when faced with a new website. We introduce the paradigm of generating web scrapers with large language models (LLMs) and propose AutoScraper, a two-stage framework that can handle diverse and changing web environments more efficiently.
  arXiv  Detail & Related papers  (2024-04-19T09:59:44Z)
• Many or Few Samples? Comparing Transfer, Contrastive and Meta-Learning in Encrypted Traffic Classification [68.19713459228369]
  We compare transfer learning, meta-learning and contrastive learning against reference Machine Learning (ML) tree-based and monolithic DL models. We show that (i) using large datasets we can obtain more general representations, (ii) contrastive learning is the best methodology. While ML tree-based cannot handle large tasks but fits well small tasks, by means of reusing learned representations, DL methods are reaching tree-based models performance also for small tasks.
  arXiv  Detail & Related papers  (2023-05-21T11:20:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.