AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines

• URL: http://arxiv.org/abs/2602.14296v1
• Date: Sun, 15 Feb 2026 20:03:19 GMT
• Title: AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines
• Abstract summary: AutoWebWorld is a framework for synthesizing controllable and verifiable web environments.<n>Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules.<n>It generates over 11,663 verified trajectories from 29 diverse web environments at only $0.04 per trajectory.
• Score: 43.251303612671194
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The performance of autonomous Web GUI agents heavily relies on the quality and quantity of their training data. However, a fundamental bottleneck persists: collecting interaction trajectories from real-world websites is expensive and difficult to verify. The underlying state transitions are hidden, leading to reliance on inconsistent and costly external verifiers to evaluate step-level correctness. To address this, we propose AutoWebWorld, a novel framework for synthesizing controllable and verifiable web environments by modeling them as Finite State Machines (FSMs) and use coding agents to translate FSMs into interactive websites. Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules. This enables programmatic verification: action correctness is checked against predefined rules, and task success is confirmed by reaching a goal state in the FSM graph. AutoWebWorld enables a fully automated search-and-verify pipeline, generating over 11,663 verified trajectories from 29 diverse web environments at only $0.04 per trajectory. Training on this synthetic data significantly boosts real-world performance. Our 7B Web GUI agent outperforms all baselines within 15 steps on WebVoyager. Furthermore, we observe a clear scaling law: as the synthetic data volume increases, performance on WebVoyager and Online-Mind2Web consistently improves.

Related papers

• Training Needs Trustworthy Worlds: Verified Synthetic Web Environments for Agent Learning [48.88985618650394]
  Our framework represents each generated website as a structured scaffold of pages, navigation links, database records, state-change markers, and task constraints.<n>During interaction, ordinary UI transitions are executed deterministically, while persistent backend updates are invoked only through validated state-change markers.<n>Across 500 synthetic environments spanning six domains, our method reduces task-blocking defects and improves feasible-task rate from 48.6% to 94.8%.
  arXiv  Detail & Related papers  (2026-08-22T10:18:45Z)
• GTA: Generating Long-Horizon Tasks for Web Agents at Scale [82.43869456830664]
  We introduce a scalable framework, GTA, that integrates crawling, retrieval-based seeding, in-context generation, and automated quality control.<n>We instantiate the pipeline on over 50 websites covering e-commerce, government, forums, and news, with multilingual and multi-hop coverage.<n>Our contributions are three-fold: (i) formalizing multi-hop web-agent task generation, (ii) proposing an efficient and validated pipeline for automatic data creation, and (iii) releasing a dynamic benchmark with reproducible evaluation.
  arXiv  Detail & Related papers  (2026-05-28T01:05:50Z)
• Weblica: Scalable and Reproducible Training Environments for Visual Web Agents [5.132610127852326]
  Weblica is a framework for constructing reproducible and scalable web environments.<n>We scale RL training to thousands of diverse environments and tasks.<n>Our best model, Weblica-8B, outperforms open-weight baselines of similar size across multiple web navigation benchmarks.
  arXiv  Detail & Related papers  (2026-05-07T17:17:10Z)
• WebTestBench: Evaluating Computer-Use Agents towards End-to-End Automated Web Testing [57.7131457251794]
  We introduce WebTestBench, a benchmark for evaluating end-to-end automated web testing.<n>We decompose the testing process into two cascaded sub-tasks, checklist generation and defect detection, and propose WebTester.<n>Our findings expose a substantial gap between current computer-use agent capabilities and industrial-grade deployment demands.
  arXiv  Detail & Related papers  (2026-03-26T09:27:29Z)
• Safe and Scalable Web Agent Learning via Recreated Websites [27.277983097111335]
  Training web agents is fundamentally limited by environments they learn from.<n>We propose a framework that treats language models as environment creators, automatically cloning real-world websites into verifiable synthetic environments.
  arXiv  Detail & Related papers  (2026-03-11T07:58:53Z)
• WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents [20.85611634311147]
  We introduce WebFactory, a novel, fully automated closed-loop reinforcement learning pipeline for GUI agents.<n>Our agent demonstrates exceptional data efficiency and generalization.<n>This work presents a scalable and cost-effective paradigm for transforming passive internet knowledge into active, grounded intelligence.
  arXiv  Detail & Related papers  (2026-03-05T10:51:34Z)
• WebWorld: A Large-Scale World Model for Web Agent Training [59.59257499344279]
  We introduce textbfWebWorld series, the first open-web simulator trained at scale.<n>WebWorld trains on 1M+ open-web interactions, supporting reasoning, multi-format data, and long-horizon simulations of 30+ steps.<n>We show that Qwen3-14B trained on WebWorld-synthesized trajectories improves by +9.2% on WebArena, reaching performance comparable to GPT-4o.
  arXiv  Detail & Related papers  (2026-02-16T13:06:49Z)
• InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training [24.578304125533734]
  We present InfiniteWeb, a system that automatically generates functional web environments at scale for GUI agent training.<n>We address challenges through unified specification, task-centric test-driven development, and a combination of website seed with reference design image.<n>Experiments show that InfiniteWeb surpasses commercial coding agents at realistic website construction.
  arXiv  Detail & Related papers  (2026-01-07T17:40:08Z)
• Web World Models [60.208836336654315]
  We introduce the Web World Model (WWM), a middle ground where world state and physics'' are implemented in ordinary web code.<n>We build a suite of WWMs on a realistic web stack, including an infinite travel atlas grounded in real geography, fictional galaxy explorers, web-scale encyclopedic and narrative worlds, and simulation- and game-like environments.<n>Our results suggest that web stacks themselves can serve as a scalable substrate for world models, enabling controllable yet open-ended environments.
  arXiv  Detail & Related papers  (2025-12-29T18:31:45Z)
• WebRenderBench: Enhancing Web Interface Generation through Layout-Style Consistency and Reinforcement Learning [24.178675410636135]
  We present a large-scale benchmark of 45.1k webpages collected from real-world portal sites.<n>We also propose a novel evaluation metric that measures layout and style consistency from the final rendered pages.
  arXiv  Detail & Related papers  (2025-10-05T08:47:39Z)
• IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video? [56.33950760097989]
  IWR-Bench is a novel benchmark for evaluating the capabilities of Large Vision-Language Models (LVLMs) in interactive webpage reconstruction from video.<n>IWR-Bench comprises 113 meticulously curated tasks from 100 real-world websites, with 1,001 actions.<n>This benchmark evaluates models on two fundamental challenges: comprehensive multi-modal reasoning to infer interaction logic from video and assets, and advanced code generation to translate this logic into functional code.
  arXiv  Detail & Related papers  (2025-09-29T12:38:06Z)
• Redefining Website Fingerprinting Attacks With Multiagent LLMs [2.7117643001081437]
  Website Fingerprinting (WFP) uses deep learning models to classify encrypted network traffic to infer visited websites.<n>Our study reveals that users exhibit highly diverse behaviors even on the same website, producing traffic patterns that vary significantly across individuals.
  arXiv  Detail & Related papers  (2025-09-15T21:17:04Z)
• NetGent: Agent-Based Automation of Network Application Workflows [10.829519766490014]
  We present NetGent, an AI-agent framework for automating complex application to generate realistic network traffic datasets.<n>In experiments, NetGent automated more than 50+ interfaces spanning video-on-demand streaming, live video streaming, video conferencing, social media, and web scraping.
  arXiv  Detail & Related papers  (2025-08-30T22:47:15Z)
• WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis [34.998277998052444]
  We propose WebSynthesis, a novel framework for trajectory synthesis and training.<n>We show that an agent trained using WebSynthesis on a small-scale synthetic dataset achieves performance comparable to or even surpassing that of models trained on large-scale real-world data.
  arXiv  Detail & Related papers  (2025-07-06T12:31:10Z)
• REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites [9.58858258192147]
  We introduce REAL, a benchmark and framework for multi-turn agent evaluations on deterministic simulations of real-world websites.<n>We also release a benchmark consisting of 112 practical tasks that mirror everyday complex user interactions.<n>Our framework supports easy integration of new tasks, reproducible evaluation, and scalable post-training data generation.
  arXiv  Detail & Related papers  (2025-04-15T18:22:55Z)
• AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials [53.376263056033046]
  Existing approaches rely on expensive human annotation, making them unsustainable at scale.<n>We propose AgentTrek, a scalable data synthesis pipeline that generates web agent trajectories by leveraging publicly available tutorials.<n>Our fully automated approach significantly reduces data collection costs, achieving a cost of just $0.55 per high-quality trajectory without human annotators.
  arXiv  Detail & Related papers  (2024-12-12T18:59:27Z)
• WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models [65.18602126334716]
  Existing web agents typically only handle one input modality and are evaluated only in simplified web simulators or static web snapshots. We introduce WebVoyager, an innovative Large Multimodal Model (LMM) powered web agent that can complete user instructions end-to-end by interacting with real-world websites. We show that WebVoyager achieves a 59.1% task success rate on our benchmark, significantly surpassing the performance of both GPT-4 (All Tools) and the WebVoyager (text-only) setups.
  arXiv  Detail & Related papers  (2024-01-25T03:33:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.