Training Needs Trustworthy Worlds: Verified Synthetic Web Environments for Agent Learning

• URL: http://arxiv.org/abs/2608.21898v1
• Date: Sat, 22 Aug 2026 10:18:45 GMT
• Title: Training Needs Trustworthy Worlds: Verified Synthetic Web Environments for Agent Learning
• Abstract summary: Our framework represents each generated website as a structured scaffold of pages, navigation links, database records, state-change markers, and task constraints.<n>During interaction, ordinary UI transitions are executed deterministically, while persistent backend updates are invoked only through validated state-change markers.<n>Across 500 synthetic environments spanning six domains, our method reduces task-blocking defects and improves feasible-task rate from 48.6% to 94.8%.
• Score: 48.88985618650394
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Web agents promise to automate complex digital workflows, but their training remains limited by synthetic environments that look plausible while hiding broken links, inconsistent states, or infeasible tasks. We address the gap between scalable environment generation and trustworthy agent learning by constructing synthetic web environments that are executable, auditable, and grounded in backend state. Our framework represents each generated website as a structured scaffold of pages, navigation links, database records, state-change markers, and task constraints, then verifies and repairs structural, semantic, consistency, and feasibility defects before policy training. During interaction, ordinary UI transitions are executed deterministically, while persistent backend updates are invoked only through validated state-change markers, enabling dense rewards compiled from verified task-progress predicates. Across 500 synthetic environments spanning six domains, our method reduces task-blocking defects and improves feasible-task rate from 48.6% to 94.8%, while producing stronger PPO policies and improving transfer to WebArena, WebShop, and MiniWoB++ without LLM calls at evaluation time. These results show that verified synthetic environments can serve as a scalable and reliable training substrate for compact web agents, shifting synthetic webagent learning from surface-level plausibility toward executable, state-grounded supervision.

Related papers

• FrogNano: Training a 4B Coding Agent via Online Task Synthesis [61.25325155871018]
  FrogNano is a 4B coding agent designed to tackle software engineering (SWE) tasks efficiently and effectively.<n>It is post-trained exclusively via RL on around 1,500 SWE environments with synthetic tasks.
  arXiv  Detail & Related papers  (2026-09-07T19:39:38Z)
• EnvHarness: Awakening Static Worlds for Agent Learning [58.54600450547412]
  Environment Harness wraps a static environment to reshape its behavior without modifying the underlying logic.<n>EnvHarness applies across diverse domains while ensuring every reshaped environment retains its original verifier.<n>EnvRigger treats the target policy as a black box, observing its execution trajectories to synthesize EnvHarness components targeting diagnosed flaws.
  arXiv  Detail & Related papers  (2026-08-20T10:42:06Z)
• Safe and Scalable Web Agent Learning via Recreated Websites [27.277983097111335]
  Training web agents is fundamentally limited by environments they learn from.<n>We propose a framework that treats language models as environment creators, automatically cloning real-world websites into verifiable synthetic environments.
  arXiv  Detail & Related papers  (2026-03-11T07:58:53Z)
• WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents [20.85611634311147]
  We introduce WebFactory, a novel, fully automated closed-loop reinforcement learning pipeline for GUI agents.<n>Our agent demonstrates exceptional data efficiency and generalization.<n>This work presents a scalable and cost-effective paradigm for transforming passive internet knowledge into active, grounded intelligence.
  arXiv  Detail & Related papers  (2026-03-05T10:51:34Z)
• SWE-World: Building Software Engineering Agents in Docker-Free Environments [91.17484806743641]
  SWE-World is a Docker-free framework that replaces physical execution environments with a learned surrogate for training and evaluating software engineering agents.<n>We show that SWE-World raises Qwen2.5-Coder-32B from 6.2% to 52.0% via Docker-free SFT, 55.0% with Docker-free RL, and 68.2% with further TTS.
  arXiv  Detail & Related papers  (2026-02-03T11:44:39Z)
• Adapting Web Agents with Synthetic Supervision [80.89365133130558]
  Web agents struggle to adapt to new websites due to the scarcity of environment specific tasks and demonstrations.<n>Recent works have explored synthetic data generation to address this challenge.<n>We propose SynthAgent, a fully synthetic supervision framework.
  arXiv  Detail & Related papers  (2025-11-08T18:45:33Z)
• SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments [2.184775414778289]
  We introduce setupbench, a benchmark that isolates the environment-bootstrap skill.<n>Our tasks span seven language ecosystems, five database engines, and multi-service orchestration scenarios.<n>We find low success rates across task categories, with particular challenges in repository setup (38.9-57.4%) and local database configuration (20.0-53.3%)
  arXiv  Detail & Related papers  (2025-07-11T22:45:07Z)
• WebSynthesis: World-Model-Guided MCTS for Efficient WebUI-Trajectory Synthesis [34.998277998052444]
  We propose WebSynthesis, a novel framework for trajectory synthesis and training.<n>We show that an agent trained using WebSynthesis on a small-scale synthetic dataset achieves performance comparable to or even surpassing that of models trained on large-scale real-world data.
  arXiv  Detail & Related papers  (2025-07-06T12:31:10Z)
• REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites [9.58858258192147]
  We introduce REAL, a benchmark and framework for multi-turn agent evaluations on deterministic simulations of real-world websites.<n>We also release a benchmark consisting of 112 practical tasks that mirror everyday complex user interactions.<n>Our framework supports easy integration of new tasks, reproducible evaluation, and scalable post-training data generation.
  arXiv  Detail & Related papers  (2025-04-15T18:22:55Z)
• WebArena: A Realistic Web Environment for Building Autonomous Agents [92.3291458543633]
  We build an environment for language-guided agents that is highly realistic and reproducible. We focus on agents that perform tasks on the web, and create an environment with fully functional websites from four common domains. We release a set of benchmark tasks focusing on evaluating the functional correctness of task completions.
  arXiv  Detail & Related papers  (2023-07-25T22:59:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.